Huggingface

Using Huggingface models with Upsonic

Overview

Huggingface provides access to thousands of open-source models through their Inference API. Great for experimentation with cutting-edge models.

Model Class: HuggingFaceModel

Authentication

export HF_TOKEN="hf_..."

Examples

from upsonic import Agent, Task
from upsonic.models.huggingface import HuggingFaceModel

model = HuggingFaceModel(model_name="meta-llama/Llama-3.3-70B-Instruct")
agent = Agent(model=model)

task = Task("Hello, how are you?")
result = agent.do(task)
print(result)

Parameters

Parameter	Type	Description	Default	Source
max_tokens	int	Maximum tokens to generate	2048	Base
temperature	float	Sampling temperature (0.0-1.0)	0.7	Base
top_p	float	Nucleus sampling	0.95	Base
seed	int	Random seed	None	Base
stop_sequences	list[str]	Stop sequences	None	Base
timeout	float	Request timeout (seconds)	600	Base