llm_together#

class baf.nlp.llm.llm_together.LLMTogether(agent, name, parameters, num_previous_messages=1, global_context=None)[source]#

Bases: LLMOpenAICompatible

LLM wrapper for Together AI models via Together’s OpenAI-compatible API.

Requires nlp.together.api_key to be set in the agent config file. The default base URL points to https://api.together.xyz/v1.

Example model names: "meta-llama/Llama-3.3-70B-Instruct-Turbo", "mistralai/Mixtral-8x22B-Instruct-v0.1", "Qwen/Qwen2.5-72B-Instruct-Turbo".

API_KEY_PROPERTY = <baf.core.property.Property object>#

Property constant used to look up the API key from the agent config file.

DEFAULT_BASE_URL = 'https://api.together.xyz/v1'#

Provider base URL. None → use the OpenAI SDK default (api.openai.com).

_abc_impl = <_abc._abc_data object>#