llm_groq#

class baf.nlp.llm.llm_groq.LLMGroq(agent, name, parameters, num_previous_messages=1, global_context=None)[source]#

Bases: LLMOpenAICompatible

LLM wrapper for Groq-hosted models via Groq’s OpenAI-compatible API.

Requires nlp.groq.api_key to be set in the agent config file. The default base URL points to https://api.groq.com/openai/v1.

Example model names: "llama-3.3-70b-versatile", "llama3-8b-8192", "gemma2-9b-it", "mixtral-8x7b-32768".

API_KEY_PROPERTY = <baf.core.property.Property object>#

Property constant used to look up the API key from the agent config file.

DEFAULT_BASE_URL = 'https://api.groq.com/openai/v1'#

Provider base URL. None → use the OpenAI SDK default (api.openai.com).

_abc_impl = <_abc._abc_data object>#