Skip to content

Providers

The engine supports three provider adapters through a common interface.

Supported Providers

  • anthropic (default model: claude-sonnet-4-20250514)
  • openai (default model: gpt-4o)
  • gemini (default model: gemini-2.5-flash)

Env Vars

  • ANTHROPIC_API_KEY
  • OPENAI_API_KEY
  • GOOGLE_API_KEY

Unified Interface

All providers implement:

  • complete(messages, tools, temperature, max_tokens, json_mode)
  • complete_json(...)

Unified response fields:

  • content
  • tool_calls
  • input_tokens
  • output_tokens
  • model
  • stop_reason

Provider-Specific Notes

Anthropic

  • Uses anthropic.AsyncAnthropic.
  • JSON mode is emulated via assistant prefill with {.

OpenAI

  • Uses openai.AsyncOpenAI chat completions.
  • JSON mode uses response_format={"type": "json_object"}.

Gemini

  • Uses google.genai client.
  • JSON mode sets response_mime_type="application/json".

Unknown Provider Handling

get_provider(...) raises ValueError for unsupported provider names.

MIT Licensed