Skip to main content

Module openai_compat

chasm_cli::providers

Module openai_compat 

Source
Expand description

OpenAI-compatible provider support

Supports servers that implement the OpenAI Chat Completions API:

  • vLLM
  • LM Studio
  • LocalAI
  • Text Generation WebUI
  • Jan.ai
  • GPT4All
  • Llamafile
  • Azure AI Foundry (Foundry Local)
  • Any custom OpenAI-compatible endpoint

Structs§

OpenAIChatChoice
OpenAI chat completion choice
OpenAIChatMessage
OpenAI chat message format
OpenAIChatRequest
OpenAI chat completion request
OpenAIChatResponse
OpenAI chat completion response
OpenAICompatProvider
OpenAI-compatible API provider

Functions§

discover_openai_compatible_providers
Discover available OpenAI-compatible providers