Expand description
Server implementation for the OpenAI-compatible API
Structs§
- AppState
- Server state shared across all requests
- Args
- Command line arguments for server configuration
- Chat
Completion Request - Chat completion request (OpenAI compatible)
- Choice
- Chat completion response choices (OpenAI compatible)
- Content
Block - Structured content block
- Content
Object - Content object with type and other fields
- Message
- Chat message structure (OpenAI compatible)
- Message
Inner - OpenAI
Response - Base response structure for OpenAI-compatible API
- Usage
- Token usage information
Enums§
- Content
Value - Content value can be string, array of strings, or structured content
Functions§
- run
- Start the Axum server
- run_
with_ args - Start the Axum server with provided arguments