List of all items

Structs

• api::openai::ChatCompletionChoice
• api::openai::ChatCompletionRequest
• api::openai::ChatCompletionResponse
• api::openai::ChatMessage
• api::openai::CompletionChoice
• api::openai::CompletionRequest
• api::openai::CompletionResponse
• api::openai::ErrorInfo
• api::openai::ErrorResponse
• api::openai::ListModelsResponse
• api::openai::ModelData
• api::openai::StreamChatCompletionChoice
• api::openai::StreamChatCompletionResponse
• api::openai::StreamCompletionChoice
• api::openai::StreamCompletionResponse
• api::openai::Usage
• api::pool::ModelPool
• api::server::AppState
• api::tllama_api::chat
• api::tllama_api::discover
• api::tllama_api::infer
• api::tllama_api::list_models
• api::tllama_api::load_model
• api::tllama_api::unload_model
• cli::ChatArgs
• cli::Cli
• cli::DiscoverArgs
• cli::InferArgs
• cli::ServeArgs
• discover::MODEL_DISCOVERER
• discover::Model
• discover::ModelDiscover
• engine::EngineConfig
• engine::adapter::InferenceEngine
• engine::llama_cpp::LLAMA_BACKEND
• engine::llama_cpp::LlamaEngine
• template::Function
• template::FunctionParameters
• template::Message
• template::NamedTemplate
• template::TemplateData
• template::TemplateParameters
• template::Tool
• template::ToolCall
• template::ToolProperty

Enums

• cli::Commands
• discover::ModelType

Traits

• engine::EngineBackend

Macros

• def_callback

Functions

• api::openai::create_chat_completion
• api::openai::create_completion
• api::openai::health_check
• api::openai::list_models
• api::openai::openai_config
• api::server::start_api_server
• api::tllama_api::tllama_config
• chat::chat_session
• template::collate_messages
• template::gtmpl::from_serde
• template::gtmpl::render_any_template
• template::gtmpl::render_chatml_template