List of all items

Structs

• GeneratedItemEmitter
• InferenceJob
• JobHandle
• StdOutListener
• TextGenerationListener
• channels::mutex::MutexChannel
• channels::passthrough::SingleThreadedChannel
• client::InferenceClient
• message::Message
• stats::Stats

Enums

• GeneratedItem
• InferenceTask
• errors::InferenceError
• message::MessageRole
• stats::StatEntry

Traits

• Any
• Backend
• CommandFactory
• Deserialize
• FromArgMatches
• InferenceJobListener
• Parser
• channels::base::InferenceChannel
• plugin::InferencePlugin
• server::InferenceServer
• server::InferenceServerConfig
• server::ServerConfigParsing

Attribute Macros

• inference_server_config

Derive Macros

• Deserialize
• InferenceServer
• Parser

Functions

• utils::parse_command

Type Aliases

• Prompt
• backends::ElemType
• backends::burn_backend_types::InferenceBackend
• backends::burn_backend_types::InferenceDevice
• errors::InferenceOptionalResult
• errors::InferenceResult
• plugin::CreateCliFlagsFn

Constants

• backends::DTYPE_NAME
• backends::burn_backend_types::INFERENCE_DEVICE
• backends::burn_backend_types::NAME
• stats::STATS_MARKER