Crate llm_daemon

Structs

• Generator
• LlamaConfig
• LlamaDaemon
• MlcConfig
• MlcDaemon
• Proxy
• ProxyConfig

Traits

• LlmConfig
• LlmDaemon
  Represents a generic daemon capable of performing background tasks, including spawning itself, maintaining a heartbeat, and generating responses based on prompts.