dynamo_llm::protocols::common

Module llm_backend

Source

Re-exports§

pub use super::preprocessor::PreprocessedRequest;
pub use super::FinishReason;

Structs§

BackendOutput
LLMEngineOutput
The LLM engine and backnd with manage it’s own state, specifically translating how a given request/slot is managed on that particular backend.

Type Aliases§

LogProbs
TokenType