Module prompt

Module prompt 

Source
Expand description

Prompt Formatting Module

Handles formatting of LLM request prompts, including:

  • Chat template rendering
  • Tool usage formatting
  • Generation prompt handling

The module supports different prompt formatting strategies through the PromptFormatter

Structs§

ContextMixins
NoOpFormatter

Enums§

PromptFormatter
PromptInput
TextInput
TokenInput

Traits§

OAIChatLikeRequest
Trait that defines a request that can map to an OpenAI-like request.
OAIPromptFormatter