Module prompt

Source
Expand description

Prompt Formatting Module

Handles formatting of LLM request prompts, including:

  • Chat template rendering
  • Tool usage formatting
  • Generation prompt handling

The module supports different prompt formatting strategies through the PromptFormatter

Structs§

ContextMixins

Enums§

PromptFormatter

Traits§

OAIChatLikeRequest
Trait that defines a request that can map to an OpenAI-like request.
OAIPromptFormatter