Crate orch

Source
Expand description

§orch

See the main README for more information.

Modules§

alignment
A module containing all logic related to alignment. Alignment, in this context, means “aligning” the model’s output with the desired output. This takes the form of a so-called [AlignmentStrategy], which is a trait that defines how to align the model’s output.
execution
A module containing all logic related to LLM execution. An [Executor] is the terminology for a component which executes an LLM, and aligns it appropriately (e.g., error correction).
lm
A module containing all logic related to LMs (Language Models). This don’t strictly have to be large language models (i.e., SLMs such as Phi-3 or Mistral NeMo are included).
response