Crate rllm

Source
Expand description

Rust LLM (RLLM) provides a unified interface for interacting with various LLM providers.

This crate abstracts away provider-specific implementation details to offer a consistent API for both chat and completion style interactions with language models.

Modules§

  • Module containing backend implementations for different LLM providers
  • Module for building and configuring LLM providers
  • Module for chain of LLM providers
  • Module for chat-based interactions with LLMs
  • Module for text completion interactions with LLMs
  • Module defining error types used throughout the crate

Traits§

  • Trait combining chat and completion capabilities that all LLM providers must implement