Crate llm_kit_togetherai

Crate llm_kit_togetherai 

Source
Expand description

Together AI provider implementation for the LLM Kit.

This crate provides a provider implementation for Together AI’s extensive collection of open-source models, supporting chat, embeddings, image generation, and reranking.

§Features

  • Chat completions with Llama, Mistral, Qwen, DeepSeek, and more
  • Traditional text completion interface
  • Text embeddings for semantic search
  • Image generation with FLUX and Stable Diffusion
  • Document reranking for improved search results

§Examples

use llm_kit_togetherai::TogetherAIClient;

// Create a provider using the client builder
let provider = TogetherAIClient::new()
    .api_key("your-api-key")
    .build();

let model = provider.chat_model("meta-llama/Llama-3.3-70B-Instruct-Turbo");

§Alternative: Direct Instantiation

use llm_kit_togetherai::{TogetherAIProvider, TogetherAIProviderSettings};

// Create a provider using settings
let provider = TogetherAIProvider::new(
    TogetherAIProviderSettings::new()
        .with_api_key("your-api-key")
);

let model = provider.chat_model("meta-llama/Llama-3.3-70B-Instruct-Turbo");

§Chained Usage

use llm_kit_togetherai::TogetherAIClient;

let model = TogetherAIClient::new()
    .api_key("your-api-key")
    .build()
    .chat_model("meta-llama/Llama-3.3-70B-Instruct-Turbo");

§Environment Variable

use llm_kit_togetherai::TogetherAIClient;

// API key will be read from TOGETHER_AI_API_KEY environment variable
let provider = TogetherAIClient::new()
    .load_api_key_from_env()
    .build();

let model = provider.chat_model("meta-llama/Llama-3.3-70B-Instruct-Turbo");

§Using the Provider

This provider implements the llm-kit-provider traits. See the examples directory for detailed usage with LanguageModel, EmbeddingModel, ImageModel, and RerankingModel traits.

Re-exports§

pub use client::TogetherAIClient;
pub use provider::TogetherAIProvider;
pub use settings::TogetherAIProviderSettings;
pub use chat_options::TogetherAIChatModelId;
pub use completion_options::TogetherAICompletionModelId;
pub use embedding_options::TogetherAIEmbeddingModelId;
pub use image::settings::TogetherAIImageModelId;
pub use reranking::options::TogetherAIRerankingModelId;
pub use reranking::options::TogetherAIRerankingOptions;

Modules§

chat_options
Chat model options and model IDs.
client
Client builder for creating Together AI providers.
completion_options
Completion model options and model IDs.
embedding_options
Embedding model options and model IDs.
image
Image generation models.
provider
Provider implementation and creation functions.
reranking
Reranking models.
settings
Settings and configuration for Together AI providers.