Struct TogetherAiClient 

pub struct TogetherAiClient { /* private fields */ }

Client for TogetherAI open source model hosting

API Details

• Base URL: https://api.together.xyz/v1
• Requires API key
• Falls back to mock data when no API key is available

Environment Variables

• TOGETHER_API_KEY: Required API key

Implementations

impl TogetherAiClient

pub fn new() -> Self

Create a new TogetherAI client

Reads API key from TOGETHER_API_KEY environment variable.

pub fn with_embedding_dim(embedding_dim: usize) -> Self

Create a new TogetherAI client with custom embedding dimension

pub async fn list_models(&self) -> Result<Vec<TogetherModel>>

List available models

pub async fn chat_completion( &self, model: &str, messages: Vec<TogetherMessage>, ) -> Result<String>

Chat completion

Arguments

• model - Model identifier
• messages - Chat message history

pub async fn embeddings(&self, model: &str, input: &str) -> Result<Vec<f32>>

Generate embeddings

Arguments

• model - Embedding model identifier
• input - Text to embed

pub fn model_to_vector(&self, model: &TogetherModel) -> SemanticVector

Convert TogetherAI model to SemanticVector

Trait Implementations

impl Default for TogetherAiClient

fn default() -> Self

Returns the “default value” for a type.