Expand description
Inference Gateway SDK for Rust
This crate provides a Rust client for the Inference Gateway API, allowing interaction with various LLM providers through a unified interface.
Structs§
- Generate
Response - Inference
Gateway Client - Client for interacting with the Inference Gateway API
- Message
- A message in a conversation with an LLM
- Model
- Represents a model available through a provider
- Provider
Models - Collection of models available from a specific provider
- Response
Content - SSEvents
- Stream of Server-Sent Events (SSE) from the Inference Gateway API
Enums§
- Gateway
Error - Custom error types for the Inference Gateway SDK
- Message
Role - Provider
- Supported LLM providers
Traits§
- Inference
GatewayAPI - Core API interface for the Inference Gateway