Expand description
Inference Gateway SDK for Rust
This crate provides a Rust client for the Inference Gateway API, allowing interaction with various LLM providers through a unified interface.
Structs§
- Generate
Response - Inference
Gateway Client - Client for interacting with the Inference Gateway API
- Message
- A message in a conversation with an LLM
- Model
- Represents a model available through a provider
- Provider
Models - Collection of models available from a specific provider
- Response
Content
Enums§
Traits§
- Inference
GatewayAPI - Core API interface for the Inference Gateway