Expand description
Inference Gateway SDK for Rust
This crate provides a Rust client for the Inference Gateway API, allowing interaction with various LLM providers through a unified interface.
Structs§
- Generate
Response - The response from generating content
- Inference
Gateway Client - Client for interacting with the Inference Gateway API
- Message
- A message in a conversation with an LLM
- Model
- Represents a model available through a provider
- Provider
Models - Collection of models available from a specific provider
- Response
Content - The content of the response
- SSEvents
- Stream of Server-Sent Events (SSE) from the Inference Gateway API
- Tool
- Tool to use for the LLM toolbox
- Tool
Call - Tool to use for generation
- Tool
Call Response - A tool call in the response
- Tool
Function - Tool function to call
- Tool
Function Response - Function details in a tool call response
Enums§
- Gateway
Error - Custom error types for the Inference Gateway SDK
- Message
Role - Provider
- Supported LLM providers
- Tool
Type - Type of tool that can be used by the model
Traits§
- Inference
GatewayAPI - Core API interface for the Inference Gateway