Expand description
gllm: Pure Rust embeddings and rerank library built on Burn.
Structs§
- Client
- Client for embeddings and reranking.
- Client
Config - Client configuration options.
- Embedder
Handle - Embedding
- Single embedding vector.
- Embedding
Response - Embedding response containing all vectors and usage stats.
- Embeddings
Builder - Embeddings request builder.
- Model
Info - Metadata describing a model.
- Model
Registry - Registry of built-in model aliases.
- Rerank
Builder - Rerank request builder.
- Rerank
Response - Rerank response containing sorted results.
- Rerank
Result - Single rerank result entry.
- Reranker
Handle - Usage
- Token usage statistics.
Enums§
- Architecture
- Architecture of a model.
- Device
- Device selection for inference.
- Error
- gllm error type.
- Model
Type - Model type supported by the library.
Type Aliases§
- Result
- Result alias for gllm operations.