Expand description
Object-safe adapters (Dyn* traits) and reference types.
Every model trait uses impl Future return types and is therefore not
object safe. For each trait this module provides a Dyn* counterpart that
boxes the futures, a blanket implementation so that every concrete model
is also a Dyn*, and a cloneable reference type (*Ref) wrapping
Arc<dyn Dyn*>.
Only import a Dyn* trait where you hold a trait object; importing both
LanguageModel and DynLanguageModel makes method calls on a concrete
model ambiguous.
Structs§
- Model
Ref - A reference to a model: either a resolved instance or a
provider:modelid that the application layer resolves through its registry. - Service
Ref - A reference to a provider service (files, skills, batch, realtime factory): always resolved.
Traits§
- DynBatch
- Object-safe counterpart of
Batch. - DynEmbedding
Model - Object-safe counterpart of
EmbeddingModel. - DynFiles
- Object-safe counterpart of
Files. - DynImage
Model - Object-safe counterpart of
ImageModel. - DynLanguage
Model - Object-safe counterpart of
LanguageModel. - DynRealtime
Factory - Object-safe counterpart of
RealtimeFactory. - DynRealtime
Model - Object-safe counterpart of
RealtimeModel. - DynReranking
Model - Object-safe counterpart of
RerankingModel. - DynSkills
- Object-safe counterpart of
Skills. - DynSpeech
Model - Object-safe counterpart of
SpeechModel. - DynSpeech
Translation Model - Object-safe counterpart of
SpeechTranslationModel. - DynTranscription
Model - Object-safe counterpart of
TranscriptionModel. - DynVideo
Model - Object-safe counterpart of
VideoModel.
Type Aliases§
- Batch
Ref - Shared reference to a batch service.
- BoxFuture
- A boxed,
Sendfuture. - BoxStream
- A boxed,
Sendstream. - Embedding
Model Ref - Shared reference to an embedding model (or an unresolved model id).
- Files
Ref - Shared reference to a files service.
- Image
Model Ref - Shared reference to an image model (or an unresolved model id).
- Language
Model Ref - Shared reference to a language model (or an unresolved model id).
- Realtime
Factory Ref - Shared reference to a realtime factory.
- Realtime
Model Ref - Shared reference to a realtime model (or an unresolved model id).
- Reranking
Model Ref - Shared reference to a reranking model (or an unresolved model id).
- Skills
Ref - Shared reference to a skills service.
- Speech
Model Ref - Shared reference to a speech model (or an unresolved model id).
- Speech
Translation Model Ref - Shared reference to a speech translation model (or an unresolved model id).
- Transcription
Model Ref - Shared reference to a transcription model (or an unresolved model id).
- Video
Model Ref - Shared reference to a video model (or an unresolved model id).