Skip to main content

ComputeLanguageModelRequests

Trait ComputeLanguageModelRequests 

Source
pub trait ComputeLanguageModelRequests {
    type Seed: HasAssociatedOutputName + Send + Sync;

    // Required method
    fn compute_language_model_requests(
        &self,
        model: &LanguageModelType,
        input_tokens: &[Self::Seed],
    ) -> Vec<LanguageModelBatchAPIRequest>;
}
Expand description

This is the trait we will typically need to implement manually

Required Associated Types§

Required Methods§

Source

fn compute_language_model_requests( &self, model: &LanguageModelType, input_tokens: &[Self::Seed], ) -> Vec<LanguageModelBatchAPIRequest>

Identify which new items need to be processed and build the requests.

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§