Struct GenerationConfiguration 

#[non_exhaustive]
pub struct GenerationConfiguration {
    pub prompt_template: Option<PromptTemplate>,
    pub guardrail_configuration: Option<GuardrailConfiguration>,
    pub kb_inference_config: Option<KbInferenceConfig>,
    pub additional_model_request_fields: Option<HashMap<String, Document>>,
}

The configuration details for response generation based on retrieved text chunks.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

prompt_template: Option<PromptTemplate>

Contains the template for the prompt that's sent to the model for response generation.

guardrail_configuration: Option<GuardrailConfiguration>

Contains configuration details for the guardrail.

kb_inference_config: Option<KbInferenceConfig>

Contains configuration details for inference for knowledge base retrieval and response generation.

additional_model_request_fields: Option<HashMap<String, Document>>

Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows you to provide custom model parameters specific to the language model being used.

Implementations

impl GenerationConfiguration

pub fn prompt_template(&self) -> Option<&PromptTemplate>

Contains the template for the prompt that's sent to the model for response generation.

pub fn guardrail_configuration(&self) -> Option<&GuardrailConfiguration>

Contains configuration details for the guardrail.

pub fn kb_inference_config(&self) -> Option<&KbInferenceConfig>

Contains configuration details for inference for knowledge base retrieval and response generation.

pub fn additional_model_request_fields( &self, ) -> Option<&HashMap<String, Document>>

Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows you to provide custom model parameters specific to the language model being used.

impl GenerationConfiguration

pub fn builder() -> GenerationConfigurationBuilder

Creates a new builder-style object to manufacture GenerationConfiguration.

Trait Implementations

impl Clone for GenerationConfiguration

fn clone(&self) -> GenerationConfiguration

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GenerationConfiguration

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for GenerationConfiguration

fn eq(&self, other: &GenerationConfiguration) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for GenerationConfiguration