Struct CustomTransformationConfiguration 

#[non_exhaustive]
pub struct CustomTransformationConfiguration {
    pub intermediate_storage: Option<IntermediateStorage>,
    pub transformations: Vec<Transformation>,
}

Settings for customizing steps in the data source content ingestion pipeline.

You can configure the data source to process documents with a Lambda function after they are parsed and converted into chunks. When you add a post-chunking transformation, the service stores chunked documents in an S3 bucket and invokes a Lambda function to process them.

To process chunked documents with a Lambda function, define an S3 bucket path for input and output objects, and a transformation that specifies the Lambda function to invoke. You can use the Lambda function to customize how chunks are split, and the metadata for each chunk.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

intermediate_storage: Option<IntermediateStorage>

An S3 bucket path for input and output objects.

transformations: Vec<Transformation>

A Lambda function that processes documents.

Implementations

impl CustomTransformationConfiguration

pub fn intermediate_storage(&self) -> Option<&IntermediateStorage>

An S3 bucket path for input and output objects.

pub fn transformations(&self) -> &[Transformation]

A Lambda function that processes documents.

impl CustomTransformationConfiguration

pub fn builder() -> CustomTransformationConfigurationBuilder

Creates a new builder-style object to manufacture CustomTransformationConfiguration.

Trait Implementations

impl Clone for CustomTransformationConfiguration

fn clone(&self) -> CustomTransformationConfiguration

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CustomTransformationConfiguration

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for CustomTransformationConfiguration

fn eq(&self, other: &CustomTransformationConfiguration) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for CustomTransformationConfiguration