Struct swiftide_indexing::transformers::embed::Embed

pub struct Embed { /* private fields */ }

A transformer that can generate embeddings for an Node

This file defines the Embed struct and its implementation of the BatchableTransformer trait.

Implementations

impl Embed

pub fn new(model: impl EmbeddingModel + 'static) -> Self

Creates a new instance of the Embed transformer.

Parameters

• model - An embedding model that implements the EmbeddingModel trait.

Returns

A new instance of Embed.

pub fn with_concurrency(self, concurrency: usize) -> Self

Trait Implementations

impl BatchableTransformer for Embed

fn batch_transform<'life0, 'async_trait>( &'life0 self, nodes: Vec<Node>, ) -> Pin<Box<dyn Future<Output = IndexingStream> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Transforms a batch of Node objects by generating embeddings for them.

Parameters

• nodes - A vector of Node objects to be transformed.

Returns

An IndexingStream containing the transformed Node objects with their embeddings.

Errors

If the embedding process fails, the function returns a stream with the error.

fn concurrency(&self) -> Option<usize>

Overrides the default concurrency of the pipeline

impl Debug for Embed

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.