Struct Projection 

pub struct Projection<T: SubwordTokenizer> { /* private fields */ }

A Projection combines a Tokenizer and a Codebook.

Implementations

impl<T: SubwordTokenizer> Projection<T>

pub fn new(tokenizer: T, codebook: Codebook) -> Self

Create a new Projection.

pub fn encode(&self, text: &str) -> Vec<f32>

Encode text into a single vector using mean pooling.

pub fn encode_sequence(&self, text: &str) -> Vec<Vec<f32>>

Encode text into a sequence of vectors (no pooling).