Enum TokenChunkingError

pub enum TokenChunkingError {
    ChunkOverlapTooLarge(String),
    TokenizationError(String),
    InvalidChunkSize(String),
}

Chunkers

Module to contain all the methods of chunking allowing for prepping text before embedding and storing it.

[ChunkingError]

Custom error type representing errors that can occur during chunking

Variants

ChunkOverlapTooLarge(String)

TokenizationError(String)

InvalidChunkSize(String)

Trait Implementations

impl Debug for TokenChunkingError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for TokenChunkingError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for TokenChunkingError

fn source(&self) -> Option<&(dyn Error + 'static)>

Returns the lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0: use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0: replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, request: &mut Request<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type-based access to context intended for error reports.

impl PartialEq for TokenChunkingError

fn eq(&self, other: &TokenChunkingError) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for TokenChunkingError

impl StructuralPartialEq for TokenChunkingError