Struct TextLoader 

pub struct TextLoader {
    pub path: PathBuf,
    pub split_by_line: bool,
}

Text document loader

Supports loading plain-text files (.txt), treating the entire file content as one document.

Fields

path: PathBuf

Text file path

split_by_line: bool

Whether to split by line (optional) If true, each line is returned as a separate document

Implementations

impl TextLoader

pub fn new(path: impl Into<PathBuf>) -> Self

Creates a new Text loader

Arguments

• path - the text file path

pub fn new_with_line_split(path: impl Into<PathBuf>) -> Self

Creates a line-splitting Text loader

Each line is returned as a separate document.

Arguments

• path - the text file path

pub fn with_split_by_line(self, split: bool) -> Self

Sets whether to split by line

Trait Implementations

impl DocumentLoader for TextLoader

fn load<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<Vec<Document>, LoaderError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Loads documents from the source