Struct TextLoader 

pub struct TextLoader { /* private fields */ }

Loads a single UTF-8 text file as one Document.

metadata.source is set to the absolute (or as-given) path.

Implementations

impl TextLoader

pub fn new(path: impl AsRef<Path>) -> Self

Construct a loader for the file at path.

pub fn lossy(self) -> Self

Skip the UTF-8 validity check (loader will lossily decode).

Trait Implementations

impl DocumentLoader for TextLoader

fn load<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<DocumentStream>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Stream of documents. Errors are per-item so a partial-failure source can still yield successful items.

fn load_all<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<Vec<Document>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Convenience: collect every yielded document. Stops at the first error.