Struct FileLoader 

pub struct FileLoader<'a, T> { /* private fields */ }

Iterator pipeline for loading UTF-8 documents. Reads happen synchronously during iteration; per-item I/O and decoding errors are yielded unless filtered.

Implementations

impl<'a, T: Readable + 'a> FileLoader<'a, T>

pub fn read(self) -> FileLoader<'a, Result<String, FileLoaderError>>

Decodes each input as UTF-8 during iteration, yielding I/O or decoding errors.

let content = FileLoader::with_glob("files/*.txt")?.read();
for result in content {
    match result {
        Ok(content) => println!("{content}"),
        Err(e) => eprintln!("Error reading file: {e}"),
    }
}

pub fn read_with_path( self, ) -> FileLoader<'a, Result<(PathBuf, String), FileLoaderError>>

Decodes each input as UTF-8 and pairs it with its source path, yielding I/O or decoding errors. In-memory inputs use the path <memory>.

let content = FileLoader::with_glob("files/*.txt")?.read_with_path();
for result in content {
    match result {
        Ok((path, content)) => println!("{path:?} {content}"),
        Err(e) => eprintln!("Error reading file: {e}"),
    }
}

impl<'a, T: 'a> FileLoader<'a, Result<T, FileLoaderError>>

pub fn ignore_errors(self) -> FileLoader<'a, T>

Discards error items and yields unwrapped successful values.

impl<'a> FileLoader<'a, Result<PathBuf, FileLoaderError>>

pub fn with_glob( pattern: &str, ) -> Result<FileLoader<'_, Result<PathBuf, FileLoaderError>>, FileLoaderError>

Creates a loader over glob matches. Invalid patterns fail immediately; traversal errors are yielded during iteration.

pub fn with_dir( directory: &str, ) -> Result<FileLoader<'_, Result<PathBuf, FileLoaderError>>, FileLoaderError>

Creates a new loader on all files within a directory (ignores subdirectories).

impl<'a> FileLoader<'a, Vec<u8>>

pub fn from_bytes(bytes: Vec<u8>) -> FileLoader<'a, Vec<u8>>

Ingest a document as a byte array.

pub fn from_bytes_multi(bytes_vec: Vec<Vec<u8>>) -> FileLoader<'a, Vec<u8>>

Ingest multiple byte arrays.

Trait Implementations

impl<'a, T> IntoIterator for FileLoader<'a, T>

type Item = T

The type of the elements being iterated over.

type IntoIter = IntoIter<'a, T>

Which kind of iterator are we turning this into?

fn into_iter(self) -> Self::IntoIter

Creates an iterator from a value.