Skip to main content

Module document

Module document 

Source
Expand description

File system / document source adapter File system document source adapter.

Implements [DocumentSourcePort] and [ScrapingService] for reading files from the local file system. Supports glob-based file discovery, recursive directory traversal, and MIME-type detection.

§Example

use stygian_graph::adapters::document::DocumentSource;
use stygian_graph::ports::document_source::{DocumentSourcePort, DocumentQuery};
use std::path::PathBuf;

let source = DocumentSource::new();
let query = DocumentQuery {
    path: PathBuf::from("data/"),
    recursive: true,
    glob_pattern: Some("*.json".into()),
};
let docs = source.read_documents(query).await.unwrap();

Structs§

DocumentSource
Adapter: local file system as a pipeline data source.