Module document_source 

Document source port — read files from the local file system Document source port — read local files as pipeline data sources.

Defines the [DocumentSourcePort] trait for reading documents (CSV, JSON, Markdown, plain text, etc.) from the local file system and returning their content for downstream processing.

Architecture

stygian-graph
  ├─ DocumentSourcePort (this file)      ← always compiled
  └─ Adapters (adapters/)
       └─ DocumentSource                 → std::fs / tokio::fs

Example

use stygian_graph::ports::document_source::{DocumentSourcePort, DocumentQuery};
use std::path::PathBuf;

async fn read_docs<D: DocumentSourcePort>(source: &D) {
    let query = DocumentQuery {
        path: PathBuf::from("data/input.csv"),
        recursive: false,
        glob_pattern: None,
    };
    let docs = source.read_documents(query).await.unwrap();
    for doc in &docs {
        println!("{}: {} bytes", doc.path.display(), doc.content.len());
    }
}

Structs

Document

A document read from the file system.

DocumentQuery

Query parameters for reading documents from the file system.

Traits

DocumentSourcePort

Port: read documents from the local file system.