Crate cadi_scraper

Crate cadi_scraper 

Source
Expand description

CADI Scraper/Chunker Utility

This module provides utilities for converting source code repositories and file data into reusable CADI chunks. It handles fetching, parsing, semantic chunking, metadata extraction, and publishing to registry servers.

Re-exports§

pub use error::Error;
pub use error::Result;
pub use scraper::Scraper;
pub use types::ScraperConfig;
pub use types::ScraperInput;
pub use types::ScraperOutput;
pub use types::ChunkingStrategy;

Modules§

chunker
config
error
fetcher
metadata
parser
scraper
transformer
types