Struct DocsSiteFetcher 

pub struct DocsSiteFetcher;

Documentation site fetcher with llms.txt support

Matches known documentation sites and explicit llms.txt URLs. For matched sites, probes for llms-full.txt/llms.txt at the origin before returning content.

Implementations

impl DocsSiteFetcher

pub fn new() -> Self

Trait Implementations

impl Default for DocsSiteFetcher

fn default() -> Self

Returns the “default value” for a type.

impl Fetcher for DocsSiteFetcher

fn name(&self) -> &'static str

Unique identifier for this fetcher (for logging/debugging)

fn matches(&self, url: &Url) -> bool

Returns true if this fetcher can handle the given URL

fn fetch<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, request: &'life1 FetchRequest, options: &'life2 FetchOptions, ) -> Pin<Box<dyn Future<Output = Result<FetchResponse, FetchError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Fetch content from the URL

fn fetch_to_file<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, request: &'life1 FetchRequest, options: &'life2 FetchOptions, saver: &'life3 dyn FileSaver, ) -> Pin<Box<dyn Future<Output = Result<FetchResponse, FetchError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

Fetch with file saving support.