Module fetcher 

Fetcher - RFC 9309 compliant robots.txt fetching

This module provides HTTP fetching with:

• Conditional GET (If-None-Match, If-Modified-Since)
• Proper status code handling per RFC 9309
• Comprehensive statistics

Structs

FetchStats

Fetch statistics with detailed metrics

FetchStatsSnapshot

Snapshot of fetch statistics

RobotsFetcher

Robots.txt fetcher with RFC 9309 compliance