Skip to main content

Crate webfetch_core

Crate webfetch_core 

Source
Expand description

Shared primitives for the webfetch/websearch tools: text compression and token budgeting (compress), reference-style URL preservation and the reference-aware token budget (refs), HTTP fetch primitives — user agent, body cap, retry classification (http) — and shared HTTP-client TLS trust configuration (tls). Both leaf crates re-export these so their internal modules can keep using crate::compress / crate::refs / crate::tls.

Modules§

charset
Decoding response bodies that are not UTF-8.
compress
http
HTTP primitives shared by the fetch and search paths: the user agent, the response-body cap, and the retry classification. Both paths previously carried their own copy of the last two and had drifted apart — search read bodies without any cap at all.
refs
Shared reference-style URL preservation.
tls
Shared TLS trust configuration for the HTTP clients.