Skip to main content

Crate webfetch_core

Crate webfetch_core 

Source
Expand description

Shared primitives for the webfetch/websearch tools: text compression and token budgeting (compress), reference-style URL preservation and the reference-aware token budget (refs), HTTP primitives — user agent, body cap, retry classification (http) — and the transport abstraction the libraries send requests through. The native transport::ReqwestTransport and shared TLS trust configuration (tls) are behind the native feature; the WASI 0.2 [transport::WasiTransport] is behind wasi. Both leaf crates re-export these so their internal modules can keep using crate::compress / crate::refs / crate::tls.

Modules§

charset
Decoding response bodies that are not UTF-8.
compress
http
HTTP primitives shared by the fetch and search paths: the user agent, the response-body cap, and the retry classification. Both paths previously carried their own copy of the last two and had drifted apart — search read bodies without any cap at all.
refs
Shared reference-style URL preservation.
tls
Shared TLS trust configuration for the HTTP clients.
transport
The HTTP seam the libraries send requests through.