webshift 0.2.0

Denoised web search library — fetch, clean, and rerank web content for AI agents.
Documentation
webshift-0.2.0 has been yanked.

webshift

Denoised web search library for AI agents.

Fetches, cleans, and reranks web content with hard caps on context size. Designed to prevent context flooding in LLM pipelines.

Quick start

use webshift::Config;

// Standalone HTML cleaning — no network, no config needed
let result = webshift::clean("<html><body><p>Hello</p></body></html>", 8000);
println!("{}", result.text);

// Fetch and clean a page
# async fn example() -> Result<(), webshift::WebshiftError> {
let config = Config::default();
let result = webshift::fetch("https://example.com", &config).await?;
println!("{}", result.text);
# Ok(())
# }