webtools-core 0.1.9

Shared primitives: compression, token budgeting, and reference-style URLs
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26

# webtools-core

Shared primitives for the [`webtools`](https://github.com/kolisachint/webtools)
fetch + search libraries: text compression, token budgeting, and the canonical
**reference-style URL** rendering (`[N]` markers + a trailing reference block).

> Published on crates.io as `webtools-core`; the library import name is
> `webfetch_core`.

```toml
[dependencies]
webfetch_core = { package = "webtools-core", version = "0.1" }
```

```rust
use webfetch_core::compress::estimate_tokens;
use webfetch_core::refs::{render_block, Reference};

let refs = vec![Reference { index: 1, url: "https://example.com".into() }];
println!("{}", render_block(&refs));
println!("~{} tokens", estimate_tokens("some text"));
```

## License

[MIT](https://github.com/kolisachint/webtools/blob/main/LICENSE)