tokenfold-core 0.3.2

Token-aware compression for LLM payloads: shrink JSON tool-call bodies, command output, and diffs with exact tiktoken accounting and a typed safety report.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13

//! Transform implementations. Each submodule exposes a pure function over bytes/text; the
//! pipeline (`crate::pipeline`) owns all bookkeeping (token counts, `TransformReport`,
//! safety validation/rollback). Canonical IDs and ordering live in `crate::modes`.

pub mod diff;
pub mod json;
pub mod json_dict;
pub mod json_fold;
pub mod logs;
pub mod redaction;
pub mod schema;

pub use crate::modes::TransformId;