Skip to main content

Module transforms

Module transforms 

Source
Expand description

Transform implementations. Each submodule exposes a pure function over bytes/text; the pipeline (crate::pipeline) owns all bookkeeping (token counts, TransformReport, safety validation/rollback). Canonical IDs and ordering live in crate::modes.

Re-exports§

pub use crate::modes::TransformId;

Modules§

diff
diff_compaction (canonical id: "diff_compaction", v1.0.0).
json
json_minify transform (canonical id "json_minify", v1.0.0).
json_dict
json_value_dict transform (canonical id "json_value_dict", v1.0.0).
json_fold
json_field_fold transform (canonical id "json_field_fold", v1.0.0).
logs
log_compaction transform (canonical id "log_compaction", v1.0.0).
redaction
secret_redaction (canonical transform id: "secret_redaction"): a mandatory safety preprocessor that scans text for common enterprise secret shapes (JWTs, API keys, AWS access key IDs, basic-auth-in-URL credentials, and bearer tokens) and replaces each match with a fixed marker naming which kind of secret was found, without ever echoing the secret’s actual value back into the output.
schema
schema_compaction (canonical transform id: "schema_compaction", version 1.0.0): a semantics-preserving transform for JSON payloads containing JSON-Schema-shaped fragments and/or OpenAI-style tool/function definitions.