Module map 

TokenizerMap — the per-model dialect record. Maps are content-addressed (sha256) and immutable.

Structs

TokenizerMap

A per-model tokenizer dialect — the data needed to encode text into token IDs and decode IDs back to text.

ToolCallingBlock

Per-model tool-calling convention block carried inside a TokenizerMap. Each convention value pins a specific argument layout, marker placement, and result framing — see spec/PROTOCOL.md § “Tool-call calling conventions in the map” for the normative table.

ToolCallingMarkers

Start/end marker token names for a tool call.

Enums

TokenizerMapError

Errors raised by TokenizerMap parsing/validation.

ToolCallingArgsFormat

ToolCallingConvention

Closed enum of tool-calling conventions. See spec/PROTOCOL.md for the normative behaviour pinned to each value.

ToolCallingResultFormat