Expand description

The EncodedInput is the “normal” input, a map of codes, that can be sent directly to the client (As opposed to other, more abstract, imputs, like an Grammar-Based AST Input)

Structs

A codes input is the basic input

A native tokenizer struct

A token input encoder/decoder

Traits

Trait to decode encoded input to bytes

Trait to encode bytes to an EncodedInput using the given Tokenizer

Tokenizer is a trait that can tokenize bytes into a ]Vec of tokens