Crate kalosm_sample

kalosm-sample

This is a sampling library for Kalosm.

It handles choosing a token from a probability distribution. Samplers can be used to constrain the generation of text for example you can use a sampler to prevent the model from generating the same word twice in a row. Or you could only allow the model to generate a list of single digit numbers.

Structs

• ArcParser
  A boxed parser.
• ArrayParser
  A parser for a fixed size array of a type.
• ChoiceParser
  A parser for a choice of two parsers.
• ChoiceParserState
  State of a choice parser.
• DynTokenizer
  A type erased wrapper for a tokenizer.
• FasterHuggingFaceTokenizer
  A tokenizer that uses the HuggingFace tokenizer with a cache for single tokens.
• FloatParser
  A parser for a float.
• FloatParserState
  The state of an integer parser.
• I8Parser
  A parser for i8.
• I16Parser
  A parser for i16.
• I32Parser
  A parser for i32.
• I64Parser
  A parser for i64.
• IntegerParser
  A parser for an integer.
• IntegerParserState
  The state of an integer parser.
• LiteralMismatchError
  The error type for a literal parser.
• LiteralParser
  A parser for a literal.
• LiteralParserOffset
  The state of a literal parser.
• MapOutputParser
  A parser that maps the output of another parser.
• RegexParser
  A parser that uses a regex pattern to parse input.
• RepeatParser
  A parser for a repeat of two parsers.
• RepeatParserState
  State of a repeat parser.
• Sentence
  A single word.
• SentenceParser
  A parser for a word.
• SeparatedParser
  A parser for a repeat of two parsers.
• SeparatedParserState
  State of a repeat parser.
• SequenceParser
  A parser for a sequence of two parsers.
• StopOn
  A parser that parses until a literal is found.
• StopOnOffset
  The state of a stop on literal parser.
• StopOnParseError
  An error that can occur while parsing a string literal.
• StringParseError
  An error that can occur while parsing a string literal.
• StringParser
  A parser for an ascii string.
• StringParserState
  The state of a literal parser.
• U8Parser
  A parser for u8.
• U16Parser
  A parser for u16.
• U32Parser
  A parser for u32.
• U64Parser
  A parser for u64.
• VecParser
  A parser for a vector of a type.
• Word
  A single word.
• WordParser
  A parser for a word.

Enums

• Either
  A value that can be one of two types.
• OwnedParseResult
  A parser for a choice between two parsers.
• ParseResult
  The state of a parser.
• SeparatedItemState
  The state of the item in the separated parser.
• SequenceParserState
  State of a sequence parser.
• StructureParser
  A validator for a string
• StructureParserState
  The state of a structure parser.

Traits

• CreateParserState
  A trait for a parser with a default state.
• HasParser
  Data that can be parsed incrementally.
• Parser
  An incremental parser for a structured input.
• ParserExt
  An extension trait for parsers.
• Tokenizer
  A tokenizer is a type that can decode a list of token ids into a string.