Module rust_bert::pipelines::common

Common blocks for generic pipelines (e.g. token classification or sequence classification)

Provides Enums holding configuration or tokenization resources that can be used to create generic pipelines. The model component is defined in the generic pipeline itself as the pre-processing, forward pass and postprocessing differs between pipelines while basic config and tokenization objects don’t.

Structs

• ONNXLocalPaths
• ONNXModelResources
  Container for ONNX model resources, containing 3 optional resources (Encoder, Decoder and Decoder with past)

Enums

• ConfigOption
  Abstraction that holds a model configuration, can be of any of the supported models
• ModelResource
  Variants to store either a Torch model resource or ONNX resources
• ModelType
  Identifies the type of model
• TokenizerOption
  Abstraction that holds a particular tokenizer, can be of any of the supported models

Functions

• cast_var_store