Module common

Source
Expand description

§Common blocks for generic pipelines (e.g. token classification or sequence classification)

Provides Enums holding configuration or tokenization resources that can be used to create generic pipelines. The model component is defined in the generic pipeline itself as the pre-processing, forward pass and postprocessing differs between pipelines while basic config and tokenization objects don’t.

Structs§

ONNXLocalPaths
ONNXModelResources
Container for ONNX model resources, containing 3 optional resources (Encoder, Decoder and Decoder with past)

Enums§

ConfigOption
Abstraction that holds a model configuration, can be of any of the supported models
ModelResource
Variants to store either a Torch model resource or ONNX resources
ModelType
Identifies the type of model
TokenizerOption
Abstraction that holds a particular tokenizer, can be of any of the supported models

Functions§

cast_var_store