Enum ParserHint 

#[non_exhaustive]
pub enum ParserHint {
    CoNLL,
    CoNLLU,
    JSON,
    JSONL,
    HuggingFaceAPI,
    BRAT,
    XML,
    ACE,
    OntoNotes,
    Custom,
}

Hint for how to parse this dataset’s format.

Used by the loader to select the appropriate parser without requiring format auto-detection.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

CoNLL

CoNLL-style column format (BIO/IOB2 tags)

CoNLLU

CoNLL-U format (Universal Dependencies)

JSON

JSON with tokens and labels arrays

JSONL

JSON Lines (one JSON object per line)

HuggingFaceAPI

HuggingFace datasets API format

BRAT

BRAT standoff annotation format

XML

XML-based format (TEI, etc.)

ACE

ACE/ERE XML format

OntoNotes

OntoNotes-style format

Custom

Custom format requiring manual parsing

Implementations

impl ParserHint

pub const fn typical_extensions(&self) -> &'static [&'static str]

File extensions typically associated with this format.

Trait Implementations

impl Clone for ParserHint

fn clone(&self) -> ParserHint

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ParserHint

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for ParserHint

fn default() -> ParserHint

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ParserHint

fn deserialize<__D>( __deserializer: __D, ) -> Result<ParserHint, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Hash for ParserHint

fn hash<__H>(&self, state: &mut __H)

where __H: Hasher,

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for ParserHint

fn eq(&self, other: &ParserHint) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ParserHint

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for ParserHint

impl Eq for ParserHint

impl StructuralPartialEq for ParserHint