#[non_exhaustive]pub enum ParserHint {
CoNLL,
CoNLLU,
JSON,
JSONL,
HuggingFaceAPI,
BRAT,
XML,
ACE,
OntoNotes,
Custom,
}Expand description
Hint for how to parse this dataset’s format.
Used by the loader to select the appropriate parser without requiring format auto-detection.
Variants (Non-exhaustive)§
This enum is marked as non-exhaustive
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
CoNLL
CoNLL-style column format (BIO/IOB2 tags)
CoNLLU
CoNLL-U format (Universal Dependencies)
JSON
JSON with tokens and labels arrays
JSONL
JSON Lines (one JSON object per line)
HuggingFaceAPI
HuggingFace datasets API format
BRAT
BRAT standoff annotation format
XML
XML-based format (TEI, etc.)
ACE
ACE/ERE XML format
OntoNotes
OntoNotes-style format
Custom
Custom format requiring manual parsing
Implementations§
Source§impl ParserHint
impl ParserHint
Sourcepub const fn typical_extensions(&self) -> &'static [&'static str]
pub const fn typical_extensions(&self) -> &'static [&'static str]
File extensions typically associated with this format.
Trait Implementations§
Source§impl Clone for ParserHint
impl Clone for ParserHint
Source§fn clone(&self) -> ParserHint
fn clone(&self) -> ParserHint
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ParserHint
impl Debug for ParserHint
Source§impl Default for ParserHint
impl Default for ParserHint
Source§fn default() -> ParserHint
fn default() -> ParserHint
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for ParserHint
impl<'de> Deserialize<'de> for ParserHint
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Hash for ParserHint
impl Hash for ParserHint
Source§impl PartialEq for ParserHint
impl PartialEq for ParserHint
Source§impl Serialize for ParserHint
impl Serialize for ParserHint
impl Copy for ParserHint
impl Eq for ParserHint
impl StructuralPartialEq for ParserHint
Auto Trait Implementations§
impl Freeze for ParserHint
impl RefUnwindSafe for ParserHint
impl Send for ParserHint
impl Sync for ParserHint
impl Unpin for ParserHint
impl UnsafeUnpin for ParserHint
impl UnwindSafe for ParserHint
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more