pub struct DatasetMetadata {
pub name: &'static str,
pub description: &'static str,
pub download_url: &'static str,
pub domain: &'static str,
pub language: &'static str,
pub entity_types: &'static [&'static str],
pub flags: DatasetFlags,
pub citation: Option<&'static str>,
pub license: Option<&'static str>,
pub year: Option<u16>,
pub paper_url: Option<&'static str>,
}Expand description
Complete metadata for a single dataset.
All fields are static references for zero-cost access.
Fields§
§name: &'static strHuman-readable name
description: &'static strShort description (1-2 sentences)
download_url: &'static strDownload URL (HuggingFace, GitHub, etc.)
domain: &'static strPrimary domain (news, biomedical, social-media, etc.)
language: &'static strISO 639-1/3 language code (en, de, zh, multilingual, etc.)
entity_types: &'static [&'static str]Entity types in this dataset
flags: DatasetFlagsCapability flags (replaces all is_* methods)
citation: Option<&'static str>Academic citation (if available)
license: Option<&'static str>License (MIT, CC-BY, etc.)
year: Option<u16>Publication year
paper_url: Option<&'static str>Paper URL (arXiv, ACL Anthology, etc.)
Implementations§
Source§impl DatasetMetadata
impl DatasetMetadata
Sourcepub const fn new(
name: &'static str,
description: &'static str,
download_url: &'static str,
) -> Self
pub const fn new( name: &'static str, description: &'static str, download_url: &'static str, ) -> Self
Create metadata with required fields only.
Sourcepub const fn entity_types(self, types: &'static [&'static str]) -> Self
pub const fn entity_types(self, types: &'static [&'static str]) -> Self
Builder: set entity types.
Sourcepub const fn flags(self, flags: DatasetFlags) -> Self
pub const fn flags(self, flags: DatasetFlags) -> Self
Builder: set flags.
Sourcepub const fn is_ner(&self) -> bool
pub const fn is_ner(&self) -> bool
Returns true if this dataset supports named entity recognition.
NER datasets provide entity span annotations with type labels.
Sourcepub const fn is_coreference(&self) -> bool
pub const fn is_coreference(&self) -> bool
Returns true if this dataset contains coreference annotations.
Coreference datasets provide mention clusters or entity chains indicating which mentions refer to the same entity.
Sourcepub const fn is_intra_doc_coref(&self) -> bool
pub const fn is_intra_doc_coref(&self) -> bool
Returns true if this dataset contains within-document coreference.
Intra-document coreference datasets link mentions within a single document, forming coreference chains or clusters.
Sourcepub const fn is_inter_doc_coref(&self) -> bool
pub const fn is_inter_doc_coref(&self) -> bool
Returns true if this dataset contains cross-document coreference.
Inter-document coreference datasets link entities across multiple documents, enabling cross-document entity resolution.
Sourcepub const fn is_temporal_ner(&self) -> bool
pub const fn is_temporal_ner(&self) -> bool
Returns true if this dataset contains temporal entity annotations.
Temporal NER datasets include time expressions, events with temporal anchors, or entities with temporal attributes (e.g., historical entities).
Sourcepub const fn is_biomedical(&self) -> bool
pub const fn is_biomedical(&self) -> bool
Returns true if this dataset is from the biomedical domain.
Biomedical datasets include medical, clinical, or life science text with specialized entity types (diseases, genes, proteins, chemicals).
Returns true if this dataset contains social media text.
Social media datasets include Twitter, Reddit, or other informal text with non-standard capitalization, abbreviations, and informal language.
Sourcepub const fn is_specialized_domain(&self) -> bool
pub const fn is_specialized_domain(&self) -> bool
Returns true if this dataset is from a specialized domain.
Specialized domain datasets include technical, legal, financial, or other domain-specific text requiring specialized entity recognition.
Sourcepub const fn is_relation_extraction(&self) -> bool
pub const fn is_relation_extraction(&self) -> bool
Returns true if this dataset supports relation extraction.
Relation extraction datasets provide entity-relation-entity triples, enabling evaluation of models that extract structured relationships.
Sourcepub const fn is_historical(&self) -> bool
pub const fn is_historical(&self) -> bool
Returns true if this dataset contains historical text.
Historical datasets include ancient texts, historical documents, or diachronic corpora that test model robustness to language evolution.
Sourcepub const fn is_bias_evaluation(&self) -> bool
pub const fn is_bias_evaluation(&self) -> bool
Returns true if this dataset is designed for bias evaluation.
Bias evaluation datasets test for gender, demographic, or other biases in entity recognition and coreference resolution.
Sourcepub const fn is_dialogue_coref(&self) -> bool
pub const fn is_dialogue_coref(&self) -> bool
Returns true if this dataset contains dialogue coreference annotations.
Dialogue coreference datasets include multi-party conversations, meetings, or interviews where coreference resolution must handle speaker turns and dialogue-specific phenomena (e.g., prosody, gestures).
Sourcepub const fn is_joint_ner_re(&self) -> bool
pub const fn is_joint_ner_re(&self) -> bool
Returns true if this dataset supports joint NER and relation extraction.
Joint datasets provide both entity annotations and relation triples, enabling evaluation of models that perform both tasks simultaneously.
Sourcepub const fn is_discontinuous_ner(&self) -> bool
pub const fn is_discontinuous_ner(&self) -> bool
Returns true if this dataset contains discontinuous entity annotations.
Discontinuous entities span non-contiguous tokens (e.g., “left and right ventricle” where “ventricle” is split). Requires specialized evaluation metrics beyond standard span-based NER.
Sourcepub const fn is_few_shot(&self) -> bool
pub const fn is_few_shot(&self) -> bool
Returns true if this dataset is designed for few-shot learning evaluation.
Few-shot datasets typically have small training sets or are used to test zero-shot transfer from related domains.
Sourcepub const fn is_multilingual(&self) -> bool
pub const fn is_multilingual(&self) -> bool
Returns true if this dataset covers multiple languages.
Multilingual datasets enable cross-lingual evaluation and testing of zero-shot transfer between languages.
Sourcepub const fn is_constructed_language(&self) -> bool
pub const fn is_constructed_language(&self) -> bool
Returns true if this dataset contains constructed/artificial languages.
Constructed languages (e.g., Esperanto, Klingon) test model generalization to languages with different structural properties than natural languages.
Sourcepub const fn is_code_switching(&self) -> bool
pub const fn is_code_switching(&self) -> bool
Returns true if this dataset contains code-switched text.
Code-switching datasets include text where speakers mix multiple languages within the same utterance, requiring models to handle language boundaries.
Sourcepub const fn is_african_language(&self) -> bool
pub const fn is_african_language(&self) -> bool
Returns true if this dataset contains African languages.
African language datasets are important for evaluating model performance on under-resourced languages and diverse linguistic structures.
Trait Implementations§
Source§impl Clone for DatasetMetadata
impl Clone for DatasetMetadata
Source§fn clone(&self) -> DatasetMetadata
fn clone(&self) -> DatasetMetadata
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreimpl Copy for DatasetMetadata
Auto Trait Implementations§
impl Freeze for DatasetMetadata
impl RefUnwindSafe for DatasetMetadata
impl Send for DatasetMetadata
impl Sync for DatasetMetadata
impl Unpin for DatasetMetadata
impl UnsafeUnpin for DatasetMetadata
impl UnwindSafe for DatasetMetadata
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> ErasedDestructor for Twhere
T: 'static,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more