Expand description
Coreference dataset loading and parsing.
Provides specialized loaders for coreference datasets that return
CorefDocument structures rather than NER annotations.
§Supported Datasets
| Dataset | Format | Size | Features |
|---|---|---|---|
| GAP | TSV | 8,908 pairs | Gender-balanced pronoun resolution |
| PreCo | JSON | ~38k docs | Large-scale, includes singletons |
| Synthetic | Generated | Configurable | For testing metrics |
§Example
ⓘ
use anno_eval::eval::coref_loader::{CorefLoader, synthetic_coref_dataset};
// Load GAP development set (requires eval feature for download)
let loader = CorefLoader::new().unwrap();
let docs = loader.load_gap().unwrap();
// Or generate synthetic data for testing
let synthetic = synthetic_coref_dataset(10);Structs§
- Coref
Loader - Loader for coreference datasets.
- GapExample
- A single GAP example (pronoun-name pair).
- PreCo
Document - A PreCo document with coreference annotations.
Functions§
- adversarial_
coref_ examples - Generate adversarial coreference examples.
- domain_
specific_ coref_ dataset - Generate domain-specific synthetic coreference documents.
- parse_
bookcoref_ json - Parse BookCoref JSON/JSONL format.
- parse_
corefud_ conllu - Parse CorefUD CoNLL-U format into coreference documents.
- parse_
ecb_ plus_ coref - Parse ECB+ coreference from any supported format.
- parse_
ecb_ plus_ zip - Parse ECB+ from the real XML zip archive (
ECB+.zip). - parse_
gap_ tsv - Parse GAP TSV format.
- parse_
preco_ json - Parse PreCo JSON format. Parse PreCo JSON format (public for use by DatasetLoader).
- synthetic_
coref_ dataset - Generate synthetic coreference documents for testing.