Struct TypeMapper 

pub struct TypeMapper { /* private fields */ }

Maps domain-specific entity types to standard NER types.

Research Context (Familiarity paper, arXiv:2412.10121)

Type mapping creates “label overlap” between training and evaluation:

• Mapping ACTOR → Person increases overlap
• This can inflate zero-shot F1 scores

Use LabelShift::from_type_sets() to quantify how much overlap exists. High overlap (>80%) means the evaluation is NOT truly zero-shot.

When to Use TypeMapper

• Cross-dataset comparison (normalize schemas for fair eval)
• Domain adaptation (map new labels to known types)

When NOT to Use TypeMapper

• True zero-shot evaluation (keep labels distinct)
• Measuring generalization (overlap hides generalization failures)

Example

use anno_core::{TypeMapper, EntityType, EntityCategory};

// MIT Movie dataset mapping
let mut mapper = TypeMapper::new();
mapper.add("ACTOR", EntityType::Person);
mapper.add("DIRECTOR", EntityType::Person);
mapper.add("TITLE", EntityType::custom("WORK_OF_ART", EntityCategory::Creative));

assert_eq!(mapper.map("ACTOR"), Some(&EntityType::Person));
assert_eq!(mapper.normalize("DIRECTOR"), EntityType::Person);

Implementations

impl TypeMapper

pub fn new() -> TypeMapper

Create empty mapper.

pub fn mit_movie() -> TypeMapper

Create mapper for MIT Movie dataset.

pub fn mit_restaurant() -> TypeMapper

Create mapper for MIT Restaurant dataset.

pub fn biomedical() -> TypeMapper

Create mapper for biomedical datasets (BC5CDR, NCBI).

pub fn social_media() -> TypeMapper

Create mapper for social media NER datasets (TweetNER7, etc.).

pub fn manufacturing() -> TypeMapper

Create mapper for manufacturing domain datasets (FabNER, etc.).

pub fn add(&mut self, source: impl Into<String>, target: EntityType)

Add a mapping from source label to target type.

pub fn map(&self, label: &str) -> Option<&EntityType>

Get mapped type for a label (returns None if not mapped).

pub fn normalize(&self, label: &str) -> EntityType

Normalize a label to EntityType, using mapping if available.

Falls back to EntityType::from_label() if no mapping exists.

pub fn contains(&self, label: &str) -> bool

Check if a label is mapped.

pub fn labels(&self) -> impl Iterator<Item = &String>

Get all source labels.

Trait Implementations

impl Clone for TypeMapper

fn clone(&self) -> TypeMapper

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TypeMapper

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for TypeMapper

fn default() -> TypeMapper

Returns the “default value” for a type.