Struct FieldInterner 

pub struct FieldInterner { /* private fields */ }

Available on crate feature worker-batch and (crate features worker-batch or worker-pool or worker) only.

Concurrent field name interner.

Pre-populate with with_known_fields to amortise the cost of the first intern call for the hot-path fields (e.g. _table, _timestamp).

Thread safety

DashMap shards the hash map into multiple segments; concurrent reads and writes from rayon worker threads are safe without external locking.

Implementations

impl FieldInterner

pub fn new() -> Self

Create a new, empty interner.

pub fn with_known_fields(fields: &[&str]) -> Self

Create an interner pre-populated with the given field names.

Callers should pass the known_fields from super::config::BatchProcessingConfig so that common fields never hit the slow-path allocation during a batch.

pub fn intern(&self, name: &str) -> Arc<str>

Intern a field name and return a shared Arc<str>.

Cost model

• Fast path (already interned): one DashMap read-lock shard + Arc::clone → ~20 ns
• Slow path (first occurrence): one write to DashMap + Arc::from allocation → ~100 ns

The slow path is taken at most once per unique field name per FieldInterner instance.

pub fn extract_known(&self, value: &Value) -> HashMap<Arc<str>, Value>

Extract known (pre-interned) fields from a parsed sonic_rs::Value.

Iterates the top-level object keys and returns only those that are already interned. O(known_fields × object_keys) – typically 6 known × 15 keys = 90 string comparisons per message.

Returns an empty map if value is not a JSON object.

pub fn len(&self) -> usize

Return the number of interned field names.

pub fn is_empty(&self) -> bool

Return true if no field names have been interned yet.

Trait Implementations

impl Default for FieldInterner

fn default() -> Self

Returns the “default value” for a type.