Skip to main content

Module model2vec

Module model2vec 

Source
Expand description

model2vec static embedder — the MULTILINGUAL (EN/JA/KO) span embedder, ported from the TS Model2VecEmbedder. No forward pass: tokenize (no special tokens), look up each subword id in the packed potion.f32 matrix, mean-pool, L2-normalise. CPU-only, language-agnostic — the same artifact the ingest pipeline already ships.

potion.f32 layout: u32 LE rows, u32 LE dim, then rows*dim little-endian f32 (row-major).

Structs§

Model2Vec

Functions§

cosine