Expand description
ONNX, sentence-transformer, and AST-aware embedding backends (K3c-G2).
These are alternative EmbeddingProvider implementations that complement
the existing [LlmEmbeddingProvider] and MockEmbeddingProvider.
OnnxEmbeddingProvider– local model inference (all-MiniLM-L6-v2, 384-d).SentenceTransformerProvider– documentation-optimised paragraph embedder.AstEmbeddingProvider– hybrid structural + semantic embedder for Rust code.
Structs§
- AstEmbedding
Provider - AST-aware embedding provider for Rust source code.
- Onnx
Embedding Provider - ONNX Runtime embedding provider.
- Rust
Code Features - Structural features extracted from Rust source code via regex parsing.
- Sentence
Transformer Provider - Sentence-transformer embedding provider for documentation.
- Word
Piece Tokenizer - BERT-compatible WordPiece tokenizer.
Functions§
- extract_
rust_ features - Extract structural features from a Rust code snippet using simple regex-like parsing. Does not depend on tree-sitter so the kernel stays lightweight.
- preprocess_
markdown - Pre-process markdown text by stripping structural elements.
- split_
sentences - Simple sentence splitting on “. “ and newlines.