Skip to main content

Crate qql_embed

Crate qql_embed 

Source
Expand description

Shared embedding layer for QQL.

  • Embedder — host-agnostic dense/sparse API (batch dense by default when overridden)
  • resolve_embeddings — rewrite QUERY / UPSERT text into vectors on the AST
  • sparse — local wire-compatible BM25 sparse vectors (no network)

Used by qql (runtime HttpEmbedder), qql-edge (FastEmbedder), and qql-wasm (fetch / JS adapters). No Qdrant I/O and no HTTP client live here.

Re-exports§

pub use bm25_lang::Language;
pub use bm25_text::AvgLenEstimate;
pub use bm25_text::Bm25Pipeline;
pub use bm25_text::Bm25TextConfig;
pub use bm25_text::Stemmer;
pub use bm25_text::Stopwords;
pub use bm25_text::Tokenizer;
pub use bm25_text::estimate_avg_len;
pub use embedder::Embedder;
pub use embedder::EmbedderBound;
pub use embedder::JointEmbeddingOutput;
pub use embedder::SparseEmbedder;
pub use embedder::cross_rerank_unsupported_error;
pub use embedder::dense_model_unsupported_error;
pub use embedder::image_unsupported_error;
pub use embedder::multi_unsupported_error;
pub use embedder::sparse_model_unsupported_error;
pub use resolve::DENSE_VECTOR_NAME;
pub use resolve::SPARSE_VECTOR_NAME;
pub use resolve::resolve_embeddings;
pub use sparse::Bm25Params;
pub use sparse::SparseVector;
pub use topology::TopologyNames;
pub use topology::query_needs_kind_resolution;
pub use topology::resolve_query_vector_kinds;
pub use topology::resolve_query_vector_kinds_simple;

Modules§

bm25_lang
BM25 processing languages (Qdrant Language names + aliases). BM25 text-processing languages, mirroring Qdrant’s Language names.
bm25_text
BM25 text-processing pipeline: languages, tokenizers, folding, and the avg_len estimator — option-compatible with Qdrant’s Bm25Config. Full BM25 text-processing pipeline, option-compatible with Qdrant.
embedder
Host-agnostic Embedder trait, joint embedding output, and error helpers.
resolve
AST rewriting: resolve TEXT inputs to vectors via the configured embedder.
sparse
Local wire-compatible BM25 sparse vectors (no network). Client-side BM25 sparse embeddings, wire-compatible with Qdrant’s qdrant/bm25 model defaults.
topology
USING vector-kind resolution from collection topology (dense/sparse/multi). Resolve USING vector kinds from collection topology before embedding.