Skip to main content

Crate conproxy

Crate conproxy 

Source
Expand description

Cache proxy server for RAG/vector search with LLM passthrough.

Provides caching, circuit-breaking, load balancing, and query federation for search backends (Elasticsearch, Qdrant, pgvector, and generic REST).

Re-exports§

pub use config::Config;
pub use config::ProxyConfig;
pub use embedding::models::ModelManager;
pub use engine::Engine;
pub use engine::EngineBuilder;
pub use engine::EngineError;
pub use engine::EngineStats;
pub use engine::QueryOpts;
pub use error::ConproxyError;
pub use error::Result;

Modules§

cache
OS page cache operations.
config
Configuration loading and management
embedding
Embedding and model management module.
engine
In-process query-core facade. Same path as the daemon HTTP handler.
error
Error types for conproxy
proxy
Cache Proxy module for remote RAG upstreams.