Expand description
§Polymathy
A high-performance web service that processes search queries, retrieves relevant content, and performs semantic chunking and embedding operations.
§Overview
Polymathy is a Rust library that provides functionality for:
- Processing search queries through SearxNG integration
- Retrieving and processing web content
- Performing semantic chunking of content
- Generating embeddings for content chunks
- Indexing content with vector similarity search
§Features
- Search Processing: Handles search queries through SearxNG integration
- Content Processing: Chunks content and generates embeddings
- Vector Indexing: Manages similarity search using USearch
- Concurrent Processing: Processes multiple URLs simultaneously using Tokio
- OpenAPI Documentation: Built-in API documentation with multiple UI options
§Usage
Add this to your Cargo.toml:
[dependencies]
polymathy = { path = "." }Then use it in your code:
use polymathy::run;
#[tokio::main]
async fn main() -> std::io::Result<()> {
run().await
}§Modules
Re-exports§
pub use api::run;