Crate ruvector_tiny_dancer_core 

Tiny Dancer: Production-Grade AI Agent Routing System

High-performance neural routing system for optimizing LLM inference costs.

This crate provides:

• FastGRNN model inference (sub-millisecond latency)
• Feature engineering for candidate scoring
• Model optimization (quantization, pruning)
• Uncertainty quantification with conformal prediction
• Circuit breaker patterns for graceful degradation
• SQLite/AgentDB integration

Re-exports

pub use error::Result;

pub use error::TinyDancerError;

pub use model::FastGRNN;

pub use router::Router;

pub use types::Candidate;

pub use types::RoutingDecision;

pub use types::RoutingRequest;

pub use types::RoutingResponse;

Modules

circuit_breaker

Circuit breaker pattern for graceful degradation

error

Error types for Tiny Dancer

feature_engineering

Feature engineering for candidate scoring

model

FastGRNN model implementation

optimization

Model optimization techniques (quantization, pruning, knowledge distillation)

router

Main routing engine combining all components

storage

SQLite/AgentDB integration for persistent storage

types

Core types for Tiny Dancer routing system

uncertainty

Uncertainty quantification with conformal prediction

Constants

VERSION

Version of the Tiny Dancer library