Expand description
HyperInfer Client Library - Data Plane
Re-exports§
pub use cache::ExactMatchCache;pub use http_client::HttpCaller;pub use mirroring::MirrorConfig;pub use mirroring::MirrorHandle;pub use router::Router;pub use router_engine::RouterEngine;pub use telemetry::Telemetry;pub use telemetry_otlp::init_langfuse_telemetry;pub use telemetry_otlp::init_telemetry;pub use telemetry_otlp::init_telemetry_with_headers;pub use telemetry_otlp::set_gen_ai_attributes;pub use telemetry_otlp::set_gen_ai_response;pub use telemetry_otlp::set_gen_ai_usage;pub use telemetry_otlp::shutdown_telemetry;
Modules§
- cache
- Redis-backed exact-match response cache.
- http_
client - mirroring
- Traffic mirroring: fire-and-forget shadow requests to a secondary model.
- router
- router_
engine - telemetry
- telemetry_
otlp