Crate llm_edge_proxy

Crate llm_edge_proxy 

Source
Expand description

Core HTTP proxy functionality for LLM Edge Agent

This crate provides the foundational proxy server capabilities including:

  • TLS termination with Rustls
  • Request/response handling
  • Protocol detection (HTTP/1.1, HTTP/2, gRPC)
  • Middleware integration points (auth, rate limiting, timeout)
  • Health checks and metrics endpoints
  • OpenTelemetry tracing integration

Re-exports§

pub use config::Config;
pub use error::ProxyError;
pub use error::ProxyResult;
pub use server::build_app;
pub use server::create_router;
pub use server::serve;

Modules§

config
Configuration management for LLM Edge Agent
error
middleware
Middleware implementations for the proxy
server
HTTP server implementation

Macros§

trace_request
Create a span for request tracing