Skip to main content

Crate oxibonsai_serve

Crate oxibonsai_serve 

Source
Expand description

Library interface for oxibonsai-serve.

Exposes the argument-parsing, banner, configuration, environment, validation, and metrics modules so they can be exercised from integration tests without going through main.

The four “uplift” modules added for the Alpha→Stable milestone are:

  • config — layered configuration (defaults < TOML < env < CLI)
  • envOXIBONSAI_* environment-variable parsing
  • validation — invariants over a fully-merged config::ServerConfig
  • metrics — hand-rolled Prometheus text-exposition registry

Re-exports§

pub use args::ParseError;
pub use args::ServerArgs;
pub use config::AuthConfig;
pub use config::BindConfig;
pub use config::ConfigError;
pub use config::LimitsConfig;
pub use config::ModelConfig;
pub use config::ObservabilityConfig;
pub use config::PartialServerConfig;
pub use config::SamplingConfig;
pub use config::ServerConfig;
pub use config::TokenizerConfigSection;
pub use env::parse_env_map;
pub use env::parse_process_env;
pub use metrics::MetricsRegistry;
pub use metrics::DEFAULT_HISTOGRAM_BUCKETS;
pub use validation::MAX_DEFAULT_MAX_TOKENS;
pub use validation::MIN_BEARER_TOKEN_LEN;
pub use validation::VALID_LOG_LEVELS;

Modules§

args
Command-line argument parsing for oxibonsai-serve.
banner
ASCII art banner and startup messaging for oxibonsai-serve.
config
Layered server configuration.
env
Environment-variable → configuration mapping.
metrics
Hand-rolled Prometheus text exposition.
validation
Configuration validation.