List of all items

Structs

• AppState
• ModelInfo
• ModelsResponse
• arrow::ArrowBatchRequest
• grpc::SystemOneService
• middleware::AuthConfig
• middleware::RateLimitConfig
• middleware::RateLimiter
• middleware::RequestId
• middleware::RequestLimits
• models::ModelInfo
• models::ModelsResponse
• playground::PlaygroundModel
• proxy::ProxyOutcome

Enums

• error::ApiError
• proxy::ProxySource

Traits

• playground::PlaygroundModels
• proxy::SystemProxy

Functions

• arrow::answers_from_batch
• arrow::arrow_batch
• grpc::server
• grpc::server_with_auth
• grpc::service
• grpc::service_with_auth
• grpc::service_with_auth_and_limits
• http::install_metrics_recorder
• http::router
• http::router_daemon
• http::router_daemon_with_arrow
• http::router_daemon_with_arrow_and_limits
• http::router_with_auth
• http::router_with_state
• http::router_with_state_and_limit
• http::router_with_state_auth_rate_limit
• middleware::auth_layer
• middleware::auth_layer_for
• middleware::is_safe_request_id
• middleware::rate_limit_layer
• middleware::request_id_layer
• middleware::secure_token_eq
• playground::playground_page

Constants

• arrow::ARROW_BATCH_TIMEOUT
• arrow::ARROW_CONTENT_TYPE
• arrow::ARROW_MAPPING_VERSION
• arrow::MAX_ARROW_RESPONSE_BYTES
• arrow::MAX_ARROW_STATES
• arrow::MAX_CHOICE_LABELS
• arrow::META_ARROW_VERSION
• arrow::META_JEV_TYPE
• arrow::META_LABELS
• arrow::META_LEGEND
• arrow::META_MODEL
• arrow::META_USAGE_INPUT_TOKENS
• arrow::META_USAGE_OUTPUT_TOKENS
• http::MAX_PAYLOAD_SIZE_BYTES
• middleware::AUTH_HEADER
• middleware::MAX_REQUEST_ID_LEN
• middleware::REQUEST_ID_HEADER