Expand description
coglet: Rust execution engine for cog models.
Re-exports§
pub use orchestrator::Orchestrator;pub use service::PredictionHandle;pub use service::SyncPredictionGuard;pub use input_validation::InputValidator;pub use service::CreatePredictionError;pub use service::HealthSnapshot;pub use service::PredictionService;pub use worker::PredictHandler;pub use worker::PredictResult;pub use worker::SetupError;pub use worker::SetupLogHook;pub use worker::SlotSender;pub use worker::WorkerConfig;pub use worker::run_worker;
Modules§
- bridge
- IPC bridge for coglet parent-worker communication.
- input_
validation - Input validation against the OpenAPI schema.
- orchestrator
- Orchestrator - manages worker subprocess lifecycle and event loop.
- permit
- Permit pool for concurrent slot management.
- service
- PredictionService: Transport-agnostic prediction lifecycle management.
- transport
- Transport layer for coglet.
- webhook
- Webhook sender for async predictions.
- worker
- Worker subprocess - runs inside the Python subprocess.
Structs§
- Cancellation
Token - A token which can be used to signal a cancellation request to one or more tasks.
- Prediction
- Prediction lifecycle state.
- Prediction
Guard - RAII guard for prediction lifecycle timing.
- Prediction
Metrics - Metrics collected during prediction.
- Prediction
Result - Result of a completed prediction.
- Setup
LogAccumulator - Setup
Result - Result of the setup phase.
- Version
Info - Version information for the runtime.
Enums§
- Health
- Health status of the coglet runtime.
- Prediction
Error - Prediction
Output - Prediction output - single value or streamed chunks.
- Prediction
Status - Setup
Status - Status of the setup phase.
Constants§
- COGLET_
VERSION - Coglet version from Cargo.toml
Functions§
- drain_
accumulated_ logs - install_
crypto_ provider - Install the
ringTLS crypto provider forrustls.