Skip to main content

Module readiness

Module readiness 

Source

Enums§

LlmReadiness
Result of a single bounded inference-service health probe.

Constants§

LLM_READINESS_PROBE_TIMEOUT
Maximum duration of one inference-service readiness probe.

Functions§

llm_readiness_client
Build the dedicated HTTP client used for inference-service health probes.
probe_llm_readiness
Probe the inference service’s /health endpoint once.
wait_llm_ready
Poll LLM /health until it responds successfully or the timeout is reached.