Enums§
- LlmReadiness
- Result of a single bounded inference-service health probe.
Constants§
- LLM_
READINESS_ PROBE_ TIMEOUT - Maximum duration of one inference-service readiness probe.
Functions§
- llm_
readiness_ client - Build the dedicated HTTP client used for inference-service health probes.
- probe_
llm_ readiness - Probe the inference service’s
/healthendpoint once. - wait_
llm_ ready - Poll LLM
/healthuntil it responds successfully or the timeout is reached.