Skip to main content

Module detect

Module detect 

Source
Expand description

Which runtime is behind an OpenAI-compatible URL, from its identifying endpoints.

Structs§

Detected

Functions§

detect
Probe in an order where no runtime matches another’s check: llama.cpp /props, SGLang /get_model_info, LM Studio /api/v0/models, Ollama /api/version, TabbyAPI /v1/model, vLLM /version; then owned_by in /v1/models.