Expand description
Which runtime is behind an OpenAI-compatible URL, from its identifying endpoints.
Structs§
Functions§
- detect
- Probe in an order where no runtime matches another’s check: llama.cpp
/props, SGLang/get_model_info, LM Studio/api/v0/models, Ollama/api/version, TabbyAPI/v1/model, vLLM/version; thenowned_byin/v1/models.