llmkit

This version has 179 feature flags, 2 of them enabled by default.

default

• anthropic (default)
• openai (default)

anthropic (default)

This feature flag does not enable additional features.

openai (default)

This feature flag does not enable additional features.

ai21

This feature flag does not enable additional features.

ai360

This feature flag does not enable additional features.

ai71

This feature flag does not enable additional features.

aimlapi

This feature flag does not enable additional features.

aleph-alpha

This feature flag does not enable additional features.

alibaba

This feature flag does not enable additional features.

all-providers

• ai21
• ai360
• aimlapi
• aleph-alpha
• alibaba
• anthropic (default)
• anyscale
• aphrodite
• assemblyai
• azure
• baichuan
• baidu
• banana
• baseten
• beam
• bedrock
• bytez
• centml
• cerebras
• cerebrium
• chutes
• circuit-breaker
• clarifai
• cloudflare
• clova
• cohere
• comet-api
• compactifai
• coreweave
• crusoe
• dashscope
• databricks
• datarobot
• deepgram
• deepinfra
• deepseek
• elevenlabs
• ernie
• fal
• fastchat
• featherless
• fireworks
• friendli
• galadriel
• gigachat
• github
• google
• gpt4all
• gradient
• groq
• helicone
• heroku-ai
• huggingface
• hunyuan
• hyperbolic
• infinity
• ionos
• jan
• jina
• keywords-ai
• kluster
• koboldcpp
• lambda
• lambda-labs
• lepton
• lightning
• lighton
• llamafile
• lm-studio
• localai
• maritaca
• martian
• meta-llama
• minimax
• mistral
• mistral-embeddings
• mlc
• moonshot
• morph
• mystic
• nebius
• nitro
• nlp-cloud
• novita
• nscale
• nvidia
• nvidia-nim
• observability
• octoai
• ollama
• openai (default)
• openai-compatible
• openai-proxy
• openai-realtime
• openllm
• openrouter
• oracle
• ovhcloud
• pangu
• petals
• poe
• portkey
• predibase
• prem
• public-ai
• qwen
• rate-limiter
• recraft
• reka
• replicate
• runpod
• runware
• runwayml
• sagemaker
• sambanova
• sap
• scaleway
• sea-lion
• sensenova
• siliconflow
• smart-router
• snowflake
• spark
• stability
• stepfun
• streaming-multiplexer
• synthetic
• tabby
• text-gen-webui
• tgi
• tiangong
• together
• triton
• unify
• upstage
• v0
• vercel-ai
• vertex
• volcengine
• voyage
• watsonx
• writer
• xai
• xinference
• yandex
• yi
• zhipu

anyscale

This feature flag does not enable additional features.

aphrodite

This feature flag does not enable additional features.

assemblyai

This feature flag does not enable additional features.

azure

This feature flag does not enable additional features.

azure-ai

This feature flag does not enable additional features.

baichuan

This feature flag does not enable additional features.

baidu

This feature flag does not enable additional features.

banana

This feature flag does not enable additional features.

baseten

This feature flag does not enable additional features.

beam

This feature flag does not enable additional features.

bedrock

• dep:aws-config
• dep:aws-sdk-bedrockruntime
• dep:aws-smithy-types

black-forest-labs

This feature flag does not enable additional features.

bytez

• openai-compatible

centml

This feature flag does not enable additional features.

cerebras

This feature flag does not enable additional features.

cerebrium

This feature flag does not enable additional features.

chutes

• openai-compatible

circuit-breaker

This feature flag does not enable additional features.

clarifai

• openai-compatible

cloudflare

This feature flag does not enable additional features.

clova

This feature flag does not enable additional features.

cohere

This feature flag does not enable additional features.

comet-api

• openai-compatible

compactifai

• openai-compatible

coreweave

This feature flag does not enable additional features.

crusoe

This feature flag does not enable additional features.

dashscope

This feature flag does not enable additional features.

databricks

This feature flag does not enable additional features.

datarobot

This feature flag does not enable additional features.

deepgram

This feature flag does not enable additional features.

deepinfra

This feature flag does not enable additional features.

deepseek

This feature flag does not enable additional features.

did

This feature flag does not enable additional features.

elevenlabs

This feature flag does not enable additional features.

ernie

This feature flag does not enable additional features.

fal

This feature flag does not enable additional features.

fastchat

This feature flag does not enable additional features.

featherless

This feature flag does not enable additional features.

fireworks

This feature flag does not enable additional features.

friendli

This feature flag does not enable additional features.

galadriel

This feature flag does not enable additional features.

gigachat

This feature flag does not enable additional features.

github

This feature flag does not enable additional features.

google

This feature flag does not enable additional features.

gpt4all

This feature flag does not enable additional features.

gradient

• openai-compatible

groq

This feature flag does not enable additional features.

helicone

This feature flag does not enable additional features.

heroku-ai

• openai-compatible

heygen

This feature flag does not enable additional features.

huggingface

This feature flag does not enable additional features.

hunyuan

This feature flag does not enable additional features.

hyperbolic

This feature flag does not enable additional features.

ideogram

This feature flag does not enable additional features.

infinity

This feature flag does not enable additional features.

ionos

This feature flag does not enable additional features.

jan

This feature flag does not enable additional features.

jina

This feature flag does not enable additional features.

kakao

This feature flag does not enable additional features.

keywords-ai

This feature flag does not enable additional features.

kling

This feature flag does not enable additional features.

kluster

This feature flag does not enable additional features.

koboldcpp

This feature flag does not enable additional features.

krutrim

This feature flag does not enable additional features.

lambda

This feature flag does not enable additional features.

lambda-labs

• openai-compatible

leonardo

This feature flag does not enable additional features.

lepton

This feature flag does not enable additional features.

lg-exaone

This feature flag does not enable additional features.

lightning

This feature flag does not enable additional features.

lighton

This feature flag does not enable additional features.

llamafile

This feature flag does not enable additional features.

lm-studio

This feature flag does not enable additional features.

localai

This feature flag does not enable additional features.

luma

This feature flag does not enable additional features.

maritaca

This feature flag does not enable additional features.

martian

This feature flag does not enable additional features.

meta-llama

This feature flag does not enable additional features.

minimax

This feature flag does not enable additional features.

mistral

This feature flag does not enable additional features.

mistral-embeddings

This feature flag does not enable additional features.

mlc

This feature flag does not enable additional features.

modal

This feature flag does not enable additional features.

moonshot

This feature flag does not enable additional features.

morph

• openai-compatible

mystic

This feature flag does not enable additional features.

naver

This feature flag does not enable additional features.

nebius

This feature flag does not enable additional features.

nitro

This feature flag does not enable additional features.

nlp-cloud

This feature flag does not enable additional features.

novita

This feature flag does not enable additional features.

nscale

This feature flag does not enable additional features.

ntt

This feature flag does not enable additional features.

nvidia

This feature flag does not enable additional features.

nvidia-nim

• openai-compatible

observability

This feature flag does not enable additional features.

octoai

This feature flag does not enable additional features.

ollama

This feature flag does not enable additional features.

openai-compatible

This feature flag does not enable additional features.

openai-proxy

This feature flag does not enable additional features.

openai-realtime

This feature flag does not enable additional features.

openllm

This feature flag does not enable additional features.

openrouter

This feature flag does not enable additional features.

oracle

This feature flag does not enable additional features.

ovhcloud

This feature flag does not enable additional features.

pangu

This feature flag does not enable additional features.

perplexity

This feature flag does not enable additional features.

petals

This feature flag does not enable additional features.

pika

This feature flag does not enable additional features.

plamo

This feature flag does not enable additional features.

playht

This feature flag does not enable additional features.

poe

• openai-compatible

portkey

This feature flag does not enable additional features.

predibase

This feature flag does not enable additional features.

prem

This feature flag does not enable additional features.

public-ai

• openai-compatible

qwen

This feature flag does not enable additional features.

rate-limiter

This feature flag does not enable additional features.

recraft

This feature flag does not enable additional features.

reka

• openai-compatible

replicate

This feature flag does not enable additional features.

resemble

This feature flag does not enable additional features.

rev

This feature flag does not enable additional features.

runpod

This feature flag does not enable additional features.

runware

This feature flag does not enable additional features.

runwayml

This feature flag does not enable additional features.

sagemaker

This feature flag does not enable additional features.

sambanova

This feature flag does not enable additional features.

sap

This feature flag does not enable additional features.

sarvam

This feature flag does not enable additional features.

scaleway

This feature flag does not enable additional features.

sea-lion

This feature flag does not enable additional features.

sensenova

This feature flag does not enable additional features.

siliconflow

This feature flag does not enable additional features.

silo-ai

This feature flag does not enable additional features.

smart-router

This feature flag does not enable additional features.

snowflake

This feature flag does not enable additional features.

softbank

This feature flag does not enable additional features.

spark

This feature flag does not enable additional features.

speechmatics

This feature flag does not enable additional features.

stability

This feature flag does not enable additional features.

stepfun

This feature flag does not enable additional features.

streaming-multiplexer

This feature flag does not enable additional features.

swiss-ai

This feature flag does not enable additional features.

synthetic

• openai-compatible

tabby

This feature flag does not enable additional features.

tensordock

This feature flag does not enable additional features.

text-gen-webui

This feature flag does not enable additional features.

tgi

This feature flag does not enable additional features.

tiangong

This feature flag does not enable additional features.

tilde

This feature flag does not enable additional features.

together

This feature flag does not enable additional features.

triton

This feature flag does not enable additional features.

twelve-labs

This feature flag does not enable additional features.

unify

This feature flag does not enable additional features.

upstage

This feature flag does not enable additional features.

v0

• openai-compatible

vastai

This feature flag does not enable additional features.

vercel-ai

• openai-compatible

vertex

• dep:gcp_auth
• dep:rustls

vllm

This feature flag does not enable additional features.

volcengine

This feature flag does not enable additional features.

voyage

This feature flag does not enable additional features.

watsonx

This feature flag does not enable additional features.

writer

This feature flag does not enable additional features.

xai

This feature flag does not enable additional features.

xinference

• openai-compatible

yandex

This feature flag does not enable additional features.

yi

This feature flag does not enable additional features.

zhipu

This feature flag does not enable additional features.