crabtalk-proxy 0.0.6

HTTP proxy server for the crabtalk LLM API gateway

Coverage
17.65%
6 out of 34 items documented0 out of 18 items with examples
Size
Source code size: 137.06 kB This is the summed size of all the files inside the crates.io package for this release.
Documentation size: 6.39 MB This is the summed size of all files generated by rustdoc for all configured targets
Ø build duration
this release: 2m 5s Average build duration of successful builds.
all releases: 1m 43s Average build duration of successful builds in releases after 2024-10-23.
Links
crabtalk/crabllm
3 0 1
crates.io
Dependencies
Versions
Owners

crabtalk-proxy

HTTP proxy server for the crabtalk LLM API gateway.

Axum-based HTTP server providing:

POST /v1/chat/completions — non-streaming and SSE streaming with retry + fallback
POST /v1/embeddings — embedding requests
POST /v1/images/generations — image generation
POST /v1/audio/speech — text-to-speech
POST /v1/audio/transcriptions — audio transcription
GET /v1/models — list configured models
Bearer token authentication middleware
Extension system: cache, rate limiting, usage tracking, budget, logging

MIT OR Apache-2.0