ai-vitals 0.1.0

A tool to monitor LLM endpoints and report status to Cronitor.

Coverage
44.12%
15 out of 34 items documented0 out of 17 items with examples
Size
Source code size: 103.2 kB This is the summed size of all the files inside the crates.io package for this release.
Documentation size: 1.19 MB This is the summed size of all files generated by rustdoc for all configured targets
Ø build duration
this release: 59s Average build duration of successful builds.
all releases: 51s Average build duration of successful builds in releases after 2024-10-23.
Links
Homepage
doublewordai/model-monitor
0 0 0
crates.io
Dependencies
Versions
Owners

AI Vitals

AI Vitals is a tool designed to monitor LLM (Large Language Model) endpoints and report their status to Cronitor, a service for monitoring and alerting on the health of applications. It actively monitors OpenAI-compatible API endpoints, ensuring they are functioning correctly and reporting any issues to Cronitor for further triage.

Usage

You can use the library interface or the command-line interface (CLI) to monitor your endpoints. The CLI is particularly useful for quick checks or running in automated scripts. We have an example helm chart that uses the CLI to monitor endpoints with kubernetes CronJobs.