vllora_core 0.1.6

Lightweight, Real-time Debugging for AI Agents

Debug your Agents in Real Time. Trace, analyze, and optimize instantly. Seamless with LangChain, Google ADK, OpenAI, and all major frameworks.

Quick Start

First, install Homebrew if you haven't already, then:

brew tap vllora/vllora
brew install vllora

Start the vLLora:

vllora

The server will start on http://localhost:9090 and the UI will be available at http://localhost:9091.

vLLora uses OpenAI-compatible chat completions API, so when your AI agents make calls through vLLora, it automatically collects traces and debugging information for every interaction.

vLLora Demo

Test Send your First Request

Configure API Keys: Visit http://localhost:9091 to configure your AI provider API keys through the UI
Make a request to see debugging in action:

curl http://localhost:9090/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4o-mini",
    "messages": [{"role": "user", "content": "What is the capital of France?"}]
  }'

Features

Real-time Tracing - Monitor AI agent interactions as they happen with live observability of calls, tool interactions, and agent workflow. See exactly what your agents are doing in real-time.

Real-time Tracing

MCP Support - Full support for Model Context Protocol (MCP) servers, enabling seamless integration with external tools by connecting with MCP Servers through HTTP and SSE

MCP Configuration

Development

To get started with development:

Clone the repository:

git clone https://github.com/vllora/vllora.git
cd vLLora
cargo build --release

The binary will be available at target/release/vlora.

Run tests:

cargo test

Contributing

We welcome contributions! Please check out our Contributing Guide for guidelines on:

How to submit issues
How to submit pull requests
Code style conventions
Development workflow
Testing requirements

License

This project is released under the Apache License 2.0. See the license file for more information.