DSRs

A high-performance DSPy rewrite in Rust for building LLM-powered applications

🚀 Overview

DSRs (DSPy Rust) is a ground-up rewrite of the DSPy framework in Rust, designed for building robust, high-performance applications powered by Language Models. Unlike a simple port, DSRs leverages Rust's type system, memory safety, and concurrency features to provide a more efficient and reliable foundation for LLM applications.

📦 Installation

Add DSRs to your Cargo.toml:

[dependencies]
dspy-rs = "0.0.1-beta"

Or use cargo:

cargo add dspy-rs

🔧 Quick Start

Here's a simple example to get you started:

use dspy_rs::prelude::*;
use std::collections::HashMap;
use indexmap::IndexMap;

#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
    // Define a signature for Q&A
    let signature = Signature::builder()
        .name("QASignature".to_string())
        .instruction("Answer the question concisely and accurately.".to_string())
        .input_fields(IndexMap::from([(
            "question".to_string(),
            Field::InputField {
                prefix: "Question:".to_string(),
                desc: "The question to answer".to_string(),
                format: None,
                output_type: "String".to_string(),
            },
        )]))
        .output_fields(IndexMap::from([(
            "answer".to_string(),
            Field::OutputField {
                prefix: "Answer:".to_string(),
                desc: "The answer to the question".to_string(),
                format: None,
                output_type: "String".to_string(),
            },
        )]))
        .build()?;

    // Create a predictor
    let predictor = Predict { 
        signature: &signature 
    };

    // Prepare input
    let inputs = HashMap::from([
        ("question".to_string(), "What is the capital of France?".to_string())
    ]);

    // Execute prediction
    let result = predictor.forward(inputs, None, None).await?;
    
    println!("Answer: {}", result.get("answer", None));

    Ok(())
}

🧪 Testing

Run the test suite:

# All tests
cargo test

# Specific test
cargo test test_predictors

# With output
cargo test -- --nocapture

📈 Project Status

⚠️ Early Development - DSRs is actively being developed. The API may change between versions.

Core Framework

• Implement core DSPy abstractions
  • Signature trait and basic implementations (file created: src/premitives/signature.rs)
  • Module trait system (file created: src/premitives/module.rs)
  • Example type (implemented in src/data/example.rs)
  • Prediction type with LmUsage tracking (implemented in src/data/prediction.rs)
  • Field types and validation (file created: src/premitives/field.rs)
  • Serialization support (serde integration)
• Implement language model abstractions
  • LM trait (file created: src/premitives/lm.rs)
• Implement basic modules (files created but empty)
  • Predict module (src/programs/predict.rs)
  • ChainOfThought module (src/programs/cot.rs)

LM Integrations

• Litellm-like client[Going with open router]

Data Management

• Basic data structures (Example, Prediction)
• Dataset loading and management

Performance Optimizations

• Implement zero-copy parsing where possible[optim clean up]
• Rayon dependency added for parallel execution
• Batch processing for LM calls

📄 License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.

🙏 Acknowledgments

• Inspired by the original DSPy framework
• Built with the amazing Rust ecosystem

Documentation • Examples • Issues • Discussions