oxirag 0.1.1

A four-layer RAG engine with SMT-based logic verification and knowledge graph support
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97

# Layer 2: Speculator

Draft verification layer using small language models.

## Overview

The Speculator layer:
- Verifies draft answers against retrieved context
- Identifies issues and inconsistencies
- Revises drafts when needed
- Makes accept/revise/reject decisions

## Components

### Traits

- **`Speculator`**: Core verification interface
  - `verify_draft()`: Analyze draft and return decision
  - `revise_draft()`: Improve draft based on issues found

### Implementations

- **`RuleBasedSpeculator`**: Heuristic verification using:
  - Content length checks
  - Context overlap analysis
  - Uncertainty marker detection
  - Confidence scoring

- **`MockSlmSpeculator`**: Simple heuristic verifier for testing

- **`CandleSlmSpeculator`**: Phi-2 based verification (requires `speculator` feature)

### Decisions

```rust
pub enum SpeculationDecision {
    Accept,  // Draft is good
    Revise,  // Draft needs improvement
    Reject,  // Draft is unusable
}
```

## Usage

```rust
use oxirag::layer2_speculator::*;

// Create speculator
let speculator = RuleBasedSpeculator::default();

// Verify a draft
let draft = Draft::new("Paris is the capital.", "What is the capital of France?");
let context = vec![/* search results */];

let result = speculator.verify_draft(&draft, &context).await?;

match result.decision {
    SpeculationDecision::Accept => println!("Draft accepted"),
    SpeculationDecision::Revise => {
        let revised = speculator.revise_draft(&draft, &context, &result).await?;
        println!("Revised: {}", revised.content);
    }
    SpeculationDecision::Reject => println!("Draft rejected"),
}
```

## Configuration

```rust
let config = SpeculatorConfig {
    temperature: 0.3,
    top_p: 0.9,
    max_tokens: 512,
    accept_threshold: 0.9,  // Auto-accept above this
    reject_threshold: 0.3,  // Auto-reject below this
    max_revisions: 2,
};

let speculator = RuleBasedSpeculator::new(config);
```

## Prompt Templates

The layer includes prompt templates for LLM-based verification:

- `VERIFICATION_SYSTEM`: System prompt for verification
- `VERIFICATION_TEMPLATE`: User prompt template
- `REVISION_TEMPLATE`: Prompt for draft revision

## File Structure

```
layer2_speculator/
├── mod.rs           # Module exports
├── traits.rs        # Speculator trait + RuleBasedSpeculator
└── candle_slm.rs    # Candle SLM implementation
```