data-doctor-core 1.0.2

A powerful data validation and cleaning tool for JSON and CSV files
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75

# DataDoctor Core 🩺


[![Crates.io](https://img.shields.io/crates/v/data-doctor-core.svg)](https://crates.io/crates/data-doctor-core)
[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
[![Documentation](https://docs.rs/data-doctor-core/badge.svg)](https://docs.rs/data-doctor-core)

**DataDoctor Core** is the foundational library powering the DataDoctor tools. It provides a robust, high-performance engine for validating, cleaning, and auto-fixing data in JSON and CSV formats.

## ✨ Features


- **JSON Validation**: Detect and fix trailing commas, unquoted keys, missing commas, and more.
- **CSV Validation**: Handle column mismatches, type validation, delimiter detection, and auto-padding/trimming.
- **Rule-Based Engine**: Extensible system for defining data quality rules.
- **Type Safety**: Built with Rust for safety and performance.
- **Zero-Config Option**: Smart defaults for immediate results.

## 📦 Installation


Add this to your `Cargo.toml`:

```toml
[dependencies]
data-doctor-core = "1.0"
```

## 📖 Usage


### Validating JSON


```rust
use data_doctor_core::json::JsonValidator;
use data_doctor_core::ValidationOptions;

fn main() {
    let json_data = r#"{ "name": "John", "age": 30, }"#; // Note: Trailing comma

    let mut options = ValidationOptions::default();
    options.auto_fix = true;

    let validator = JsonValidator::new();
    let (fixed_content, result) = validator.validate_and_fix(json_data, &options);

    if result.success {
        println!("Fixed JSON: {}", fixed_content);
        // Output: { "name": "John", "age": 30 }
    } else {
        println!("Issues found: {:?}", result.issues);
    }
}
```

### Validating CSV


```rust
use data_doctor_core::validate_csv_stream;
use data_doctor_core::ValidationOptions;

fn main() {
    let csv_data = "name,age\nJohn,30\nJane,twenty-five";
    
    let options = ValidationOptions::default();
    let result = validate_csv_stream(csv_data.as_bytes(), &options);

    println!("Total Records: {}", result.stats.total_records);
    println!("Invalid Records: {}", result.stats.invalid_records);
}
```

## 🤝 Contributing


This crate is part of the `data-doctor` workspace. Contributions are welcome on the [GitHub repository](https://github.com/jeevanms003/data-doctor).

## 📄 License


This project is licensed under the MIT License.