apple-vision 0.12.0

Safe Rust bindings for Apple's Vision framework — OCR, object detection, face landmarks on macOS
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58

# vision

Safe Rust bindings for Apple's [Vision](https://developer.apple.com/documentation/vision) framework — on-device OCR, object detection, face landmarks, and other computer vision tasks on macOS.

> **Status:** experimental. v0.1 ships text recognition (OCR); object/face detection, classification, barcode scanning land in v0.2.

## Quick start — OCR

```rust,no_run
use apple_vision::prelude::*;

fn main() -> Result<(), Box<dyn std::error::Error>> {
    let recognizer = TextRecognizer::new()
        .with_recognition_level(RecognitionLevel::Accurate)
        .with_language_correction(true);

    let observations = recognizer.recognize_in_path("/tmp/screenshot.png")?;
    for obs in &observations {
        println!("[{:.2}] '{}'", obs.confidence, obs.text);
    }
    Ok(())
}
```

## Composes with the rest of the doom-fish stack

```text
screencapturekit-rs / capture ──► IOSurface / PNG ──► vision ──► text
                                                          │
                                                          ▼
                                                  foundation-models
                                                  ("summarise this")
```

## Feature flags

| Feature        | Status |
|----------------|--------|
| `recognize_text` (default) | ✅ |
| `detect_faces` (default)   | ✅ |
| `detect_rectangles`        | 🚧 v0.4 |
| `classify_image`           | 🚧 v0.4 |
| `detect_barcodes`          | 🚧 v0.4 |

## Roadmap

- [x] `VNRecognizeTextRequest` (OCR) via `TextRecognizer`
- [x] `VNDetectFaceRectanglesRequest` via `FaceDetector` (returns bounding box + roll/yaw/pitch)
- [x] `CGImage` / `CVPixelBuffer` ingest (file path AND zero-copy `CVPixelBuffer` paths)
- [ ] `VNDetectFaceLandmarksRequest` (face landmark points)
- [ ] `VNDetectRectanglesRequest`
- [ ] `VNClassifyImageRequest`
- [ ] `VNDetectBarcodesRequest`
- [ ] Async API (`VNRequest` completion handlers exposed via `async fn`)

## License

Licensed under either of [Apache-2.0](LICENSE-APACHE) or [MIT](LICENSE-MIT) at your option.