zer-judge 1.1.0

ONNX-based neural judge for zer, runs DeBERTa/MiniLM NLI models via ORT to adjudicate borderline record pairs
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52

# zer-judge

ONNX-based neural judge for the zer entity-resolution library.

Loads a DeBERTa-v3 or MiniLM NLI cross-encoder model via ONNX Runtime and uses it to adjudicate borderline record pairs that the Fellegi-Sunter scorer could not classify with high confidence. Models are hosted on HuggingFace at [arsalan-anwari/zjudge](https://huggingface.co/arsalan-anwari/zjudge).

- **Documentation**: [docs.zal-analytics.ch](https://docs.zal-analytics.ch)
- **Website**: [www.zal-analytics.ch](https://www.zal-analytics.ch)
- **Support & feedback**: [info@zal-analytics.ch](mailto:info@zal-analytics.ch)

## Getting the models

```bash
# Download all model variants to ~/.cache/zer/models/
bash scripts/download_models.sh

# Or point at a custom location:
export ZER_MODEL_DIR=/path/to/your/models
```

The `ZER_MODEL_DIR` environment variable controls where zer looks for models. If unset, zer checks `~/.cache/zer/models` and falls back to `./models`.

## Feature flags

| Flag              | Description |
|-------------------|-------------|
| `judge_cpu`       | CPU execution provider for ORT |
| `judge_cuda`      | NVIDIA CUDA execution provider (requires CUDA toolkit + cuDNN) |
| `judge_tensorrt`  | NVIDIA TensorRT EP, FP16 + engine caching (requires TensorRT 8+) |
| `judge_rocm`      | AMD ROCm execution provider |
| `judge_directml`  | Windows DirectML execution provider |
| `judge_openvino`  | Intel OpenVINO execution provider |

These are independent from `zer-compute`'s `cuda`/`avx2`/`vulkan` flags.

## Usage

```rust
use zer_judge::{spec_from_env, ModelPrecision, backend::JudgeBackend};

// Reads ZER_MODEL_DIR → ~/.cache/zer/models → ./models
let backend = JudgeBackend::auto_detect();
let spec    = spec_from_env(ModelPrecision::Fp16Fused, backend.available_vram_bytes());

// Or pick a specific model explicitly:
use zer_judge::spec::DebertaBaseSpec;
let spec = DebertaBaseSpec::from_env(ModelPrecision::Base);
```

## License

Apache-2.0 · [GitHub](https://github.com/ZAL-Analytics/zer)