embroider 0.1.1

Text embroidery: Jina v5 text embeddings via ONNX Runtime (Rust core, optional PyO3 bindings) — shared by bobine and okfgraph
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

//! CUDA availability probing against the loaded ONNX Runtime library.

use ort::ep::{ExecutionProvider, CUDA};

/// Probe the loaded ORT library for a usable CUDA execution provider.
/// Uses the EP availability check — deliberately NOT a session-builder
/// registration probe: in ort 2.0.0-rc.13 `with_execution_providers` returns
/// `Ok` even against a CPU-only dylib, which would report CUDA on every CPU
/// box. `apply_providers` still degrades gracefully if registration fails
/// despite this probe. Probed once per process.
pub fn cuda_available() -> bool {
    use std::sync::OnceLock;
    static PROBE: OnceLock<bool> = OnceLock::new();
    *PROBE.get_or_init(|| CUDA::default().is_available().unwrap_or(false))
}