Skip to main content

DEFAULT_RAYON_THREADS

Constant DEFAULT_RAYON_THREADS 

Source
pub const DEFAULT_RAYON_THREADS: usize = 2;
Expand description

Default worker count for the global Rayon pool.

Each worker holds one batch-embedding call in flight, so a wider pool buys no throughput on the LLM-only path and risks RSS oversubscription on a 4-8 GiB host. Override via XDG parallelism.rayon_threads.