tritonserver_rs

Macro run_in_context_sync

Source
macro_rules! run_in_context_sync {
    ($val: expr, $expr: expr) => { ... };
}
Expand description

Run cuda code (which should be run in sync + cuda context pinned).

First argument is an id of device to run function on; second is the code to run.

If “gpu” feature is off just runs a code without context/blocking.