tritonserver_rs

Module context

Source
Expand description

Cuda context for managing device execution.

Structs§

  • Cuda Context.
  • Handler of Cuda context that was pushed as current. On Drop will pop context from current.
  • Cuda representation of the device.

Functions§

  • Get Cuda context on device.
  • Initialize Cuda runtime. Should be called before any Cuda function, perfectly — on the start of the application.