tritonserver_rs

Module server

Source
Expand description

Server initialization and lifecycle management.

Structs§

  • Batch properties of the model.
  • Inference server object.
  • Flags that control how to collect the index.
  • Transaction policy of the model.

Enums§

  • Kinds of instance groups recognized by TRITONSERVER.