Module server

Module server 

Source
Expand description

Server initialization and lifecycle management.

Structs§

Server
Inference server object.
State
Flags that control how to collect the index.

Enums§

Batch
Batch properties of the model.
InstanceGroup
Kinds of instance groups recognized by TRITONSERVER.
LogLevel
Transaction
Transaction policy of the model.