Module parameter

Model inference requests and server parameters.

Structs

Parameter

Parameter of the Server or Response.

Enums

ParameterContent

Enum representation of Parameter content.

TritonParameterType

Types of parameters recognized by TRITONSERVER.

Functions

load_config_as_json

Load config.pbtxt from the config_path and parse it to json value.
Might be useful if it is required to run model with altered config. In this case String Parameter with name ‘config’ and the result of this method as data should be created and passed to Server::load_model_with_parametrs (Options::model_control_mode set as EXPLICIT required). Check realization of Parameter::from_config_with_exact_version as an example.
Note (Subject to change): congig must be in hjson format.