Module parameter

Model inference requests and server parameters.

Structs

• Parameter
  Parameter of the Server or Response.
• TritonParameterType
  Types of parameters recognized by TRITONSERVER.

Enums

• ParameterContent
  Enum representation of Parameter content.

Functions

• load_config_as_json
  Load config.pbtxt from the config_path and parse it to json value.
  Might be useful if it is required to run model with altered config. In this case String Parameter with name ‘config’ and the result of this method as data should be created and passed to Server::load_model_with_parametrs (Options::model_control_mode set as EXPLICIT required). Check realization of Parameter::from_config_with_exact_version as an example.
  Note (Subject to change): congig must be in hjson format.