Attribute Macros§
- inference_
server_ config - This macro consumes the struct, extracts any
#[config(default = ...)]attributes and regenerates a brand-new struct with: - inference_
server_ registry - This macro implements the new() function for the Registry struct given a list of Inference Server entries. This macro also defines some type aliases to make the generated code more readable. For instance for “MyModel” server_name the macro will define the following types: