Expand description
Triton KServe v2 HTTP adapter for rskit-inference.
This crate implements non-streaming rskit_inference::Inference against Triton’s KServe v2 HTTP data plane.
KServe v2 HTTP has no native streaming protocol,
so this adapter intentionally does not implement rskit_inference::StreamingInference.
Structs§
- Config
- Configuration for Triton KServe v2 HTTP serving.
Functions§
- register
- Register the Triton adapter factory in an explicit registry.