Enum ServingProtocol 

#[non_exhaustive]
pub enum ServingProtocol {
    KServeV2Http,
    KServeV2Grpc,
    VllmRest,
    TgiRest,
    BentoMl,
    OnnxRuntime,
    TfServing,
    Custom,
}

Model-serving runtime protocol.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

KServeV2Http

KServe v2 over HTTP.

KServeV2Grpc

KServe v2 over gRPC.

VllmRest

vLLM raw REST generation APIs.

TgiRest

Hugging Face Text Generation Inference REST APIs.

BentoMl

BentoML serving APIs.

OnnxRuntime

ONNX Runtime serving APIs.

TfServing

TensorFlow Serving APIs.

Custom

Custom runtime protocol.

Trait Implementations

impl Clone for ServingProtocol

fn clone(&self) -> ServingProtocol

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ServingProtocol

impl Debug for ServingProtocol

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ServingProtocol

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for ServingProtocol

impl PartialEq for ServingProtocol

fn eq(&self, other: &ServingProtocol) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for ServingProtocol

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ServingProtocol