Struct ModelDeploymentCardBuilder

pub struct ModelDeploymentCardBuilder { /* private fields */ }

Builder for ModelDeploymentCard.

Implementations

impl ModelDeploymentCardBuilder

pub fn display_name(&mut self, value: String) -> &mut Self

Human readable model name, e.g. “Meta Llama 3.1 8B Instruct”

pub fn service_name(&mut self, value: String) -> &mut Self

Identifier to expect in OpenAI compatible HTTP request, e.g. “meta-llama/Meta-Llama-3.1-8B-Instruct” This will get slugified for use in NATS.

pub fn model_info(&mut self, value: Option<ModelInfoType>) -> &mut Self

Model information

pub fn tokenizer(&mut self, value: Option<TokenizerKind>) -> &mut Self

Tokenizer configuration

pub fn prompt_formatter( &mut self, value: Option<PromptFormatterArtifact>, ) -> &mut Self

Prompt Formatter configuration

pub fn prompt_context( &mut self, value: Option<Vec<PromptContextMixin>>, ) -> &mut Self

Prompt Formatter Config

pub fn last_published(&mut self, value: Option<DateTime<Utc>>) -> &mut Self

When this card was last advertised by a worker. None if not yet published.

pub fn revision(&mut self, value: u64) -> &mut Self

Incrementing count of how many times we published this card

pub fn requires_preprocessing(&mut self, value: bool) -> &mut Self

Does this model expect preprocessing (tokenization, etc) to be already done? If this is true they get a BackendInput JSON. If this is false they get a ChatCompletionRequest JSON.

pub fn build( &self, ) -> Result<ModelDeploymentCard, ModelDeploymentCardBuilderError>

Builds a new ModelDeploymentCard.

Errors

If a required field has not been initialized.

Trait Implementations

impl Clone for ModelDeploymentCardBuilder

fn clone(&self) -> ModelDeploymentCardBuilder

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for ModelDeploymentCardBuilder

fn default() -> Self

Returns the “default value” for a type.