Struct Embedding 

pub struct Embedding {
    pub http: HttpSurface,
    pub model_naming: ModelNaming,
    pub model_name: fn(&Path, &HashSet<String>) -> String,
    pub sampling_fallback: Option<SamplingFallback>,
    pub identity: ServerIdentity,
    pub session_socket: bool,
    pub workerd: Option<PathBuf>,
}

What a program running run in place of superfluid serve changes. Embedding::default is superfluid serve itself.

Fields

http: HttpSurface

The APIs served beside the OpenAI-compatible routes.

model_naming: ModelNaming

How a request’s model picks the model that serves it.

model_name: fn(&Path, &HashSet<String>) -> String

Names registered artifacts (initial, additional and model-dir models). Receives already registered names so an embedding can disambiguate variants. Explicit HTTP model IDs are not rewritten.

sampling_fallback: Option<SamplingFallback>

Sampling policy for omitted parameters; None is superfluid’s default.

identity: ServerIdentity

The name and version the HTTP API reports for the server.

session_socket: bool

Whether the native session API listens on a unix socket (--socket). Without it the HTTP API is all there is, and --no-http is refused.

workerd: Option<PathBuf>

The program that runs a linked runtime’s worker, in place of the superfluid-workerd beside this executable; it passes crate::workerd::main’s arguments to it.

Trait Implementations

impl Clone for Embedding

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Embedding

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Embedding

fn default() -> Embedding

Returns the “default value” for a type.