Struct LLMRegistryEntry

pub struct LLMRegistryEntry {

    pub id: String,
    pub family_id: String,
    pub organization: String,
    pub name: String,
    pub license: String,
    pub description: String,
    pub homepage: String,
    pub capabilities: HashMap<String, i32>,
    pub tags: Vec<String>,
    pub requirements: String,
    pub backend_uuid: String,
    pub url: String,
    pub config: HashMap<String, Value>,
    pub local: bool,
    pub connector_type: LLMConnectorType,
    pub parameters: HashMap<String, Value>,
    pub user_parameters: Vec<String>,
    pub session_parameters: HashMap<String, Value>,
    pub user_session_parameters: Vec<String>,
}

Registry entry, containing all the information to upload an LLM.

Most of this information is non-mandatory, and it’s fine to send empty strings. Try to avoid it if possible, since your app’s user will see the information in their Pantry UI.

At present, LLMConnectorType::LLMrs is the only working connector, and using it requires config[‘model_architecture’] to be set according to the rustformers/llm documentation

Fields

id: String

family_id: String

organization: String

name: String

license: String

description: String

homepage: String

capabilities: HashMap<String, i32>

tags: Vec<String>

requirements: String

backend_uuid: String

For security reasons, this gets overwritten by remote and returned when making either a download request or a download command.

url: String

config: HashMap<String, Value>

local: bool

connector_type: LLMConnectorType

parameters: HashMap<String, Value>

user_parameters: Vec<String>

session_parameters: HashMap<String, Value>

user_session_parameters: Vec<String>

Trait Implementations

impl Clone for LLMRegistryEntry

fn clone(&self) -> LLMRegistryEntry

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LLMRegistryEntry

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for LLMRegistryEntry

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for LLMRegistryEntry

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.