Skip to main content

Module manifests

Module manifests 

Source
Expand description

Community runtime manifests: the manifest.toml that describes a user-installed runtime — what it can serve, how it launches (a [serve] sidecar or a one-shot [invoke] command, optionally inside a [vm]), and its permissions. Parsing uses the toml crate; the validation is the meat.

Structs§

ManifestDetect
How a runtime is auto-detected for a model: a weight-file extension, or a marker file (optionally containing a string) beside the model.
ManifestEnv
The Python environment a runtime needs.
ManifestInvoke
A one-shot command template.
ManifestPermissions
What the runtime is allowed to touch.
ManifestServe
A long-running sidecar entrypoint.
ManifestValidationError
A manifest that failed validation. Its message is available via Display.
ManifestVm
A digest-pinned VM image the runtime runs inside.
RuntimeManifest
A validated community runtime manifest.
RuntimeProvenance
The provenance of an installed runtime.