Skip to main content

Module runtime_options

Module runtime_options 

Source
Expand description

--<runtime>-<name> <value> on superfluid serve: an option of one runtime, checked against what its adapter declares and forwarded to its worker as --<name> <value>; set once per process, as BASERT_LIB is.

Structs§

Given
One --<runtime>-<name> <value> as given, resolved to the runtime it names.

Functions§

blamed
When a probe failed with options given: the option at fault, named as the daemon names it, when the worker answers without them; None when the runtime fails without them too.
check
The options among given for runtime, checked against its declarations, as the pairs its worker takes.
daemon_environment
What this process must carry for the libraries it loads itself: the llama.cpp tokenizer finds libllama by SUPERFLUID_LLAMA_LIB, since the worker’s --lib never reaches it.
declared_by
What superfluid runtime options <id> lists: a usable runtime’s declaration, else the one its adapter makes before an install, asked as runtime versions asks it (the worker named for it, the linked adapter, the worker that would install it): the options, --llamacpp-lib among them, are what one reads before the runtime runs here.
export_to_daemon
Sets daemon_environment on this process, before any such library is loaded.
for_runtime
The --<name> <value> pairs a worker of id gets.
given_pairs
The options as given, grouped by runtime, for the first probe of a runtime: an option that makes it usable here (its library, its environment) counts from the start, and the worker refuses one it does not take.
json
superfluid runtime options <id> --json.
looks_like
Whether flag is shaped as a runtime option, --<id>-<name>, spelled as a runtime id and an option name can be (an id may hold ‘.’ and ‘_’, a name never does); only then does serve keep it for resolve.
pull_args
The arguments an in-process pull gets: the runtime’s options alone, parsed as a worker process parses them.
refuse_repeats
Refuses an option given twice: the worker reads the last value and this process the first (daemon_environment), so a repeat would split one knob between two values; serve refuses it as a usage error before anything starts.
resolve
The runtime among ids that flag names, the longest id winning (--mlx-x-y is mlx’s x-y unless a runtime mlx-x is here), or None when no runtime here is named.
set
Keeps the settled options for every worker this process starts; the first call wins.
settle
Every given option checked: against primary for its runtime, and against any other runtime named, which must be usable here.
text
superfluid runtime options <id>, for a person.
worker_args
The arguments an in-process worker gets, parsed as a worker process parses them, so --venv lands in its field.
worker_args_from

Type Aliases§

Settled
The options per runtime, as the --<name> <value> pairs its worker takes.