Skip to main content

Module compute

Module compute 

Source
Expand description

The worker’s compute runtime: a wasm / container pipeline step selects a Kinetics transform by ref; fv_plan::KineticsRunner types the rows, runs it, and returns rows. This module only decides which transforms and backends the worker has: the roots from FV_TRANSFORMS_DIR, and both shipped backends.

Structs§

WorkerCompute
Runs wasm / container steps on a shared fv_compute::Runtime.

Functions§

from_env
A runner from FV_TRANSFORMS_DIR (colon-separated roots). Unset means an empty registry, so compute steps fail closed; a malformed manifest in a configured root fails loudly here.
run_batch
Run a wasm / container step on a batch: the batch is typed to the transform’s declared input signature (columns by name, cast safely — a value that does not fit lands null, a missing column is all null), run once, and the transform’s output batch returned as is.
runtime_with_roots
The Kinetics runtime itself (registry + backends + cache) over the roots, for the columnar path that hands a RecordBatch to a transform directly.
typed_batch
batch reshaped to schema: columns by name, cast safely (unfittable values → null), missing columns all null.
with_roots
A runner over an ordered list of transform roots (the provided package first, business bundles after; later roots override by id@version), with the wasm and container backends registered.