Skip to main content

Crate fv_compute_container

Crate fv_compute_container 

Source
Expand description

§fv-compute-container — the container backend

The second IMPL behind the same registry + contract: for heavy / GPU / arbitrary-dependency transforms that don’t fit the wasm sandbox. A transform is a process/image that reads Arrow IPC on stdin and writes Arrow IPC on stdout (the Arrow handoff), run in the isolated runtime. Heavier per invocation than wasm (process spawn) but the only option for arbitrary native deps.

Register it on a fv_compute::Backends set for impl = "container" manifests. Single-input today; multi-input container joins are a later extension.

Structs§

ContainerBackend
The container backend. Stateless — each load returns a ContainerCompute that spawns the transform’s process per run.
ContainerCompute
A loaded container transform. Each run spawns the entry process with cwd = the transform’s directory (so relative paths in the command resolve against it) and speaks Arrow IPC over stdio.