Skip to main content

Crate somatize_compiler

Crate somatize_compiler 

Source
Expand description

Graph compiler for Soma pipelines.

Transforms a [Graph] of filter nodes into an ExecutionPlan:

  • Topological ordering and parallelism detection
  • Cache resolution (content-addressable, cascade invalidation)
  • Schema validation between connected filters
  • Distribution wrapping for remote execution
  • [Scheduler] assigns plan nodes to workers

Re-exports§

pub use compiler::CompileMode;
pub use compiler::CompileResult;
pub use compiler::Compiler;
pub use compiler::Diagnostic;
pub use compiler::DiagnosticLevel;
pub use compiler::FilterRegistry;
pub use compiler::SimpleFilterRegistry;
pub use compiler::compile;
pub use plan::ExecutionPlan;
pub use scheduler::Assignment;
pub use scheduler::DataTransfer;
pub use scheduler::DistributionPlan;
pub use scheduler::Phase;
pub use scheduler::PlanPhase;
pub use scheduler::WorkerInfo;
pub use scheduler::schedule;

Modules§

compiler
Graph → ExecutionPlan compiler.
plan
Execution plan — the compiled representation of a pipeline.
scheduler
Scheduler: distributes ExecutionPlan nodes across available workers.