Skip to main content

Crate oxidelake_compute

Crate oxidelake_compute 

Source
Expand description

Physical operators (docs/SPEC.md §2.3): the Gpu*Exec DataFusion ExecutionPlans, the backend-agnostic GpuOperator that runs each batch on the local backend with CPU fallback, and the conformance suite (in tests/) that pins every operator to the stock DataFusion semantics.

Every exec records the planned backend (its EXPLAIN tag) but selects the real backend at execute() time from the local hardware detector, so a plan shipped to a machine without a GPU still runs correctly.

Dependency direction: depends on oxidelake-core, oxidelake-memory, oxidelake-device.

Re-exports§

pub use backend::init_local_backend;
pub use backend::local_backend;
pub use exec::GpuAggregateExec;
pub use exec::GpuFilterExec;
pub use exec::GpuHashJoinExec;
pub use exec::GpuVectorDistanceExec;
pub use exec::aggregate_output_schema;
pub use operator::GpuOperator;
pub use operator::JoinBuild;
pub use operator::JoinProbe;
pub use predict::ACTIVATION_KEY;
pub use predict::Activation;
pub use predict::Model;
pub use predict::ModelSpec;
pub use predict::PREDICT;
pub use predict::predict_udf;
pub use udf::COSINE_DISTANCE;
pub use udf::L2_DISTANCE;
pub use udf::cosine_distance_udf;
pub use udf::distance_metric_for;
pub use udf::distance_udf_name;
pub use udf::l2_distance_udf;
pub use udf::literal_query;
pub use udf::oxide_udfs;
pub use udf::query_literal;

Modules§

backend
Process-wide backend selection for operators.
display
EXPLAIN rendering helpers shared by the execs.
exec
The four Gpu*Exec DataFusion ExecutionPlans and their shared plumbing.
operator
GpuOperator: runs one operator’s batches on a backend with per-batch CPU fallback and telemetry.
params
Operator parameter types and the bounded v1 GPU type coverage.
predict
The predict scalar UDF: run a trained model over a column, in SQL.
udf
l2_distance / cosine_distance scalar UDFs (docs/SPEC.md §2.8).

Structs§

AggregateSpec
A grouped aggregation over one Int64 key.

Enums§

AggregateFunction
Aggregate functions supported by the grouped-aggregation kernel.
Comparison
Comparison operators supported by the fused filter kernel.
DistanceMetric
Distance metric for the vector kernel.
Literal
A literal a column is compared against.
Predicate
A filter predicate in the bounded v1 grammar: column-vs-literal comparisons combined with AND.

Constants§

FEATURE_MASK
Which optional capabilities of this build change what a plan can say, as a bitmask.

Functions§

gpu_eligible_scalar
true for the scalar types the v1 GPU kernels accept as filter, join-key and aggregate inputs.
vector_dimension
For a FixedSizeList<Float32, n> column returns Some(n); otherwise None.