robin-sparkless-core 0.15.0

Shared types, config, and error for robin-sparkless (no Polars).
Documentation

robin-sparkless-core

Shared types, config, error, and engine-agnostic expression IR for robin-sparkless. No Polars dependency — use this crate when you want schema, config, or expression building without pulling in an execution backend.

crates.io docs.rs License: MIT

Contents

Area Description
Config SparklessConfig for session/engine configuration
Schema DataType, StructField, StructType (engine-agnostic)
Error EngineError used across backends
Engine traits SparkSessionBackend, DataFrameReaderBackend, DataFrameBackend, GroupedDataBackend, PlanExecutor, JoinType, CollectedRows
Expression IR ExprIr, LiteralValue, and builders: col, when, lit_i64, lit_str, lit_bool, lit_f64, lit_i32, lit_null, gt, lt, eq, and_, or_, between, is_in, call, etc.

Backends (e.g. robin-sparkless-polars) implement the engine traits and convert ExprIr into their native representation. The root crate robin-sparkless re-exports the public API and wires in one backend.

Usage

Most users depend on the main crate only:

[dependencies]
robin-sparkless = "0.15"

If you are building a custom backend or need only types and expression IR:

[dependencies]
robin-sparkless-core = "0.15"

License

MIT. See the repository for details.