robin-sparkless-polars 4.7.0

Polars-backed DataFrame, Session, and expression layer for robin-sparkless.
docs.rs failed to build robin-sparkless-polars-4.7.0
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.
Visit the last successful build: robin-sparkless-polars-4.5.6

robin-sparkless-polars

Polars-backed implementation of robin-sparkless: SparkSession, DataFrame, DataFrameReader, Column, expression functions, UDFs, and plan execution. This is the only crate in the workspace that depends on Polars; the root crate is a thin facade that re-exports the public API.

crates.io docs.rs License: MIT

Contents

Area Description
Session SparkSession, SparkSessionBuilder, DataFrameReader — read CSV/Parquet/JSON/Delta, create_dataframe_*, sql, catalog (temp views, tables)
DataFrame DataFrame, GroupedData, CubeRollupData, PivotedGroupedData — filter, select, join, group_by, order_by, window, collect
Column / Expr Column, Polars Expr — built via functions::* (e.g. col, lit_*, when, aggregations, string/datetime/struct/map)
UDFs UdfRegistry, RustUdf, apply_* implementations used by expression layer
Plan Plan executor for embedded execution (e.g. Sparkless Python → plan JSON → this crate)
Optional SQL sql feature: spark.sql("SELECT ...") using spark-sql-parser
Optional Delta delta feature: read_delta, write_delta, Delta table support

Implements the engine traits from robin-sparkless-core and converts ExprIr to Polars Expr at the boundary.

Usage

Most users depend on the main crate, which pulls in this crate and re-exports the API:

[dependencies]
robin-sparkless = { version = "0.15", features = ["sql"] }

If you need to depend on the Polars backend directly (e.g. for a custom build or integration):

[dependencies]
robin-sparkless-core = "0.15"
robin-sparkless-polars = { version = "0.15", features = ["sql", "delta"] }

License

MIT. See the repository for details.