rust-data-processing 0.3.3

Schema-first ingestion (CSV, JSON, Parquet, Excel) into an in-memory DataSet, plus Polars-backed pipelines, SQL, profiling, validation, and map/reduce-style processing.
1
2
3
4
5
6
7
8
9
10

# Databricks integration: MinIO S3 warehouse (object_store Delta staging path).
# No Databricks cluster Docker — in-tree writes go to warehouse s3:// per CONNECTORS.md.
#
# Usage:
#   cd integration_testing/Databricks
#   docker compose up -d
#   python3 run_databricks_tests.py --no-rancher

include:
  - path: ../MinIO/docker-compose.yml