robin-sparkless 4.0.0

PySpark-like DataFrame API in Rust on Polars; no JVM.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107

# MkDocs configuration for Read the Docs and local builds
# https://www.mkdocs.org/user-guide/configuration/

site_name: Robin Sparkless
site_description: PySpark-style DataFrames in Rust on Polars—no JVM
site_url: https://robin-sparkless.readthedocs.io/
repo_url: https://github.com/eddiethedean/robin-sparkless
repo_name: eddiethedean/robin-sparkless
edit_uri: edit/main/docs/
copyright: Robin Sparkless contributors

theme:
  name: material
  palette:
    - scheme: default
      primary: indigo
      accent: indigo
      toggle:
        icon: material/brightness-7
        name: Switch to dark mode
    - scheme: slate
      primary: indigo
      accent: indigo
      toggle:
        icon: material/brightness-4
        name: Switch to light mode
  features:
    - navigation.tabs
    - navigation.sections
    - navigation.expand
    - navigation.top
    - search.suggest
    - search.highlight

plugins:
  - search

markdown_extensions:
  - attr_list
  - admonition
  - pymdownx.superfences
  - pymdownx.highlight:
      anchor_linenums: true
  - toc:
      permalink: true

nav:
  - Home: index.md
  - Doc index: DOC_INDEX.md
  - Python (Sparkless 4.0):
    - Getting started: python_getting_started.md
    - Migration (PySpark / Sparkless 3): python_migration.md
  - Getting started:
    - User guide: USER_GUIDE.md
    - Quickstart: QUICKSTART.md
    - Embedding: EMBEDDING.md
    - Persistence guide: PERSISTENCE_GUIDE.md
    - Releasing: RELEASING.md
  - Reference:
    - PySpark differences: PYSPARK_DIFFERENCES.md
    - Parity status: PARITY_STATUS.md
    - Robin-Sparkless missing: ROBIN_SPARKLESS_MISSING.md
  - Sparkless integration:
    - Integration analysis: SPARKLESS_INTEGRATION_ANALYSIS.md
    - Full backend roadmap: FULL_BACKEND_ROADMAP.md
    - Refactor plan: SPARKLESS_REFACTOR_PLAN.md
    - Readiness plan: READINESS_FOR_SPARKLESS_PLAN.md
    - Logical plan format: LOGICAL_PLAN_FORMAT.md
  - Development:
    - Roadmap: ROADMAP.md
    - Test creation guide: TEST_CREATION_GUIDE.md
    - Converter status: CONVERTER_STATUS.md
    - Sparkless parity status: SPARKLESS_PARITY_STATUS.md
  - Status & analysis:
    - Signature gap analysis: SIGNATURE_GAP_ANALYSIS.md
    - Signature alignment tasks: SIGNATURE_ALIGNMENT_TASKS.md
    - Gap analysis (Sparkless 3.28): GAP_ANALYSIS_SPARKLESS_3.28.md
    - Parity check (Sparkless 3.28): PARITY_CHECK_SPARKLESS_3.28.md
    - Phase 15 gap list: PHASE15_GAP_LIST.md
    - Sparkless 3.28 API snapshot: SPARKLESS_3.28_API_SNAPSHOT.md
    - Sparkless parity issues reported: SPARKLESS_PARITY_ISSUES_REPORTED.md
    - Implementation status: IMPLEMENTATION_STATUS.md
  - More:
    - Bugs and improvements plan: BUGS_AND_IMPROVEMENTS_PLAN.md
    - Closed issues test coverage: CLOSED_ISSUES_TEST_COVERAGE.md
    - CreateDataFrame gaps: CREATEDATAFRAME_GAPS.md
    - DataFrame test guide: DATAFRAME_TEST_GUIDE.md
    - Deferred scope: DEFERRED_SCOPE.md
    - Full parity roadmap: FULL_PARITY_ROADMAP.md
    - Gap analysis (PySpark repo): GAP_ANALYSIS_PYSPARK_REPO.md
    - Integration test guide: INTEGRATION_TEST_GUIDE.md
    - Lazy backend plan: LAZY_BACKEND_PLAN.md
    - Migration status: MIGRATION_STATUS.md
    - Parity functions expectations: PARITY_FUNCTIONS_EXPECTATIONS.md
    - Persistence between sessions: PERSISTENCE_BETWEEN_SESSIONS.md
    - Polars crate isolation: POLARS_CRATE_ISOLATION.md
    - Ported test expectations: PORTED_TEST_EXPECTATIONS.md
    - PySpark mode test failures: PYSPARK_MODE_TEST_FAILURES.md
    - PySpark test translation: PYSPARK_TEST_TRANSLATION.md
    - PySpark version notes: PYSPARK_VERSION_NOTES.md
    - Rust-first testing: RUST_FIRST_TESTING.md
    - Sparkless Python test port: SPARKLESS_PYTHON_TEST_PORT.md
    - Subcrate split plan: SUBCRATE_SPLIT_PLAN.md
    - Test failure checklist: TEST_FAILURE_CHECKLIST.md
    - TODO Spark DDL parser Rust: TODO_SPARK_DDL_PARSER_RUST.md
    - UDF guide: UDF_GUIDE.md
    - Test failure categories: test_failure_categories.md