Skip to main content

Module soch_ql_executor

Module soch_ql_executor 

Source
Expand description

SOCH-QL Query Executor (Task 6)

End-to-end SOCH-QL query execution pipeline:

  1. parse(sql) → SochQuery
  2. validate(query, catalog) → Result<()>
  3. plan(query, stats) → QueryPlan
  4. execute(plan, storage) → SochTable

§Token Reduction Model

tokens_JSON(table) ≈ 4 + Σ(|field_name| + |value| + 4) per row
tokens_TOON(table) ≈ header + Σ(|value| + 1) per row
reduction = 1 - tokens_TOON/tokens_JSON ≈ 0.4 to 0.6

For 100 rows × 5 fields:
JSON: ~100 × (5 × 15) = 7,500 tokens
TOON: ~50 + 100 × 25 = 2,550 tokens → 66% reduction

Structs§

ColumnBatch
Columnar batch for vectorized processing
KeyRange
Key range for index seeks
Predicate
Query predicate
PredicateCondition
Single predicate condition (uses CoreSochValue for row compatibility)
SelectionVector
Selection vector for batch predicate evaluation
SochQlExecutor
SOCH-QL Query Executor
TokenReductionStats
Token reduction statistics
VectorizedExecutor
Vectorized executor for batch predicate evaluation
VectorizedStats
Statistics for vectorized execution

Enums§

QueryPlan
Query plan operators
VectorPredicate
Vectorized predicate for batch evaluation

Functions§

estimate_token_reduction
Estimate token reduction for a TOON result vs JSON
execute_sochql
Execute a SOCH-QL query (convenience function)