Module datafusion 

DataFusion integration for SQL processing.

Re-exports

pub use complex_type_lambda::register_lambda_functions;

pub use complex_type_lambda::ArrayFilter;

pub use complex_type_lambda::ArrayReduce;

pub use complex_type_lambda::ArrayTransform;

pub use complex_type_lambda::MapFilter;

pub use complex_type_lambda::MapTransformValues;

pub use complex_type_udf::register_complex_type_functions;

pub use complex_type_udf::MapContainsKey;

pub use complex_type_udf::MapFromArrays;

pub use complex_type_udf::MapKeys;

pub use complex_type_udf::MapValues;

pub use complex_type_udf::StructDrop;

pub use complex_type_udf::StructExtract;

pub use complex_type_udf::StructMerge;

pub use complex_type_udf::StructRename;

pub use complex_type_udf::StructSet;

pub use execute::execute_streaming_sql;

pub use execute::DdlResult;

pub use execute::QueryResult;

pub use execute::StreamingSqlResult;

pub use format_bridge_udf::FromJsonUdf;

pub use format_bridge_udf::ParseEpochUdf;

pub use format_bridge_udf::ParseTimestampUdf;

pub use format_bridge_udf::ToJsonUdf;

pub use json_extensions::register_json_extensions;

pub use json_extensions::JsonInferSchema;

pub use json_extensions::JsonToColumns;

pub use json_extensions::JsonbDeepMerge;

pub use json_extensions::JsonbExcept;

pub use json_extensions::JsonbFlatten;

pub use json_extensions::JsonbMerge;

pub use json_extensions::JsonbPick;

pub use json_extensions::JsonbRenameKeys;

pub use json_extensions::JsonbStripNulls;

pub use json_extensions::JsonbUnflatten;

pub use json_path::CompiledJsonPath;

pub use json_path::JsonPathStep;

pub use json_path::JsonbPathExistsUdf;

pub use json_path::JsonbPathMatchUdf;

pub use json_tvf::register_json_table_functions;

pub use json_tvf::JsonbArrayElementsTextTvf;

pub use json_tvf::JsonbArrayElementsTvf;

pub use json_tvf::JsonbEachTextTvf;

pub use json_tvf::JsonbEachTvf;

pub use json_tvf::JsonbObjectKeysTvf;

pub use json_udaf::JsonAgg;

pub use json_udaf::JsonObjectAgg;

pub use json_udf::JsonBuildArray;

pub use json_udf::JsonBuildObject;

pub use json_udf::JsonTypeof;

pub use json_udf::JsonbContainedBy;

pub use json_udf::JsonbContains;

pub use json_udf::JsonbExists;

pub use json_udf::JsonbExistsAll;

pub use json_udf::JsonbExistsAny;

pub use json_udf::JsonbGet;

pub use json_udf::JsonbGetIdx;

pub use json_udf::JsonbGetPath;

pub use json_udf::JsonbGetPathText;

pub use json_udf::JsonbGetText;

pub use json_udf::JsonbGetTextIdx;

pub use json_udf::ToJsonb;

pub use live_source::LiveSourceHandle;

pub use live_source::LiveSourceProvider;

pub use lookup_join_exec::LookupJoinExec;

pub use lookup_join_exec::LookupJoinExtensionPlanner;

pub use lookup_join_exec::LookupSnapshot;

pub use lookup_join_exec::LookupTableRegistry;

pub use lookup_join_exec::PartialLookupJoinExec;

pub use lookup_join_exec::PartialLookupState;

pub use lookup_join_exec::RegisteredLookup;

pub use lookup_join_exec::VersionedLookupJoinExec;

pub use lookup_join_exec::VersionedLookupState;

pub use proctime_udf::ProcTimeUdf;

pub use watermark_filter::WatermarkDynamicFilter;

pub use watermark_udf::WatermarkUdf;

pub use window_udf::CumulateWindowStart;

pub use window_udf::HopWindowStart;

pub use window_udf::SessionWindowStart;

pub use window_udf::TumbleWindowStart;

Modules

complex_type_lambda

Lambda higher-order functions for arrays and maps (F-SCHEMA-015 Tier 3) Lambda higher-order functions for arrays and maps (F-SCHEMA-015 Tier 3).

complex_type_udf

Array, Struct, and Map scalar UDFs (F-SCHEMA-015) Array, Struct, and Map scalar UDFs (F-SCHEMA-015).

execute

End-to-end streaming SQL execution Streaming SQL execution via DataFusion.

format_bridge_udf

Format bridge UDFs for inline format conversion Format bridge scalar UDFs (F-SCHEMA-014).

json_extensions

LaminarDB streaming JSON extension UDFs (F-SCHEMA-013) LaminarDB JSON extension UDFs (F-SCHEMA-013).

json_path

SQL/JSON path query compiler and scalar UDFs SQL/JSON path query functions.

json_tvf

JSON table-valued functions (array/object expansion) JSON table-valued functions.

json_types

JSONB binary format types for JSON UDF evaluation JSONB type system for JSON UDF evaluation.

json_udaf

PostgreSQL-compatible JSON aggregate UDAFs PostgreSQL-compatible JSON aggregate UDFs (F-SCHEMA-011).

json_udf

PostgreSQL-compatible JSON scalar UDFs PostgreSQL-compatible JSON scalar UDFs (F-SCHEMA-011).

live_source

Live source provider for streaming execution with plan caching Swappable table provider that eliminates per-cycle catalog churn and enables physical plan caching.

lookup_join

Lookup join plan node for DataFusion. LookupJoinNode — custom DataFusion logical plan node for lookup joins.

lookup_join_exec

Physical execution plan and extension planner for lookup joins. Physical execution plan for lookup joins.

proctime_udf

Processing-time UDF for PROCTIME() support Processing-time UDF for DataFusion integration

watermark_filter

Dynamic watermark filter for scan-level late-data pruning Dynamic watermark filter for scan-level late-data pruning

watermark_udf

Watermark UDF for current watermark access Watermark UDF for DataFusion integration

window_udf

Window function UDFs (TUMBLE, HOP, SESSION, CUMULATE) Window function UDFs for DataFusion integration

Structs

BridgeSender

A cloneable sender for pushing RecordBatch instances into a bridge.

BridgeStream

A stream that pulls RecordBatch instances from the bridge.

ChannelStreamSource

A streaming source that receives data through a channel.

SortColumn

Declares a column’s sort ordering for a streaming source.

StreamBridge

Push-to-pull bridge carrying RecordBatch results from the reactor into a DataFusion query execution plan.

StreamingScanExec

A DataFusion execution plan that scans from a streaming source.

StreamingTableProvider

A DataFusion table provider backed by a streaming source.

Enums

BridgeSendError

Error when sending a batch to the bridge.

BridgeTrySendError

Error when trying to send a batch without blocking.

Traits

StreamSource

A source of streaming data for DataFusion queries.

Functions

base_session_config

Returns a base SessionConfig with identifier normalization disabled.

create_session_context

Creates a DataFusion session context with identifier normalization disabled.

create_streaming_context

Creates a DataFusion session context configured for streaming queries.

create_streaming_context_with_validator

Creates a streaming context with a configurable validator mode.

register_json_functions

Registers all PostgreSQL-compatible JSON UDFs and UDAFs with the given SessionContext.

register_streaming_functions

Registers LaminarDB streaming UDFs with a session context.

register_streaming_functions_with_watermark

Registers streaming UDFs with a live watermark source.

Type Aliases

StreamSourceRef

A shared reference to a stream source.