Crate wf_connector_api 

wf-connector-api

Minimal Arrow-native connector API for warp-fusion.

Design

wp-connector-api sources produce SourceEvent { payload: RawData }, designed for downstream parse pipelines. CEP engines like warp-fusion operate on Arrow RecordBatch directly.

wf-connector-api fills this gap for Arrow-native source consumption. (Sink output uses the existing wp-connector-api SinkRuntime — adding send_batch() to it is sufficient, no new trait needed.)

Relationship with wp-connector-api

	wp-connector-api	wf-connector-api
Source data	SourceEvent { payload: RawData }	RecordBatch (columnar)
Consumer	parse pipeline (WPL)	CEP engine (warp-fusion)
Error model	SourceResult<T> (orion-error)	SourceResult<T> (orion-error)
Lifecycle	start() / receive() / close()	start() / receive_batch() / close()

wp-connectors (the implementation crate) can implement BOTH traits for the same connector (Kafka / File / TCP), sharing connection logic.

Enums

SourceReason

Connector error reason.

Traits

BatchSource

A batch-oriented data source that produces Arrow RecordBatches.

Type Aliases

SourceError

SourceResult