Expand description
Arrow Zerobus SDK Wrapper
Cross-platform Rust SDK wrapper for Databricks Zerobus with Python bindings. Provides a unified API for sending Arrow RecordBatch data to Zerobus with automatic protocol conversion, authentication, retry logic, and observability.
§Features
- Rust SDK API for sending Arrow RecordBatch data to Zerobus
- Python bindings (Python 3.11+) via PyO3
- Automatic retry with exponential backoff + jitter
- Automatic token refresh for long-running operations
- OpenTelemetry observability integration
- Optional debug file output (Arrow + Protobuf)
- Thread-safe concurrent operations
§Example
use arrow_zerobus_sdk_wrapper::{ZerobusWrapper, WrapperConfiguration};
use arrow::record_batch::RecordBatch;
Re-exports§
pub use config::OtlpConfig;pub use config::OtlpSdkConfig;pub use config::WrapperConfiguration;pub use error::ZerobusError;pub use wrapper::ErrorStatistics;pub use wrapper::TransmissionResult;pub use wrapper::ZerobusWrapper;
Modules§
- config
- Configuration module for Zerobus SDK Wrapper
- error
- Error types for the Zerobus SDK Wrapper
- observability
- OpenTelemetry observability integration
- utils
- Utility modules
- wrapper
- Main wrapper implementation for Zerobus SDK