Crate oxigdal_kafka 

Apache Kafka integration for OxiGDAL

This crate provides comprehensive Apache Kafka support for OxiGDAL, including:

• Producer: Async producer with batching, partitioning, and compression
• Consumer: Async consumer with consumer groups and offset management
• Schema Registry: Avro schema management with evolution support
• Transactions: Transactional producer/consumer with exactly-once semantics

Features

• producer - Enable producer functionality (default)
• consumer - Enable consumer functionality (default)
• schema-registry - Enable Avro schema registry support
• transactions - Enable transactional support
• compression-* - Enable various compression algorithms

Example

use oxigdal_kafka::producer::{ProducerConfig, KafkaProducer};

let config = ProducerConfig::builder()
    .bootstrap_servers("localhost:9092")
    .build()?;

let producer = KafkaProducer::new(config).await?;
producer.send("my-topic", Some(b"key".as_slice()), b"value").await?;

Re-exports

pub use error::Error;

pub use error::Result;

pub use producer::KafkaProducer;

pub use producer::ProducerConfig;

pub use consumer::ConsumerConfig;

pub use consumer::KafkaConsumer;

Modules

config

Common configuration types for Kafka operations

consumer

Kafka consumer implementation

error

Error types for Kafka operations

producer

Kafka producer implementation