Requirements
- cmake
- clang
- libtool
- libstdc++-devel
Rust MSRV
We are using:
rustc 1.60.0 (7737e0b5c 2022-04-04)
Running
With Docker Compose - Nerdctl Compose
- You need to have docker installation locally. With containerd backend, if you want to bring single node Kafka replacement use:
$ nerdctl compose up
If you want to bring Confluent Kafka single node. You can:
$ nerdctl compose -f docker-compose.kafkasn.yml
If you want to bring full blown Confluent Kafka cluster. Use:
$ nerdctl compose -f docker-compose.kafkacluster.yml
Mind that nerdctl command is interchangeable with docker.
With K8S
- You need to have K8S installation locally.
$ cd k8s && kubectl apply -f . && kubectl port-forward svc/redpanda 9092:9092
- Now you can run the producers in Python.
$ virtualenv venv
$ source venv/bin/activate
$ which pip3 # check that it is pointing to venv
$ pip3 install aiokafka -U
$ python examples/producer.py
- Now you can spawn the double agent example (without durability).
$ RUST_LOG="info,rdkafka::client=warn" RUST_BACKTRACE=full cargo run --example double-agent
Environment variables passed above is optional, but suggested for development.