celery-rs 0.6.0

Community-maintained Rust implementation of Celery (fork of rusty-celery)
Documentation
<div align="center">
    <br>
    <img src="img/rusty-celery-logo-transparent.png"/>
    <br>
    <br>
    <p>
    A Rust implementation of <a href="https://github.com/celery/celery">Celery</a> for producing and consuming asynchronous tasks with a distributed message queue.
    </p>
    <hr/>
</div>

> **📢 Project Status**: This is a community-maintained fork of the original [rusty-celery]https://github.com/rusty-celery/rusty-celery project. The original project became inactive, so we've taken over maintenance to ensure continued development and support for the Rust Celery ecosystem.

<p align="center">
    <a href="https://github.com/GaiaNet-AI/celery-rs/actions">
        <img alt="Build" src="https://github.com/GaiaNet-AI/celery-rs/workflows/CI/badge.svg?event=push&branch=main">
    </a>
    <a href="https://github.com/GaiaNet-AI/celery-rs/blob/main/LICENSE">
        <img alt="License" src="https://img.shields.io/github/license/GaiaNet-AI/celery-rs.svg?color=blue&cachedrop">
    </a>
    <a href="https://crates.io/crates/celery-rs">
        <img alt="Crates" src="https://img.shields.io/crates/v/celery-rs.svg?color=blue">
    </a>
    <a href="https://docs.rs/celery-rs/">
        <img alt="Docs" src="https://img.shields.io/badge/docs.rs-API%20docs-blue">
    </a>
    <a href="https://github.com/GaiaNet-AI/celery-rs/issues?q=is%3Aissue+is%3Aopen+label%3A%22help%20wanted%22">
        <img alt="Help wanted" src="https://img.shields.io/github/issues/GaiaNet-AI/celery-rs/help%20wanted?label=Help%20Wanted">
    </a>
</p>
<br/>


We welcome contributions from everyone regardless of your experience level with Rust. For complete beginners, see [HACKING_QUICKSTART.md](https://github.com/rusty-celery/rusty-celery/blob/main/HACKING_QUICKSTART.md).

If you already know the basics of Rust but are new to Celery, check out the [Rusty Celery Book](https://rusty-celery.github.io/) or the original Python [Celery Project](http://www.celeryproject.org/).

## Quick start

Define tasks by decorating functions with the [`task`](https://docs.rs/celery-rs/*/celery/attr.task.html) attribute.

```rust
use celery::prelude::*;

#[celery::task]
fn add(x: i32, y: i32) -> TaskResult<i32> {
    Ok(x + y)
}
```

Create an app with the [`app`](https://docs.rs/celery-rs/*/celery/macro.app.html) macro
and register your tasks with it:

```rust
let my_app = celery::app!(
    broker = AMQPBroker { std::env::var("AMQP_ADDR").unwrap() },
    tasks = [add],
    task_routes = [
        "*" => "celery",
    ],
).await?;
```

Then send tasks to a queue with

```rust
my_app.send_task(add::new(1, 2)).await?;
```

And consume tasks as a worker from a queue with

```rust
my_app.consume().await?;
```

## Examples

The [`examples/`](https://github.com/rusty-celery/rusty-celery/tree/main/examples) directory contains:

- a simple Celery app implemented in Rust using an AMQP broker ([`examples/celery_app.rs`]https://github.com/rusty-celery/rusty-celery/blob/main/examples/celery_app.rs),
- the same Celery app implemented in Python ([`examples/celery_app.py`]https://github.com/rusty-celery/rusty-celery/blob/main/examples/celery_app.py),
- and a Beat app implemented in Rust ([`examples/beat_app.rs`]https://github.com/rusty-celery/rusty-celery/blob/main/examples/beat_app.rs).

### Prerequisites

If you already have an AMQP broker running you can set the environment variable `AMQP_ADDR` to your broker's URL (e.g., `amqp://localhost:5672//`, where
the second slash at the end is the name of the [default vhost](https://www.rabbitmq.com/access-control.html#default-state)).
Otherwise simply run the helper script:

```bash
./scripts/brokers/amqp.sh
```

This will download and run the official [RabbitMQ](https://www.rabbitmq.com/) image (RabbitMQ is a popular AMQP broker).

### Run the examples

![](./img/demo.gif)

#### Run Rust Celery app

You can consume tasks with:

```bash
cargo run --example celery_app consume
```

And you can produce tasks with:

```bash
cargo run --example celery_app produce [task_name]
```

Current supported tasks for this example are: `add`, `buggy_task`, `long_running_task` and `bound_task`

#### Run Python Celery app

Similarly, you can consume or produce tasks from Python by running


```bash
python examples/celery_app.py consume [task_name]
```

or

```bash
python examples/celery_app.py produce
```

You'll need to have Python 3 installed, along with the requirements listed in the `requirements.txt` file.  You'll also have to provide a task name. This example implements 4 tasks: `add`, `buggy_task`, `long_running_task` and `bound_task`

#### Run Rust Beat app

You can start the Rust beat with:

```bash
cargo run --example beat_app
```

And then you can consume tasks from Rust or Python as explained above.

## Road map and current state

✅ = Supported and mostly stable, although there may be a few incomplete features.<br/>
⚠️ = Partially implemented and under active development.<br/>
🔴 = Not supported yet but on-deck to be implemented soon.

### Core

|                  | Status  | Tracking  |
| ---------------- |:-------:| --------- |
| Protocol         | ⚠️      | [![]https://img.shields.io/github/issues/rusty-celery/rusty-celery/Protocol%20Feature?label=Issues]https://github.com/rusty-celery/rusty-celery/issues?q=is%3Aissue+label%3A%22Protocol+Feature%22+is%3Aopen |
| Producers        || |
| Consumers        || |
| Brokers          || |
| Beat             || |
| Backends         | 🔴      | |
| [Baskets]https://github.com/rusty-celery/rusty-celery/issues/53 | 🔴      | |

### Brokers

|       | Status | Tracking |
| ----- |:------:| -------- |
| AMQP  || [![]https://img.shields.io/github/issues/rusty-celery/rusty-celery/Broker%3A%20AMQP?label=Issues]https://github.com/rusty-celery/rusty-celery/labels/Broker%3A%20AMQP |
| Redis || [![]https://img.shields.io/github/issues/rusty-celery/rusty-celery/Broker%3A%20Redis?label=Issues]https://github.com/rusty-celery/rusty-celery/labels/Broker%3A%20Redis |

### Backends

|             | Status | Tracking |
| ----------- |:------:| -------- |
| RPC         | 🔴     | [![]https://img.shields.io/github/issues/GaiaNet-AI/celery-rs/Backend%3A%20RPC?label=Issues]https://github.com/GaiaNet-AI/celery-rs/labels/Backend%3A%20RPC |
| Redis       | 🔴     | [![]https://img.shields.io/github/issues/GaiaNet-AI/celery-rs/Backend%3A%20Redis?label=Issues]https://github.com/GaiaNet-AI/celery-rs/labels/Backend%3A%20Redis |

## Project History and Maintenance

### This is a Community Fork

This project (`celery-rs`) is a community-maintained fork of the original [`rusty-celery`](https://github.com/rusty-celery/rusty-celery) project. We've taken over maintenance due to the original project becoming inactive.

**Key Changes in This Fork:**
- **Active Maintenance**: Regular updates and bug fixes
-**Updated Dependencies**: All dependencies kept up-to-date
-**Improved Stability**: Fixed broker connection issues and test reliability
-**Modern Rust**: Compatible with latest Rust versions and async ecosystem

### Migration from rusty-celery

If you're migrating from the original `rusty-celery`, the API remains **100% compatible**. Simply update your `Cargo.toml`:

```toml
[dependencies]
# Change from:
# celery = "0.5"

# To:
celery-rs = "0.6"
# Or use git directly:
# celery-rs = { git = "https://github.com/GaiaNet-AI/celery-rs", branch = "main" }
```

### Contributing

We welcome contributions! This fork aims to:
- Maintain API compatibility with the original project
- Provide active maintenance and support
- Keep dependencies updated
- Fix bugs and add features requested by the community

### Acknowledgments

Special thanks to the original [`rusty-celery`](https://github.com/rusty-celery/rusty-celery) team for creating this excellent foundation. This fork builds upon their work while ensuring continued development and support for the Rust Celery ecosystem.