Crate celers_protocol

Crate celers_protocol 

Source
Expand description

Celery Protocol v2/v5 implementation

This crate provides the core protocol definitions for Celery message format, ensuring compatibility with Python Celery workers.

§Protocol Compatibility

  • Celery Protocol v2 (Celery 4.x+)
  • Celery Protocol v5 (Celery 5.x+)

§Message Format

Messages consist of:

  • Headers: Task metadata (task name, ID, parent/root IDs, etc.)
  • Properties: AMQP properties (correlation_id, reply_to, delivery_mode)
  • Body: Serialized task arguments
  • Content-Type: Serialization format (“application/json”, “application/x-msgpack”)
  • Content-Encoding: Encoding format (“utf-8”, “binary”)

§Modules

  • compat - Python Celery compatibility verification
  • serializer - Pluggable serialization framework
  • result - Task result message format
  • event - Celery event message format
  • compression - Message body compression
  • embed - Embedded body format (args, kwargs, embed)
  • negotiation - Protocol version negotiation
  • security - Security utilities and content-type whitelist
  • builder - Fluent message builder API
  • auth - Message authentication and signing (HMAC)
  • crypto - Message encryption (AES-256-GCM)
  • extensions - Message extensions and utility helpers
  • migration - Protocol version migration helpers
  • middleware - Message transformation middleware
  • zerocopy - Zero-copy deserialization for performance
  • lazy - Lazy deserialization for large messages
  • pool - Message pooling for memory efficiency
  • extension_api - Custom protocol extensions API
  • utils - Message utility helpers
  • batch - Batch message processing utilities
  • routing - Message routing helpers
  • retry - Retry strategy utilities
  • dedup - Message deduplication utilities
  • priority_queue - Priority-based message queues
  • workflow - Workflow and task chain utilities

Modules§

auth
Message authentication and signing
batch
Batch message processing utilities
builder
Fluent message builder API
compat
Python Celery Protocol Compatibility Tests
compression
Compression support for message bodies
crypto
Message encryption and decryption
dedup
Message deduplication utilities
embed
Celery embedded body format
event
Celery event message format
extension_api
Custom protocol extensions API
extensions
Message extensions and utilities
lazy
Lazy deserialization for improved performance
middleware
Message transformation middleware
migration
Protocol version migration helpers
negotiation
Protocol version negotiation and detection
pool
Message pooling for memory efficiency
priority_queue
Priority queue for message processing
result
Task result message format
retry
Retry strategy utilities
routing
Message routing helpers
security
Security utilities for protocol handling
serializer
Pluggable serialization framework
utils
Message utility helpers
workflow
Workflow and task chain utilities
zerocopy
Zero-copy deserialization for performance optimization

Structs§

Message
Complete Celery message
MessageHeaders
Message headers (Celery protocol)
MessageProperties
Message properties (AMQP-like)
TaskArgs
Task arguments (args, kwargs)

Enums§

ContentEncoding
Content encoding
ContentType
Content type for serialization
ProtocolVersion
Protocol version
ValidationError
Validation errors for Celery protocol messages