llt-rs

low latency tools - rust

Low-Latency Toolkit

This toolkit provides core primitives designed for building high-performance, low-latency applications.

1. Lock-Free and Wait-Free Data Structures

[x] Atomic Ring Buffer (SPSC): A raw, wait-free, fixed-size ring buffer for single-producer, single-consumer scenarios. It uses explicit memory ordering (Acquire/Release) and cache-line padding to eliminate lock contention and false sharing. (v0.1.0)

2. High-Performance Channels

[x] SPSC Channel: A hybrid channel wrapper around the Atomic Ring Buffer. It combines the nanosecond-scale latency of lock-free operations with the CPU efficiency of blocking. It spins briefly for immediate data, but uses Condvar to park the thread during idle periods.

3. Thread Management

[ ] Steal-able Task Scheduler: A scheduler that dynamically balances workloads by allowing idle threads to "steal" tasks from busy threads.

[ ] CPU Affinity-Aware Thread Pool: A thread pool that can pin threads to specific CPU cores, reducing cache misses and context-switching overhead.

4. Memory Management

[x] Object Pool: A system for pre-allocating and recycling objects to avoid the latency spikes associated with dynamic memory allocation.

[ ] Arena Allocator: An allocator that manages memory in a large, pre-allocated block, freeing all objects at once for efficient batch processing.

5. Utilities & Diagnostics

[ ] High-Resolution Clock: A precise, low-overhead clock for accurate latency measurement and profiling.

[ ] Latency Profiler: Tools to measure and visualize latency distribution, helping identify and eliminate performance outliers.

[ ] Non-Blocking Logger: A logger that writes messages without blocking the main execution thread, enabling production debugging without performance impact.