Crate smolscale2

A global, auto-scaling scheduler for [async-task] using work-balancing.

What? Another executor?

smolscale is a work-balancing executor based on [async-task], designed to be a drop-in replacement to smol and async-global-executor. It is designed based on the idea that work-stealing, the usual approach in async executors like async-executor and tokio, is not the right algorithm for scheduling huge amounts of tiny, interdependent work units, which are what message-passing futures end up being. Instead, smolscale uses work-balancing, an approach also found in Erlang, where a global “balancer” thread periodically instructs workers with no work to do to steal work from each other, but workers are not signalled to steal tasks from each other on every task scheduling. This avoids the extremely frequent stealing attempts that work-stealing schedulers generate when applied to async tasks.

smolscale’s approach especially excels in two circumstances:

• When the CPU cores are not fully loaded: Traditional work stealing optimizes for the case where most workers have work to do, which is only the case in fully-loaded scenarios. When workers often wake up and go back to sleep, however, a lot of CPU time is wasted stealing work. smolscale will instead drastically reduce CPU usage in these circumstances — a async-executor app that takes 80% of CPU time may now take only 20%. Although this does not improve fully-loaded throughput, it significantly reduces power consumption and does increase throughput in circumstances where multiple thread pools compete for CPU time.
• When a lot of message-passing is happening: Message-passing workloads often involve tasks quickly waking up and going back to sleep. In a work-stealing scheduler, this again floods the scheduler with stealing requests. smolscale can significantly improve throughput, especially compared to executors like async-executor that do not special-case message passing.

Re-exports

pub use fastcounter::*;

pub use immortal::*;

pub use reaper::*;

Modules

fastcounter

immortal

reaper

Constants

MONITOR_INTERVAL

Statics

SMOLSCALE2_SCHED_LB

SMOLSCALE_PROFILE

SMOLSCALE_USE_AGEX

Functions

active_task_count

Returns the current number of active tasks.

block_on

Spawns a future onto the global executor and immediately blocks on it.`

permanently_single_threadedDeprecated

[deprecated] Irrevocably puts smolscale into single-threaded mode.

running_threads

Returns the number of running worker threads.

set_max_threads

set maximum number of worker threads

set_threads

set minimum number of worker threads

spawn

Spawns a task onto the lazily-initialized global executor.

tick_monitor

tells the monitor something happening