Crate little_loadshedder

Crate little_loadshedder 

Source
Expand description

A load-shedding middleware based on Little’s law.

This provides middleware for shedding load to maintain a target average latency, see the documentation on the LoadShed service for more detail.

The metrics feature uses the metrics crate to provide insight into the current queue sizes and measured latency.

Structs§

LoadShed
A Service that attempts to hold the average latency at a given target.
LoadShedLayer
A Layer to wrap services in a LoadShed middleware.

Enums§

LoadShedResponse
Either an error from the wrapped service or message that the request was shed