Module http_cache 

HTTP Cache Middleware for caching web responses.

This module provides the HttpCacheMiddleware, which intercepts HTTP requests and responses to implement a caching mechanism. It stores successful HTTP responses (e.g., 200 OK) to a local directory, and for subsequent identical requests, it serves the cached response instead of making a new network request. This can significantly reduce network traffic, improve crawling speed, and enable offline processing or replay of crawls.

The cache uses request fingerprints to identify unique requests and associates them with their corresponding cached responses. Responses are serialized and deserialized using bincode.

Structs

HttpCacheMiddleware

HttpCacheMiddlewareBuilder

Builder for HttpCacheMiddleware.