Module cache 

Filesystem-based HTTP response cache for development mode.

When Spider::development_mode returns true, the engine creates a ResponseCacheManager that saves every fetched response to disk as a JSON file. On subsequent runs, cached responses are served directly without hitting the network, which dramatically speeds up iterative development of parse logic.

Each cached response is stored as <hex-fingerprint>.json inside the cache directory. The response body is base64-encoded to keep the JSON valid regardless of the body’s content type. Writes are atomic (temp file + rename) to prevent partial files.

This cache is not intended for production use. It does not implement expiration, size limits, or cache-control header semantics.

Structs

ResponseCacheManager

Manages a filesystem cache of HTTP responses, keyed by request fingerprint.