Struct FsStorageClient 

pub struct FsStorageClient { /* private fields */ }

A file-system storage client using Crawlee-compatible directory layouts.

Implementations

impl FsStorageClient

pub fn new(root: impl Into<PathBuf>) -> Self

Creates a client rooted at the supplied storage directory.

pub fn root(&self) -> &Path

Returns the storage root.

Trait Implementations

impl StorageClient for FsStorageClient

fn purge<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = StorageResult<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Deletes stored contents and clears the opened dataset and store caches.

The default key-value store’s INPUT.<ext> file is preserved for Crawlee migration parity. This matters when purge_on_start uses its default value of true. Previously opened handles remain usable, but subsequent opens return fresh instances backed by the purged layout.

fn open_dataset<'life0, 'life1, 'async_trait>( &'life0 self, name: Option<&'life1 str>, ) -> Pin<Box<dyn Future<Output = StorageResult<Arc<dyn Dataset>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Opens a dataset, using the default dataset when name is None.

fn open_key_value_store<'life0, 'life1, 'async_trait>( &'life0 self, name: Option<&'life1 str>, ) -> Pin<Box<dyn Future<Output = StorageResult<Arc<dyn KeyValueStore>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Opens a key-value store, using the default store when name is None.

fn open_request_queue<'life0, 'life1, 'async_trait>( &'life0 self, name: Option<&'life1 str>, ) -> Pin<Box<dyn Future<Output = StorageResult<Arc<dyn RequestQueue>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Opens a request queue, using the default queue when name is None.