Struct FileStore 

pub struct FileStore { /* private fields */ }

An abstract interface over one or more storage transports.

Supports separate writable and read-only transport pools. Write operations (upload, put, delete) only target writable transports. Read operations (download, get, exists, stream) search both pools, with read-only transports used as a fallback for data that hasn’t been migrated to the primary storage.

Implementations

impl FileStore

pub async fn open(urls: &[String]) -> Result<Arc<FileStore>>

Open all urls with default parameters

pub async fn with_limit_retries(url: &str) -> Result<Arc<FileStore>>

Open a single url with retrying disabled

pub async fn put(&self, name: &str, body: &Bytes) -> Result<()>

Upload a buffer to all writable transports. Read-only transports are skipped.

pub async fn exists(&self, name: &str) -> Result<bool>

Check if a given blob is defined in any transport (writable or read-only). Errors will be supressed as long as any transport contains the file.

pub async fn get(&self, name: &str) -> Result<Option<Vec<u8>>>

Pull blob to in memory buffer from any transport (writable or read-only). Returns errors only if all transports fail, otherwise errors will be logged as warnings.

pub async fn download(&self, name: &str, path: &Path) -> Result<()>

Download a blob and write it to a local file from any transport (writable or read-only). If the file does not exist it will be created. If it does exist it will be replaced.

pub async fn upload(&self, path: &Path, name: &str) -> Result<()>

Upload a local file as a named blob to writable transports only. Read-only transports are skipped.

pub async fn upload_batch( &self, local_remote_tuples: &[(&Path, &str)], ) -> Vec<(PathBuf, String, String)>

Upload a collection of local files to writable transports only.

pub async fn stream( &self, name: &str, ) -> Result<(u64, Receiver<Result<Bytes, Error>>)>

Stream the content of a blob from any transport (writable or read-only). Returns the total expected length of the stream and a message receiver of data buffers.

pub async fn delete(&self, name: &str) -> Result<()>

Remove a blob from writable storage only. Read-only transports are skipped.

Trait Implementations

impl Debug for FileStore

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.