Crate s3_algo

S3 high-performance algorithms

High-performance algorithms for batch operations in Amazon S3.

https://docs.aws.amazon.com/AmazonS3/latest/dev/optimizing-performance-guidelines.html

Until now, uploading multiple files has been the main focus. Deletion of prefix is also implemented. Listing of files is planned.

performance of the upload functionality, until rusoto updates to tokio 0.2 and bytes 0.5.

Modules

timeout

The Timeout trait defines the how the timeout value of a multi-file upload evolves based on past file upload results. A default implementation TimeoutState is provided.

Structs

ListObjects
UploadConfig
UploadFileResult

Enums

Error
ObjectSource

Functions

files_recursive
s3_list_objects	Generates a stream of ListObjects with all objects in a bucket with the given prefix
s3_upload_files	Upload multiple files to S3.
strip_prefix	Just for convenience: to provide as path_to_key for s3_upload_files
testing_s3_client	S3 client for testing - assumes local minio on port 9000 and an existing credentials profile called testing