reqwest_resume
Wrapper that uses the Range
HTTP header to resume get requests.
It's a thin wrapper around reqwest
. It's a work in progress – wrapping functionality is copied across on an as-needed basis. Feel free to open a PR/issue if you need something.
Example
extern crate reqwest_resume;
extern crate flate2;
use ;
let url = "http://commoncrawl.s3.amazonaws.com/crawl-data/CC-MAIN-2018-30/warc.paths.gz";
let body = get.unwrap;
// Content-Encoding isn't set, so decode manually
let body = new;
for line in new.lines
License
Licensed under Apache License, Version 2.0, (LICENSE.txt or http://www.apache.org/licenses/LICENSE-2.0).
Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be licensed as above, without any additional terms or conditions.