pub struct CrawlResume {
pub enqueued: Vec<String>,
pub pending: Vec<(String, usize)>,
pub done: usize,
}Expand description
中断的爬取任务恢复时的进度。完成的页面以文档的 metadata.sourceURL(失败的以出错的 URL)为准。
Fields§
§enqueued: Vec<String>入过队的全部 URL,按入队顺序(去重表)。
pending: Vec<(String, usize)>入了队但还没完成的 URL 和发现深度,按入队顺序。中断时正在抓的页面也在这里。
done: usize已经完成的页数(成功和失败都算),计入 limit。
Trait Implementations§
Source§impl Clone for CrawlResume
impl Clone for CrawlResume
Source§impl Debug for CrawlResume
impl Debug for CrawlResume
Source§impl Default for CrawlResume
impl Default for CrawlResume
Source§impl PartialEq for CrawlResume
impl PartialEq for CrawlResume
impl StructuralPartialEq for CrawlResume
Auto Trait Implementations§
impl Freeze for CrawlResume
impl RefUnwindSafe for CrawlResume
impl Send for CrawlResume
impl Sync for CrawlResume
impl Unpin for CrawlResume
impl UnsafeUnpin for CrawlResume
impl UnwindSafe for CrawlResume
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more