pub struct SiteScope { /* private fields */ }Expand description
Decides which URLs belong to the site being crawled.
A URL is internal when its host (lower-cased, one leading www. removed) and its port
match the start address. The scheme is ignored, so http:// and https:// versions of
a page are the same site. Url::port is None for a scheme’s default port, so :80 on
http and :443 on https both read as “no explicit port”; any other port is part of
the site’s identity.
Subdomains other than www. are external.
Implementations§
Trait Implementations§
impl Eq for SiteScope
impl StructuralPartialEq for SiteScope
Auto Trait Implementations§
impl Freeze for SiteScope
impl RefUnwindSafe for SiteScope
impl Send for SiteScope
impl Sync for SiteScope
impl Unpin for SiteScope
impl UnsafeUnpin for SiteScope
impl UnwindSafe for SiteScope
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.