pub struct AdaptiveOptions {
pub coverage_threshold: f64,
pub evidence_per_term: usize,
pub patience: usize,
pub min_gain: f64,
}Expand description
Adaptive crawl stopping conditions (PageSift extension adaptive). With them the crawl decides
how many pages it needs; limit is only a cap.
Fields§
§coverage_threshold: f64Share of query terms that must have evidencePerTerm pieces of evidence (from at least two
pages) before the query counts as covered. Once covered, the crawl stops after
ceil(patience / 2) pages in a row that add nothing new (coverage_reached).
evidence_per_term: usize§patience: usizePages in a row without new relevant content before the crawl stops (saturated). While
nothing relevant has been found, 2 × patience pages in a row reached only through links
without any sign of the query stop it (no_relevant_pages).
min_gain: f64A page whose new relevant content is less than this share of everything collected so far counts as adding nothing new.
Trait Implementations§
Source§impl Clone for AdaptiveOptions
impl Clone for AdaptiveOptions
Source§impl Debug for AdaptiveOptions
impl Debug for AdaptiveOptions
Source§impl Default for AdaptiveOptions
impl Default for AdaptiveOptions
Source§impl<'de> Deserialize<'de> for AdaptiveOptionswhere
AdaptiveOptions: Default,
impl<'de> Deserialize<'de> for AdaptiveOptionswhere
AdaptiveOptions: Default,
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for AdaptiveOptions
impl PartialEq for AdaptiveOptions
Source§impl Serialize for AdaptiveOptions
impl Serialize for AdaptiveOptions
impl StructuralPartialEq for AdaptiveOptions
Auto Trait Implementations§
impl Freeze for AdaptiveOptions
impl RefUnwindSafe for AdaptiveOptions
impl Send for AdaptiveOptions
impl Sync for AdaptiveOptions
impl Unpin for AdaptiveOptions
impl UnsafeUnpin for AdaptiveOptions
impl UnwindSafe for AdaptiveOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more