pub struct QueueEntry {
pub url: Url,
pub canonical_url: Url,
pub depth: usize,
pub priority: Priority,
pub discovered_at: DateTime<Utc>,
pub referrer: Option<Url>,
}Expand description
A URL entry in the crawl queue.
Contains the URL, its canonical form, crawl depth, priority, discovery timestamp, and optional referrer. Ordered by priority (lower value = higher priority) for the min-heap queue.
Fields§
§url: UrlThe URL to crawl.
canonical_url: UrlThe canonical (normalized) URL for deduplication.
depth: usizeCrawl depth from the seed URL (0 = seed).
priority: PriorityPriority score (lower = higher priority).
discovered_at: DateTime<Utc>When this URL was discovered.
referrer: Option<Url>The URL that discovered this one.
Trait Implementations§
Source§impl Clone for QueueEntry
impl Clone for QueueEntry
Source§fn clone(&self) -> QueueEntry
fn clone(&self) -> QueueEntry
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for QueueEntry
impl Debug for QueueEntry
Source§impl<'de> Deserialize<'de> for QueueEntry
impl<'de> Deserialize<'de> for QueueEntry
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for QueueEntry
Source§impl Ord for QueueEntry
impl Ord for QueueEntry
1.21.0 (const: unstable) · Source§fn max(self, other: Self) -> Selfwhere
Self: Sized,
fn max(self, other: Self) -> Selfwhere
Self: Sized,
Compares and returns the maximum of two values. Read more
Source§impl PartialEq for QueueEntry
impl PartialEq for QueueEntry
Auto Trait Implementations§
impl Freeze for QueueEntry
impl RefUnwindSafe for QueueEntry
impl Send for QueueEntry
impl Sync for QueueEntry
impl Unpin for QueueEntry
impl UnsafeUnpin for QueueEntry
impl UnwindSafe for QueueEntry
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Comparable<K> for Q
impl<Q, K> Comparable<K> for Q
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more