Struct Request 

pub struct Request {

    pub id: RequestId,
    pub url: Url,
    pub loaded_url: Option<Url>,
    pub unique_key: String,
    pub method: Method,
    pub headers: HeaderMap,
    pub body: Option<RequestBody>,
    pub user_data: UserData,
    pub label: Option<String>,
    pub retry_count: u32,
    pub session_rotation_count: u32,
    pub max_retries: Option<u32>,
    pub no_retry: bool,
    pub error_messages: Vec<String>,
    pub handled_at: Option<OffsetDateTime>,
    pub state: RequestState,
    pub crawl_depth: u32,
    pub skip_navigation: bool,
}

A crawl request and its processing state.

Fields

id: RequestId

Stable identifier derived from unique_key.

url: Url

URL to navigate to.

loaded_url: Option<Url>

Final URL after redirects, when navigation has occurred.

unique_key: String

Queue deduplication key.

method: Method

HTTP method.

headers: HeaderMap

HTTP headers, including repeated values.

body: Option<RequestBody>

Optional request body.

user_data: UserData

User-defined structured metadata.

label: Option<String>

Optional routing label.

retry_count: u32

Number of retry attempts made.

session_rotation_count: u32

Number of session rotations made.

max_retries: Option<u32>

Per-request retry limit override.

no_retry: bool

Whether retries are disabled.

error_messages: Vec<String>

Errors recorded during processing.

handled_at: Option<OffsetDateTime>

Time at which processing completed.

state: RequestState

Current lifecycle state.

crawl_depth: u32

Depth at which this request was discovered.

skip_navigation: bool

Whether navigation should be skipped.

Implementations

impl Request

pub fn get(url: impl IntoUrl) -> RequestBuilder

Creates a builder configured for a GET request.

pub fn post(url: impl IntoUrl) -> RequestBuilder

Creates a builder configured for a POST request.

pub fn builder() -> RequestBuilder

Creates an empty request builder.

pub fn compute_unique_key( url: &Url, method: &Method, body: Option<&RequestBody>, ) -> String

Computes a deterministic queue deduplication key.

Trait Implementations

impl Clone for Request

fn clone(&self) -> Request

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Request

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Request

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl From<Request> for RequestSource

fn from(request: Request) -> Self

Converts to this type from the input type.

impl IntoStartRequest for Request

fn into_start_request(self) -> Result<Request, CrawlError>

Converts this value into a request.

impl IntoStartRequests for Request

fn into_start_requests(self) -> Result<Vec<Request>, CrawlError>

Converts this value into an owned list of requests.

impl PartialEq for Request

fn eq(&self, other: &Request) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for Request

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Request