spider-util-0.1.3
- spider-util 0.1.3
- Docs.rs crate page
- MIT
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- mzyui
- Dependencies
- bincode ^1.3 normal
  bytes ^1.11.1 normal
  csv ^1.1 normal
  dashmap ^6.1.0 normal
  futures-util ^0.3 normal
  http ^1.4.0 normal
  linkify ^0.10.0 normal
  once_cell ^1.19 normal
  parking_lot ^0.12 normal
  psl ^2.1.183 normal
  reqwest ^0.13.1 normal
  rusqlite ^0.31 normal
  scraper ^0.19 normal
  seahash ^4.1.0 normal
  serde ^1.0.228 normal
  serde_json ^1.0.149 normal
  thiserror ^2.0.18 normal
  twox-hash ^2.1.2 normal
  url ^2.5.8 normal
- Versions
- 70.49% of the crate is documented
Go to latest version
Platform
Feature flags

docs.rs

Rust

Skip to main content

All

spider_util0.1.3

Crate Items

Structs
Enums
Traits
Functions

List of all items

Structs

bloom_filter::BloomFilter
error::ReqwestErrorDetails
item::ParseOutput
request::Request
response::Link
response::Response
stream_response::StreamResponse

Enums

error::PipelineError
error::SpiderError
request::Body
response::LinkType
response_type::ResponseType

Traits

item::ScrapedItem
utils::ToSelector

Functions

selector_cache::get_cached_selector
selector_cache::prewarm_cache
utils::create_dir
utils::is_same_site
utils::normalize_origin
utils::validate_output_dir