spider-2.36.3
- spider 2.36.3
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- madeindjs
- j-mendez
- Dependencies
- ahash ^0.8 normal
  aho-corasick ^1 normal optional
  async-openai ^0.28 normal optional
  async-trait ^0.1 normal optional
  async_job ^0.1 normal optional
  auto_encoder ^0.1 normal
  base64 ^0.22 normal optional
  bytes ^1 normal
  case_insensitive_string ^0.2 normal
  chrono ^0.4 normal optional
  const_format ^0.2 normal optional
  cron ^0.15 normal optional
  fastrand ^2 normal optional
  flexbuffers ^2 normal optional
  h2 ^0.4 normal
  hashbrown ^0.15 normal
  http ^1 normal optional
  http-cache ^0.20 normal optional
  http-cache-reqwest ^0.15 normal optional
  http-cache-semantics ^2 normal optional
  httpdate ^1 normal optional
  itertools ^0.14 normal optional
  lazy_static ^1 normal
  log ^0.4 normal
  lol_html ^2 normal
  moka ^0.12 normal optional
  num_cpus ^1 normal
  percent-encoding ^2 normal
  phf ^0.11 normal
  phf_codegen ^0.11 normal
  pin-project-lite ^0.2 normal
  quick-xml ^0.37 normal
  rand ^0.9 normal optional
  regex ^1 normal
  reqwest-middleware ^0.4 normal optional
  rquest ^5 normal optional
  rquest-util ^2 normal optional
  serde ^1 normal optional
  serde_json ^1 normal optional
  serde_regex ^1 normal optional
  sitemap ^0.4 normal optional
  smallvec ^1 normal
  sonic-rs ^0.4 normal optional
  spider_chrome ^2 normal optional
  spider_firewall ^2 normal optional
  sqlx ^0.8 normal optional
  statrs ^0.18 normal optional
  string-interner ^0.19 normal optional
  string_concat ^0.0.1 normal
  strum ^0.26 normal
  sysinfo ^0.33 normal optional
  tiktoken-rs ^0.6 normal optional
  tokio-stream ^0.1 normal
  tower ^0.5 normal
  tracing ^0.1 normal optional
  ua_generator ^0.5 normal optional
  url ^2 normal
  fastrand ^2 normal optional
  reqwest ^0.12 normal
  tokio ^1 normal
  fastrand ^2 normal optional
  reqwest ^0.12 normal
  tokio ^1 normal
  libc ^0.2 normal
  tokio-uring ^0.4 normal optional
- Versions
- 100% of the crate is documented
Go to latest version
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

spider2.36.3

In spider::utils

Static IGNORE_CONTENT_TYPES

pub static IGNORE_CONTENT_TYPES: Set<&'static str>

Expand description

Ignore the content types.