spider-2.51.90
- spider 2.51.90
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- madeindjs
- j-mendez
- Dependencies
- ahash ^0.8 normal
  aho-corasick ^1 normal
  async-openai ^0.33 normal optional
  async-trait ^0.1 normal optional
  async_job ^0.1 normal optional
  auto_encoder ^0.1 normal
  base64 ^0.22 normal optional
  bytes ^1 normal
  case_insensitive_string ^0.2 normal
  chromey ^2 normal optional
  chrono ^0.4 normal optional
  const_format ^0.2 normal optional
  cookie ^0.18 normal optional
  cron ^0.15 normal optional
  dashmap ^6 normal optional
  fastrand ^2 normal optional
  flexbuffers ^25 normal optional
  gemini-rust ^1.7 normal optional
  h2 ^0.4 normal
  hashbrown ^0.16 normal
  hickory-resolver ^0.25 normal optional
  home ^0.5 normal optional
  http ^1 normal optional
  http-cache ^1.0.0-alpha.5 normal optional
  http-cache-reqwest ^1.0.0-alpha.5 normal optional
  http-cache-semantics ^3 normal optional
  http-global-cache ^0.2.0 normal optional
  httpdate ^1 normal optional
  itertools ^0.14 normal optional
  lazy_static ^1 normal
  llm_json ^1 normal optional
  log ^0.4 normal
  lol_html ^2 normal
  memchr ^2 normal
  mimalloc ^0.1 normal optional
  moka ^0.12 normal optional
  num_cpus ^1 normal
  percent-encoding ^2 normal
  phf ^0.13 normal
  pin-project-lite ^0.2 normal
  quick-xml ^0.39 normal
  rand ^0.9 normal optional
  regex ^1 normal
  reqwest-middleware ^0.5 normal optional
  serde ^1 normal optional
  serde_json ^1 normal optional
  serde_regex ^1 normal optional
  simdutf8 ^0.1 normal
  sitemap ^0.4 normal optional
  smallvec ^1 normal
  sonic-rs ^0.5 normal optional
  spider_agent ^2.51.90 normal optional
  spider_agent_types ^2.51.90 normal
  spider_fingerprint ^2 normal
  spider_firewall ^2 normal optional
  spider_remote_cache ^0.3 normal optional
  sqlx ^0.8 normal optional
  statrs ^0.18 normal optional
  string-interner ^0.19 normal optional
  string_concat ^0.0.1 normal
  strum ^0.28 normal
  sysinfo ^0.38 normal optional
  tempfile ^3 normal optional
  thirtyfour ^0.36 normal optional
  tiktoken-rs ^0.9 normal optional
  tikv-jemallocator ^0.6 normal optional
  tokio-stream ^0.1 normal
  tower ^0.5 normal
  tracing ^0.1 normal optional
  ua_generator ^0.5 normal optional
  url ^2 normal
  which ^6.0 normal optional
  wreq ^5 normal optional
  wreq-util ^2 normal optional
  zerocopy ^0.8 normal optional
  criterion ^0.5 dev
  env_logger ^0.11 dev
  serde_json ^1 dev
  libc ^0.2 normal optional
  fastrand ^2 normal optional
  reqwest ^0.13 normal
  tokio ^1 normal
  fastrand ^2 normal optional
  reqwest ^0.13 normal
  tokio ^1 normal
  io-uring ^0.7 normal optional
  libc ^0.2 normal
- Versions
- 100% of the crate is documented
Go to latest version
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

IGNORE_CONTENT_TYPES

spider2.51.90

In spider::utils

Static IGNORE_CONTENT_TYPES

pub static IGNORE_CONTENT_TYPES: Set<&'static str>

Expand description

Ignore the content types.