crawlkit_extensions/lib.rs
1//! # crawlkit-extensions
2//!
3//! crawlkit 官方第三方服务扩展集，提供开箱即用的云爬虫后端实现。
4//!
5//! ## 支持的服务
6//!
7//! | 服务 | Feature | 免费额度 | 说明 |
8//! |------|---------|---------|------|
9//! | [Jina Reader](https://jina.ai/reader) | `jina`（默认） | 1000 次/月 | 网页转 Markdown |
10//! | [Firecrawl](https://firecrawl.dev) | `firecrawl` | 500 次/月 | JS 渲染 + 结构化提取 |
11//! | [Lightpanda](https://github.com/lightpanda-io/browser) | `cdp` | 免费开源 | 轻量级 CDP 无头浏览器 |
12//! | [Obscura](https://github.com/h4ckf0r0day/obscura) | `cdp` | 免费开源 | Rust 编写，内置反检测 |
13//!
14//! ## 快速开始
15//!
16//! ```toml
17//! [dependencies]
18//! crawlkit-extensions = "0.2"
19//! ```
20//!
21//! ```rust
22//! use crawlkit_extensions::jina::JinaClient;
23//!
24//! let client = JinaClient::builder()
25//! .with_token("your-api-token")
26//! .build();
27//! ```
28
29pub mod jina;
30
31#[cfg(feature = "firecrawl")]
32pub mod firecrawl;
33
34#[cfg(feature = "cdp")]
35pub mod cdp;
36
37pub use jina::{JinaClient, JinaFormat};
38#[cfg(feature = "firecrawl")]
39pub use firecrawl::FirecrawlClient;
40#[cfg(feature = "cdp")]
41pub use cdp::CdpClient;