qrawl 0.6.0

Rust toolkit to crawl web data for AI agents
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27

/// Fetch Profiles
///
/// Each profile represents a platform with its natural default browser so User-Agent and headers are always consistent:
/// - `Windows` → Chrome (most popular on Windows)
/// - `MacOS` → Safari (native browser)
/// - `IOS` → Safari (only real browser on iPhone)
/// - `Android` → Chrome (most popular on Android)
/// - `Minimal` → Basic Mozilla (no platform-specific headers)
use serde::{Deserialize, Serialize};

#[derive(Debug, Clone, Copy, PartialEq, Eq, Hash, Serialize, Deserialize)]
pub enum FetchProfile {
    /// Minimal (just User-Agent)
    Minimal,

    /// Chrome on Windows (most popular desktop platform)
    Windows,

    /// Safari on macOS
    MacOS,

    /// Safari on iPhone (most popular mobile browser)
    IOS,

    /// Chrome on Android
    Android,
}