Struct UserAgentRotator 

pub struct UserAgentRotator { /* private fields */ }

User-agent rotator that cycles through a list of user-agent strings.

Thread-safe rotation using atomic operations. Useful for distributing requests across multiple identity strings to avoid detection.

Examples

use crawlkit_engine::http::UserAgentRotator;

let rotator = UserAgentRotator::new(vec![
    "bot/1.0".to_string(),
    "bot/2.0".to_string(),
]);
assert_eq!(rotator.next(), "bot/1.0");
assert_eq!(rotator.next(), "bot/2.0");
assert_eq!(rotator.next(), "bot/1.0"); // wraps around

Implementations

impl UserAgentRotator

pub fn new(agents: Vec<String>) -> Self

Creates a new rotator with the given user-agent strings.

Panics

Panics if agents is empty.

pub fn next(&self) -> &str

Returns the next user-agent string in rotation.

Uses AcqRel ordering to ensure fair rotation under contention. Relaxed would allow multiple threads to read the same index.

pub fn len(&self) -> usize

Returns the number of user-agents in the rotation.

pub fn is_empty(&self) -> bool

Returns true if the rotation contains no user-agents.

Trait Implementations

impl Debug for UserAgentRotator

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for UserAgentRotator

fn default() -> Self

Returns the “default value” for a type.