Function enforce_robots 

pub async fn enforce_robots(
    url: &str,
    policy: RobotsPolicy,
    user_agent: &str,
) -> Result<(), CliError>

Fetch origin robots.txt and enforce honor policy (async, one-shot).