Struct DnsCache 

pub struct DnsCache { /* private fields */ }

A concurrent DNS cache with background prefetching.

Caches DNS resolution results with configurable TTL and provides background prefetching for upcoming URLs. Uses DashMap for concurrent access without external locking.

Examples

use crawlkit_engine::DnsCache;
use std::time::Duration;

let cache = DnsCache::new(Duration::from_secs(300), 10_000);
cache.insert("example.com", vec!["93.184.216.34:443".parse().unwrap()]);
assert!(cache.get_cached("example.com").is_some());

Implementations

impl DnsCache

pub fn new(default_ttl: Duration, max_entries: usize) -> Self

Creates a new DNS cache with the given TTL and capacity.

pub fn with_defaults() -> Self

Creates a DNS cache with sensible defaults (5 min TTL, 10k entries).

pub async fn resolve(&self, domain: &str) -> Result<Vec<SocketAddr>, DnsError>

Resolves a domain, using the cache if available and not expired.

pub async fn resolve_url(&self, url: &Url) -> Result<Vec<SocketAddr>, DnsError>

Resolves a domain from a URL.

pub fn insert(&self, domain: &str, addresses: Vec<SocketAddr>)

Inserts a pre-resolved entry into the cache.

pub fn get_cached(&self, domain: &str) -> Option<Vec<SocketAddr>>

Returns cached addresses for a domain without doing DNS resolution.

pub fn enqueue_prefetch(&self, domains: Vec<String>)

Queues domains for background prefetching.

pub fn dequeue_prefetch(&self, batch_size: usize) -> Vec<String>

Dequeues domains for prefetching (called by the background task).

pub fn len(&self) -> usize

Returns the number of entries in the cache.

pub fn is_empty(&self) -> bool

Returns true if the cache is empty.

pub fn memory_usage(&self) -> usize

Returns the approximate memory usage in bytes.

Trait Implementations

impl Default for DnsCache

fn default() -> Self

Returns the “default value” for a type.