Skip to main content

fetch_vraix_dump

Function fetch_vraix_dump 

Source
pub fn fetch_vraix_dump(
    from: &str,
    date: &str,
    input_path: Option<&str>,
    limit: Option<usize>,
    offset: usize,
    cache_ttl: Duration,
) -> Result<Vec<Data>>
Expand description

Fetch commonmeta records from a VRAIX daily dump for from (“crossref” or “datacite”) and date (YYYY-MM-DD).

With input_path, the local SQLite file at that path is read directly via read_vraix_sqlite (e.g. an already-downloaded dump); otherwise {from}-{date}.sqlite3.zst is downloaded from metadata.vraix.org — cached locally for cache_ttl via file_utils::download_file_cached — and decompressed into a temp file first.

limit/offset window the rows read from the dump; limit: None reads every row.