Struct DataForge 

pub struct DataForge { /* private fields */ }

Blocking dataset discovery and archive client.

Implementations

impl DataForge

pub fn new(provider: DatasetProvider) -> Result<Self>

Build a new client for the selected provider.

pub fn with_user_agent( provider: DatasetProvider, user_agent: &str, ) -> Result<Self>

Build a new client with a custom User-Agent.

pub fn with_token(self, token: impl Into<String>) -> Self

Attach a provider token. Hugging Face uses Authorization: Bearer <token>.

pub fn with_page_size(self, page_size: usize) -> Self

Set the API page size used for list requests.

pub fn provider(&self) -> DatasetProvider

Return the provider this client targets.

pub fn discover(&self, target: &DatasetTarget) -> Result<Vec<DatasetSummary>>

Discover datasets for a normalized target.

pub fn inspect(&self, dataset_id: &str) -> Result<DatasetDetails>

Fetch full details and file URLs for one dataset id.

pub fn archive_target( &self, target: &DatasetTarget, options: &ArchiveOptions, ) -> Result<ArchiveSummary>

Discover and archive datasets for a target.

pub fn archive_datasets( &self, datasets: &[DatasetSummary], options: &ArchiveOptions, ) -> Result<ArchiveSummary>

Archive discovered dataset summaries with bounded concurrent file downloads.

Trait Implementations

impl Clone for DataForge

fn clone(&self) -> DataForge

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.