Crate burn_dataset 

Burn Dataset

Burn Dataset is a library for creating and loading datasets.

Modules

source

Sources for datasets.

transform

Dataset Transformations

Structs

DatasetIterator

Dataset iterator.

HuggingfaceDatasetLoadersqlite or sqlite-bundled

Load a dataset from huggingface datasets.

InMemDataset

Dataset where all items are stored in ram.

SqliteDatasetsqlite or sqlite-bundled

This struct represents a dataset where all items are stored in an SQLite database. Each instance of this struct corresponds to a specific table within the SQLite database, and allows for interaction with the data stored in the table in a structured and typed manner.

SqliteDatasetStoragesqlite or sqlite-bundled

The SqliteDatasetStorage struct represents a SQLite database for storing datasets. It consists of an optional name, a database file path, and a base directory for storage.

SqliteDatasetWritersqlite or sqlite-bundled

This SqliteDatasetWriter struct is a SQLite database writer dedicated to storing datasets. It retains the current writer’s state and its database connection.

Enums

ImporterErrorsqlite or sqlite-bundled

Error type for HuggingfaceDatasetLoader.

SqliteDatasetErrorsqlite or sqlite-bundled

Sqlite dataset error.

Traits

Dataset

The dataset trait defines a basic collection of items with a predefined size.

Type Aliases

Resultsqlite or sqlite-bundled

Result type for the sqlite dataset.