Crate burn_dataset 

Burn Dataset

Burn Dataset is a library for creating and loading datasets.

Modules

source

Sources for datasets.

transform

Dataset Transformations

Structs

DatasetIterator

Dataset iterator.

HuggingfaceDatasetLoadersqlite-bundled or sqlite

Load a dataset from huggingface datasets.

InMemDataset

Dataset where all items are stored in ram.

SqliteDatasetsqlite-bundled or sqlite

This struct represents a dataset where all items are stored in an SQLite database. Each instance of this struct corresponds to a specific table within the SQLite database, and allows for interaction with the data stored in the table in a structured and typed manner.

SqliteDatasetStoragesqlite-bundled or sqlite

The SqliteDatasetStorage struct represents a SQLite database for storing datasets. It consists of an optional name, a database file path, and a base directory for storage.

SqliteDatasetWritersqlite-bundled or sqlite

This SqliteDatasetWriter struct is a SQLite database writer dedicated to storing datasets. It retains the current writer’s state and its database connection.

Enums

ImporterErrorsqlite-bundled or sqlite

Error type for HuggingfaceDatasetLoader.

SqliteDatasetErrorsqlite-bundled or sqlite

Sqlite dataset error.

Traits

Dataset

The dataset trait defines a basic collection of items with a predefined size.

Type Aliases

Resultsqlite-bundled or sqlite

Result type for the sqlite dataset.