Crate dset

Re-exports§

pub use xio;

Modules§

caption
metadata
st

Structs§

Path: A slice of a path (akin to str).
PathBuf: An owned, mutable path (akin to String).

Functions§

format_json_file: Formats a JSON file to have pretty-printed JSON.
process_caption_file: Process a caption file
process_json_file: Processes a JSON file with a given processor function.
process_json_to_caption: Processes a JSON file and converts it to a caption file.
process_safetensors_file: Process a safetensors file and extract its metadata
split_content: Splits content into tags and sentences.