Bunsen

by ZSpaceLabs

bunsen aims to be a "batteries included" complementary community standard library for extending the burn tensor library.

Motivation

This library is a synthesis of the utility and extension work that I've been accumulating in:

• https://github.com/zspacelabs/wordchipper
• https://github.com/zspacelabs/bimm
• https://github.com/zspacelabs/bimm-contracts
• https://github.com/zspacelabs/zsl-chat
• https://github.com/crutcher/clockmill

This library is a work in progress, and I'm working to fold the various utilities and support code from these projects into a single place; where we can closely track the burn release cycle, and minimize the dependency-hell churn problem for writing extensions.

I plan on continuing to work on this library, and recruit community involvement for landing and publishing new operators and blocks in a place we can lock down their testings and documentation.

Components

Burn Extensions

• bunsen::burner - this is a library of burn::module::Module lifecycle components which extend the current functionality of burn.
• bunsen::contracts - this is a library of runtime tensor-shape contracts.

Component Libraries

• bunsen::blocks - this is a library of burn::module::Module components. This includes simple inner layers, recurrent utility blocks.
• bunsen::kit - this is a library complete modules and simulators.
• bunsen::ops - this is a library burn::tensor::Tensor operations.

App and Testing Support Libs

• bunsen::errors - this is a library of error types and tooling.
• bunsen::support - this is a library of support functions for bunsen, including testing tooling which may be useful for clients.
• bunsen::zspace - this is a library of z-space / index utilities.

Future Components

The base libraries have significant features which haven't been polished and stabilized for bunsen yet.

• weight/data download disk cache - there are several implementations of this in my codebase so far, the most robust is probably in the wordchipper code.
• shard fetching - being able to bind a family of shards to URL template + range pattern; with information on the target format; and wire that smoothly into the download and cache layer. this is also currently in some of the LLM/chat codebases.
• LLM DataLoader - a high-performance burn data loader for LLM models, built on parquet/arrow; and wordchipper. This is currently in the zsl-chat codebase.
• Data transform pipeline - I did a pretty solid pass over an in-memory data transform pipeline for images, called bimm-firehose; and it is still in the bimm codebase. Something like it is needed to train image models.
• clap tooling - I've built a lot of burn-related clap tools, and I'm pretty sure some of the arguments/setup machinery could be shared.
• the rest of the bimm models.
• the bimm and zsl-chat training demos.

Demos

The bunsen repo includes a number of complex demos. The goal of the demos is to showcase the capabilities of the library; while also collecting a working edge of problems which could and should be improved by further development.

• clockmill - this is a demonstration of 2D/3D simulation on constant volume grids.

License

bunsen is distributed under the terms of both the MIT license and the Apache License (Version 2.0). See LICENSE-APACHE and LICENSE-MIT for details. Opening a pull request is assumed to signal agreement with these licensing terms