Bunsen

by ZSpaceLabs

bunsen aims to be a "batteries included" complementary community standard library for extending the burn tensor library.

Book

Read the bunsen book

Components

Burn Extensions

• bunsen::burner - this is a library of burn::module::Module lifecycle components which extend the current functionality of burn.
• bunsen::contracts - this is a library of runtime tensor-shape contracts.

Component Libraries

• bunsen::blocks - this is a library of burn::module::Module components. This includes simple inner layers, recurrent utility blocks.
• bunsen::kit - this is a library complete modules and simulators.
• bunsen::ops - this is a library burn::tensor::Tensor operations.

App and Testing Support Libs

• bunsen::errors - this is a library of error types and tooling.
• bunsen::support - this is a library of support functions for bunsen, including testing tooling which may be useful for clients.
• bunsen::zspace - this is a library of z-space / index utilities.

Motivation

This library is a synthesis of the utility and extension work that I've been accumulating in:

• https://github.com/zspacelabs/wordchipper
• https://github.com/zspacelabs/bimm
• https://github.com/zspacelabs/bimm-contracts
• https://github.com/zspacelabs/zsl-chat
• https://github.com/crutcher/clockmill

This library is a work in progress, and I'm working to fold the various utilities and support code from these projects into a single place; where we can closely track the burn release cycle, and minimize the dependency-hell churn problem for writing extensions.

I plan on continuing to work on this library, and recruit community involvement for landing and publishing new operators and blocks in a place we can lock down their testings and documentation.

Future Components

The base libraries have significant features which haven't been polished and stabilized for bunsen yet.

• weight/data download disk cache - there are several implementations of this in my codebase so far, the most robust is probably in the wordchipper code.
• shard fetching - being able to bind a family of shards to URL template + range pattern; with information on the target format; and wire that smoothly into the download and cache layer. this is also currently in some of the LLM/chat codebases.
• LLM DataLoader - a high-performance burn data loader for LLM models, built on parquet/arrow; and wordchipper. This is currently in the zsl-chat codebase.
• clap tooling - I've built a lot of burn-related clap tools, and I'm pretty sure some of the arguments/setup machinery could be shared.

Examples

The bunsen repo includes a number of complex demos. The goal of the demos is to showcase the capabilities of the library; while also collecting a working edge of problems which could and should be improved by further development.

License

bunsen is distributed under the terms of both the MIT license and the Apache License (Version 2.0). See LICENSE-APACHE and LICENSE-MIT for details. Opening a pull request is assumed to signal agreement with these licensing terms