Crate bimm_contracts

Crate bimm_contracts 

Source
Expand description

§bimm-contracts

This is a no_std inline contract programming library for tensor geometry for the burn tensor framework.

Contract programming, or Design by Contract, is a programming paradigm that specifies the rights and obligations of software components.

The goal of this library is to make in-line geometry contracts:

  • Easy to Read, Write, and Use,
  • Performant at Runtime (so they can always be enabled),
  • Verbose and Helpful in their error messages.

§Features

  • burn: Shape support for burn types:
    • &Tensor, &Shape, Shape.

§API

Users will primarily use the macros:

For example:

use bimm_contracts::unpack_shape_contract;

let shape = [12, 3 * 4, 5 * 4, 3];

// In release builds, this has a benchmark of ~160ns:
let [b, h_wins, w_wins, c] = unpack_shape_contract!(
    [
        "batch",
        "height" = "h_wins" * "window_size",
        "width" = "w_wins" * "window_size",
        "channels"
    ],
    &shape,
    &["batch", "h_wins", "w_wins", "channels"],
    &[("window_size", 4)],
);

assert_eq!(b, 12);
assert_eq!(h_wins, 3);
assert_eq!(w_wins, 4);
assert_eq!(c, 3);

In turn, these macros wrap the layer 2 api:

§ShapeArgument Support

The shape methods take a ShapeArgument parameter; with implementations for:

  • &[usize], &[usize; D],
  • &[u32], &[u32; D],
  • &[i32], &[i32; D],
  • &Vec<usize>,
  • &Vec<u32>,
  • &Vec<i32>

With features = ["burn"]:

  • burn::prelude::Shape,
  • &burn::prelude::Shape,
  • &burn::prelude::Tensor

§Speed and Stack Design

Contracts are only useful when they are fast enough to be always enabled.

As a result, this library is designed to be fast at runtime, focusing on static contracts and using stack over heap wherever possible.

Benchmarks on release builds are available under cargo bench -p bimm-contracts:

Running benches/contracts.rs (target/release/deps/contracts-86950340ff3748c1)
unpack_shape            time:   [176.03 ns 177.39 ns 178.81 ns]
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe

assert_shape            time:   [166.57 ns 168.00 ns 169.60 ns]
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe

assert_shape_every_nth/assert_shape_every_nth
time:   [4.4057 ns 4.4769 ns 4.5726 ns]
Found 14 outliers among 100 measurements (14.00%)
6 (6.00%) high mild
8 (8.00%) high severe

§shape_contract! macro

The shape_contract! macro is a compile-time macro that parses a shape contract from a shape contract pattern:

use bimm_contracts::{ShapeContract, shape_contract};
static CONTRACT: ShapeContract = shape_contract![_, "w" = "x" + "y", ..., "z" ^ 2];

A shape pattern is made of one or more dimension matcher terms:

  • _: for any shape; ignores the size, but requires the dimension to exist.,
  • ...: for ellipsis; matches any number of dimensions, only one ellipsis is allowed,
  • a dim expression.
ShapeContract => <LabeledExpr> { ',' <LabeledExpr> }* ','?
LabeledExpr => {Param "="}? <Expr>
Expr => <Term> { <AddOp> <Term> }
Term => <Power> { <MulOp> <Power> }
Power => <Factor> [ ^ <usize> ]
Factor => <Param> | ( '(' <Expression> ')' ) | NegOp <Factor>
Param => '"' <identifier> '"'
identifier => { <alpha> | "_" } { <alphanumeric> | "_" }*
NegOp =>      '+' | '-'
AddOp =>      '+' | '-'
MulOp =>      '*'

§Usage Example

use burn::prelude::{Tensor, Backend};
use burn::tensor::BasicOps;
use bimm_contracts::{unpack_shape_contract, assert_shape_contract_periodically};

/// Window Partition
///
/// ## Parameters
///
/// - `tensor`: Input tensor of shape (B, h_wins * window_size, w_wins * window_size, C).
/// - `window_size`: Window size.
///
/// ## Returns
///
/// Output tensor of shape (B * h_windows * w_windows, window_size, window_size, C).
///
/// ## Panics
///
/// Panics if the input tensor does not have 4 dimensions.
pub fn window_partition<B: Backend, K>(
    tensor: Tensor<B, 4, K>,
    window_size: usize,
) -> Tensor<B, 4, K>
where
    K: BasicOps<B>,
{
    // In release builds, this has a benchmark of ~160ns:
    let [b, h_wins, w_wins, c] = unpack_shape_contract!(
        [
            "batch",
            "height" = "h_wins" * "window_size",
            "width" = "w_wins" * "window_size",
            "channels"
        ],
        &tensor,
        &["batch", "h_wins", "w_wins", "channels"],
        &[("window_size", window_size)],
    );

    let tensor = tensor
        .reshape([b, h_wins, window_size, w_wins, window_size, c])
        .swap_dims(2, 3)
        .reshape([b * h_wins * w_wins, window_size, window_size, c]);

    // Run an amortized check on the output shape.
    //
    // `run_periodically!{}` runs the first 10 times,
    // then on an incrementally lengthening schedule,
    // until it reaches its default period of 1000.
    //
    // Due to amortization, in release builds, this averages ~4ns:
    assert_shape_contract_periodically!(
        [
            "batch" * "h_wins" * "w_wins",
            "window_size",
            "window_size",
            "channels"
        ],
        &tensor,
        &[
            ("batch", b),
            ("h_wins", h_wins),
            ("w_wins", w_wins),
            ("window_size", window_size),
            ("channels", c),
        ]
    );

    tensor
}

§Error Messages

Error messages are verbose and helpful.

use bimm_contracts::{ShapeContract, shape_contract};
use indoc::indoc;

fn example() {
    static CONTRACT: ShapeContract = shape_contract![
            ...,
            "height" = "h_wins" * "window",
            "width" = "w_wins" * "window",
            "color",
        ];

    let h_wins = 2;
    let w_wins = 3;
    let window = 4;
    let color = 3;

    let shape = [1, 2, 3, h_wins * window, w_wins * window, color];

    let [h, w] = CONTRACT.unpack_shape(&shape, &["h_wins", "w_wins"], &[
        ("window", window),
        ("color", color),
    ]);
    assert_eq!(h, h_wins);
    assert_eq!(w, w_wins);

    assert_eq!(
        CONTRACT.try_unpack_shape(&shape, &["h_wins", "w_wins"], &[
            ("window", window + 1),
            ("color", color),
        ]).unwrap_err(),
        indoc! {r#"
            Shape Error:: 8 !~ height=(h_wins*window) :: No integer solution.
             shape:
              [1, 2, 3, 8, 12, 3]
             expected:
              [..., height=(h_wins*window), width=(w_wins*window), color]
              {"window": 5, "color": 3}"#
        },
    );
}

Re-exports§

pub use bindings::StackEnvironment;
pub use contracts::DimMatcher;
pub use contracts::ShapeContract;
pub use expressions::DimExpr;
pub use shape_argument::ShapeArgument;

Modules§

bindings
Evaluation Key/Value bindings.
contracts
Shape Contracts.
expressions
Dimension Expressions.
macros
Support macros.
math
Mathematical utilities.
shape_argument
Utility crate for ShapeArgument for passing shapes in a type-safe manner.
support
Framework Support.

Macros§

assert_shape_contract
A macro which calls crate::ShapeContract::assert_shape on a static shape contract.
assert_shape_contract_periodically
A macro which periodically calls crate::assert_shape_contract.
define_shape_contract
A macro which defines a static crate::ShapeContract.
run_periodically
A macro to run a block of code or an expression every nth time it is called.
shape_contract
Parse a shape contract at compile time and return the ShapePattern struct.
unpack_shape_contract
A macro which calls crate::ShapeContract::unpack_shape on a static shape contract.