Crate tract_core 

Tract

Tiny, no-nonsense, self contained, portable TensorFlow and ONNX inference.

Example

use tract_core::internal::*;

// build a simple model that just add 3 to each input component
let mut model = TypedModel::default();

let input_fact = f32::fact(&[3]);
let input = model.add_source("input", input_fact).unwrap();
let three = model.add_const("three".to_string(), tensor1(&[3f32])).unwrap();
let add = model.wire_node("add".to_string(),
    tract_core::ops::math::add(),
    [input, three].as_ref()
    ).unwrap();

model.auto_outputs().unwrap();

// We build an execution plan. Default inputs and outputs are inferred from
// the model graph.
let plan = model.into_runnable().unwrap();

// run the computation.
let input = tensor1(&[1.0f32, 2.5, 5.0]);
let mut outputs = plan.run(tvec![input.into()]).unwrap();

// take the first and only output tensor
let mut tensor = outputs.pop().unwrap();

assert_eq!(tensor, tensor1(&[4.0f32, 5.5, 8.0]).into());

While creating a model from Rust code is useful for testing the library, real-life use-cases will usually load a TensorFlow or ONNX model using tract-tensorflow or tract-onnx crates.

Re-exports

pub extern crate downcast_rs;

pub extern crate ndarray;

pub extern crate num_traits;

pub extern crate tract_data;

pub extern crate tract_linalg;

Re-exports

pub use dyn_clone;

Modules

axes

broadcast

N-way tensor broadcast

floats

framework

Enforce consistent API between the implemented Frameworks importers.

internal

This prelude is meant for code extending tract (like implementing new ops).

knobs

Runtime configuration knobs.

macros

model

Models and their lifecycle

ops

Ops

optim

plan

prelude

This prelude is meant for code using tract.

runtime

transform

value

Macros

args_1

args_2

args_3

args_4

args_5

args_6

args_7

args_8

as_op

assert_close

bin_to_super_type

declare_knob

Declare a knob: a typed runtime setting resolved from override / environment / default, registered for listing.

dims

element_wise

element_wise_oop

not_a_typed_op

op_as_typed_op

register_model_transform

register_runtime

register_simple_model_transform

rule_if

rule_if_let

rule_if_some

trivial_op_state_freeze