Module kn_graph::cpu

source ·
Expand description

CPU graph execution.

Structs

Functions

  • Evaluate the given graph on the CPU, with the given batch size and inputs, returning the outputs.
  • Evaluate the given graph on the CPU, with the given batch size and inputs, returning the full execution state including profiling information.
  • Layernorm along the given axis of the tensor.
  • Softmax along the given axis of the tensor. Implementation (and more importantly, the generic bounds) based on softmax within the onnxruntime crate

Type Aliases

  • The core tensor type of this crate.