Module layers

This module implments various layers for a neural network

Modules

attention

Attention

Structs

LayerBase

Linear

ReLU

Sigmoid

Tanh

Traits

Activate

The Activate trait defines a method for applying an activation function to an input tensor.

ActivateGradient

The ActivateGradient trait extends the Activate trait to include a method for computing the gradient of the activation function.

Layer

A layer within a neural-network containing a set of parameters and an activation function. Here, this manifests as a wrapper around the parameters of the layer with a generic activation function and corresponding traits to denote desired behaviors.