Skip to main content

Crate tpt_gpu_primitives

Crate tpt_gpu_primitives 

Source
Expand description

§TPT Primitives (tptp-core)

GPU compute primitives for the TPT GPU platform. Provides high-level Rust wrappers for GEMM, Attention, Conv2D, Conv3D, LayerNorm, BatchNorm, GroupNorm, RMSNorm, Softmax, elementwise activations, Embedding lookup, and 2D Pooling kernels with TPTIR compilation and vendor dispatch.

Re-exports§

pub use error::TptpError;
pub use error::TptpResult;
pub use kernel::KernelBuilder;
pub use kernel::KernelConfig;
pub use kernel::KernelDispatch;
pub use kernel::KernelResult;
pub use kernel::PrimitiveKernel;
pub use kernels::attention::AttentionParams;
pub use kernels::batchnorm::BatchNormParams;
pub use kernels::conv2d::Conv2DParams;
pub use kernels::conv3d::Conv3DParams;
pub use kernels::elementwise::ElementwiseParams;
pub use kernels::embedding::EmbeddingParams;
pub use kernels::gemm::GemmParams;
pub use kernels::groupnorm::GroupNormParams;
pub use kernels::layernorm::LayerNormParams;
pub use kernels::pooling::PoolingParams;
pub use kernels::quant_gemm::DEFAULT_GROUP_SIZE;
pub use kernels::rmsnorm::RmsNormParams;
pub use kernels::softmax::SoftmaxParams;
pub use kernels::ActivationKind;
pub use kernels::AttentionKernel;
pub use kernels::AvgPool2DKernel;
pub use kernels::BatchNormKernel;
pub use kernels::Conv2DKernel;
pub use kernels::Conv3DKernel;
pub use kernels::ElementwiseKernel;
pub use kernels::EmbeddingKernel;
pub use kernels::FusedActivation;
pub use kernels::FusedGemmKernel;
pub use kernels::FusedGemmParams;
pub use kernels::GemmKernel;
pub use kernels::GroupNormKernel;
pub use kernels::LayerNormKernel;
pub use kernels::MaxPool2DKernel;
pub use kernels::QuantGemmKernel;
pub use kernels::RmsNormKernel;
pub use kernels::SoftmaxKernel;
pub use memory::BufferFlags;
pub use memory::DType;
pub use memory::GpuBuffer;
pub use tptir::CompilationOptions;
pub use tptir::CompilationTarget;
pub use tptir::TptirCompiler;
pub use vendor::VendorBackend;
pub use vendor::VendorLibrary;

Modules§

error
Error types for TPT Primitives
ffi
FFI bindings to TPTIR C API
kernel
Kernel trait and dispatch interface
kernels
Kernel Host Wrappers
memory
GPU memory management for primitives
prelude
Re-export commonly used types
tptir
TPTIR Kernel Compilation
vendor
Vendor Library Integration

Macros§

sym
Helper to build a symbol name as a CStr-compatible byte slice.

Constants§

NAME
Crate name
VERSION
Crate version