oxibonsai-kernels 0.1.1

1-bit Q1_0_g128 compute kernels (dequant, GEMV, GEMM) for OxiBonsai
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19

//! # CudaGraph - context_arc_group Methods
//!
//! This module contains method implementations for `CudaGraph`.
//!
//! 🤖 Generated with [SplitRS](https://github.com/cool-japan/splitrs)

use cudarc::driver::CudaContext;
use std::sync::Arc;

use super::cudagraph_type::CudaGraph;

impl CudaGraph {
    /// Return the underlying `CudaContext` (shared reference).
    ///
    /// Used by `cuda_full_layer.rs` to compile the attention PTX module.
    pub fn context_arc(&self) -> &Arc<CudaContext> {
        &self.context
    }
}