Struct BurnChunker 

pub struct BurnChunker<B: Backend> { /* private fields */ }

Implementations

impl<B: Backend> BurnChunker<B>

pub fn save_to(&self, dir: impl AsRef<Path>)

pub fn load_from_bytes( model_bytes: impl AsRef<[u8]>, vocab_bytes: impl AsRef<[u8]>, embed_dim: usize, dropout: f32, device: B::Device, ) -> Self

impl BurnChunker<NdArray>

pub fn load_from_bytes_cpu( model_bytes: impl AsRef<[u8]>, vocab_bytes: impl AsRef<[u8]>, embed_dim: usize, dropout: f32, ) -> Self

Trait Implementations

impl<B: Backend> Chunker for BurnChunker<B>

fn chunk_sentence( &self, sentence: &[String], tags: &[Option<UPOS>], ) -> Vec<bool>

Iterate over the sentence, identifying the noun phrases contained within. A token marked true is a component of a noun phrase. A token marked false is not.