libafl::inputs::encoded

Trait Tokenizer

Source 
pub trait Tokenizer {
    // Required method
    fn tokenize(&self, bytes: &[u8]) -> Result<Vec<String>, Error>;
}
Expand description

Tokenizer is a trait that can tokenize bytes into a Vec of tokens

Required Methods§

Source

fn tokenize(&self, bytes: &[u8]) -> Result<Vec<String>, Error>

Tokenize the given bytes

Implementors§