Function mako::tokenization::untokenize_wordpiece [−][src]
pub fn untokenize_wordpiece(tokens: Vec<String>) -> String
Expand description
Untokenize wordpiece tokens
pub fn untokenize_wordpiece(tokens: Vec<String>) -> String
Untokenize wordpiece tokens