Skip to main content

bpe_encode

Function bpe_encode 

Source
pub fn bpe_encode(
    text: String,
    _merges: Vec<(String, String)>,
) -> PyResult<Vec<i64>>