Crate cpd_tokenizer 

Modules

embedded

formats

functions

Function extraction for similarity scoring (issue #999, stage 2).

generic

javascript

line_index

markdown

razor

sfc

tokenizer

ts_strip