codesynapse-core-0.1.3
- codesynapse-core 0.1.3
- Docs.rs crate page
- MIT
- 10 July 2026
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- sohilladhani
- Dependencies
- bincode ^1 normal
  chrono ^0.4 normal
  glob ^0.3 normal
  ignore ^0.4 normal
  notify ^6 normal
  petgraph ^0.7 normal
  rand ^0.8 normal
  rayon ^1 normal
  regex ^1 normal
  safetensors ^0.4 normal
  serde ^1 normal
  serde_json ^1 normal
  sha2 ^0.10 normal
  sled ^0.34 normal
  tempfile ^3 normal
  thiserror ^2 normal
  tokenizers ^0.20 normal
  toml ^0.8 normal
  tracing ^0.1 normal
  tree-sitter ^0.25 normal
  tree-sitter-bash ^0.25 normal
  tree-sitter-c ^0.24 normal
  tree-sitter-c-sharp ^0.23 normal
  tree-sitter-cmake ^0.7 normal
  tree-sitter-cpp ^0.23 normal
  tree-sitter-dart ^0.2 normal
  tree-sitter-elixir ^0.3 normal
  tree-sitter-fortran ^0.6 normal
  tree-sitter-go ^0.25 normal
  tree-sitter-groovy ^0.1 normal
  tree-sitter-haskell ^0.23 normal
  tree-sitter-java ^0.23 normal
  tree-sitter-javascript ^0.25 normal
  tree-sitter-julia ^0.23 normal
  tree-sitter-kotlin ^0.3 normal
  tree-sitter-lua ^0.5 normal
  tree-sitter-objc ^3.0 normal
  tree-sitter-pascal ^0.10 normal
  tree-sitter-php ^0.24 normal
  tree-sitter-powershell ^0.26 normal
  tree-sitter-python ^0.25 normal
  tree-sitter-racket ^0.24 normal
  tree-sitter-ruby ^0.23 normal
  tree-sitter-rust ^0.24 normal
  tree-sitter-scala ^0.26 normal
  tree-sitter-sql ^0.0 normal
  tree-sitter-swift ^0.7 normal
  tree-sitter-typescript ^0.23 normal
  tree-sitter-verilog ^1.0 normal
  tree-sitter-zig ^1 normal
  ureq ^2 normal
  uuid ^1 normal
  walkdir ^2 normal
  criterion ^0.5 dev
- Versions
- 2.73% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

tokenize_label

codesynapse_core0.1.3

In codesynapse_core::embedding

codesynapse_core::embedding

Function tokenize_label

pub fn tokenize_label(label: &str) -> Vec<String>