torsh-data-0.1.2
- torsh-data 0.1.2
- Docs.rs crate page
- Apache-2.0
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- cool-japan
- Dependencies
- anyhow ^1.0 normal
  arrow ^58.1 normal optional
  crossbeam ^0.8 normal
  csv ^1.4 normal optional
  futures ^0.3 normal optional
  hdf5 ^0.8 normal optional
  image ^0.25 normal optional
  imageproc ^0.26 normal optional
  indexmap ^2.14 normal
  js-sys ^0.3 normal optional
  memmap2 ^0.9 normal optional
  parking_lot ^0.12 normal
  parquet ^58.1 normal optional
  rayon ^1.12 normal
  scirs2-core ^0.4.2 normal
  scirs2-datasets ^0.4.2 normal
  serde ^1.0 normal optional
  serde_json ^1.0 normal optional
  tempfile ^3.27 normal optional
  thiserror ^2.0 normal
  tokio ^1.52 normal optional
  torsh-core ^0.1.2 normal
  torsh-sparse ^0.1.2 normal optional
  torsh-tensor ^0.1.2 normal
  wasm-bindgen ^0.2 normal optional
  web-sys ^0.3 normal optional
  tempfile ^3.27 dev
  getrandom ^0.4 normal
- Versions
- 80.45% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

tokenize

torsh_data0.1.2

In torsh_data::text_processing

torsh_data::text_processing

Function tokenize

pub fn tokenize(delimiter: &str) -> Tokenize

Expand description

Create a tokenizer with custom delimiter