sochdb-vector-2.0.7
- sochdb-vector 2.0.7
- Permalink
- Docs.rs crate page
- AGPL-3.0-or-later
- Links
- crates.io
- Source
- Owners
- sushanthpy
- Dependencies
- ahash ^0.8 normal
  anyhow ^1.0 normal
  bincode ^1.3 normal
  bytemuck ^1.14 normal
  crc32fast ^1.3 normal
  crossbeam ^0.8 normal
  dashmap ^5.5 normal
  half ^2.3 normal
  memmap2 ^0.9 normal
  ordered-float ^4.2 normal
  parking_lot ^0.12 normal
  rand ^0.8 normal
  rand_xoshiro ^0.6 normal
  serde ^1.0 normal
  serde_json ^1.0 normal
  sochdb-core ^2.0.7 normal
  sochdb-index ^2.0.7 normal
  sochdb-storage ^2.0.7 normal
  tempfile ^3.9 normal
  thiserror ^1.0 normal
  tracing ^0.1 normal
  criterion ^0.5 dev
  proptest ^1.4 dev
  libc ^0.2 normal
- Versions
- 84.05% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

tokenize_minimal

sochdb_vector2.0.7

In sochdb_vector::bm25

sochdb_vector::bm25

Function tokenize_minimal

pub fn tokenize_minimal(text: &str) -> Vec<String>

Expand description

Tokenize with minimal normalization