llm_utils-0.0.11
- llm_utils 0.0.11
- Permalink
- Docs.rs crate page
- MIT
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- ShelbyJenkins
- Dependencies
- anyhow ^1.0.86 normal
  
  html2text ^0.12.6 normal
  
  linkify ^0.10.0 normal
  
  llm_models ^0.0.1 normal
  
  rayon ^1.10.0 normal
  
  readability ^0.3.0 normal
  
  regex ^1.11.0 normal
  
  serde ^1.0.202 normal
  
  serde_json ^1.0.117 normal
  
  thiserror ^1.0.64 normal
  
  unicode-properties ^0.1.3 normal
  
  unicode-segmentation ^1.11.0 normal
  
  url ^2.5.2 normal
  
  text-splitter ^0.14.0 dev
  
  tiktoken-rs ^0.5.9 dev
- Versions
- 4.78% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs
- About docs.rs
- Privacy policy

Rust

llm_utils0.0.11

Module test_text

Module Items

Structs
Statics

In crate llm_utils

Module test_text

Structs§

Chunking
ChunkingTestCase
ChunkingTestCases
Splitting
Text
chunking_small
chunking_tiny
graphemes_unicode
html_short
joining
long
many_subjects
medium
one_subject_many_topics
one_subject_one_topic
really_long
sentences_rule_1
sentences_rule_2
sentences_rule_3
sentences_rule_4
sentences_unicode
single_eol
small
smollest
tiny
two_plus_eol
words_unicode

Statics§

CHUNK_TESTS
SPLIT_TESTS
TEXT