Skip to main content

Crate synaptic_splitters

Crate synaptic_splitters 

Source

Re-exports§

pub use language::Language;

Modules§

language

Structs§

CharacterTextSplitter
Splits text by a single separator string.
HeaderType
A markdown header level and its text.
HtmlHeaderTextSplitter
Splits HTML content by header tags (h1, h2, h3, etc.).
MarkdownHeaderTextSplitter
Splits markdown text by headers, adding header hierarchy to metadata.
RecursiveCharacterTextSplitter
Recursively splits text using a hierarchy of separators.
TokenTextSplitter
Splits text by estimated token count using a ~4 chars/token heuristic.

Traits§

TextSplitter
Trait for splitting text into chunks.