scirs2-neural 0.3.3

Neural network building blocks module for SciRS2 (scirs2-neural) - Minimal Version
Documentation 
1
2
3
4
5
6
7
8
9
10

//! NLP utilities for text processing and sequence generation.
//!
//! This module provides:
//! - Tokenizers: BPE, character-level, word-level
//! - Beam search and sampling decoding strategies
//! - Language model evaluation utilities (perplexity, BLEU, NLL)

pub mod beam_search;
pub mod language_model;
pub mod tokenizer;