api_huggingface 0.4.1

HuggingFace's API for accessing large language models (LLMs) and embeddings.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33

//! Token Counting Implementation
//!
//! Provides token counting and estimation for API requests.
//!
//! ## Features
//!
//! - **Multiple Strategies**: Estimation, character-based, word-based
//! - **Message Counting**: Count tokens in chat messages
//! - **Request Estimation**: Estimate costs before making API calls
//! - **Model-Aware**: Different counting for different models
//!
//! ## Usage
//!
//! ```no_run
//! # use api_huggingface::token_counter::{TokenCounter, CountingStrategy};
//! # fn example() -> Result< (), Box< dyn std::error::Error > > {
//! let counter = TokenCounter::new(CountingStrategy::Estimation);
//!
//! let text = "Hello, how are you today?";
//! let count = counter.count_tokens(text);
//! println!("Estimated tokens : {}", count.total);
//! # Ok(())
//! # }
//! ```

pub mod counter;

pub use counter::{
  TokenCounter,
  CountingStrategy,
  TokenCount,
  TokenCountError,
};