api_huggingface 0.4.1

HuggingFace's API for accessing large language models (LLMs) and embeddings.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12

# token_counter

### Purpose

Token count estimation with multiple counting strategies.

### Responsibility

| File | Purpose |
|------|---------|
| `mod.rs` | Module root — re-exports `TokenCounter` type and counting strategies |
| `counter.rs` | Token estimation implementations — character-based, word-based, and model-specific strategies |