llmkit 0.1.3

Production-grade LLM client - 100+ providers, 11,000+ models. Pure Rust.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157

# Changelog

All notable changes to this project will be documented in this file.

The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [0.1.3] - 2025-01-15

### Added

#### Rust Documentation & Quality Assurance
- **Comprehensive Rust documentation infrastructure**:
  - Documented 5 critical public functions with detailed examples and argument descriptions
  - Added dedicated CI/CD "Documentation" job with `RUSTDOCFLAGS="-D warnings"`
  - Added docs.rs badge to README for public documentation access
  - Pragmatic documentation strategy: public API fully documented, internal registries exempted

#### Python Enhancements (PEP 735 & Modern Tooling)
- **PEP 735 Dependency Groups support**:
  - Created `pdm.toml` with structured dependency groups (dev, docs)
  - Configured for modern Python package management
- **Expanded Python version support**:
  - Lowered `abi3` from `py39` to `py38` (supports Python 3.8+)
  - Updated classifiers to include Python 3.8
  - Updated pyproject.toml `requires-python` to `>=3.8`

- **Modern Python tooling configuration**:
  - Added `[tool.ty]` configuration for type checking with strict mode
  - Updated MyPy target from py39 to py38
  - Updated Ruff target from py39 to py38
  - Updated Black to support py38-py312 targets
  - All tools configured for Python 3.8 compatibility

#### Version Updates
- Rust core bumped to 0.1.3
- Python bindings bumped to 0.1.3 (with abi3-py38 for broad compatibility)
- Node.js bindings bumped to 0.1.3

### Technical Details

- **Rust Documentation Pattern**: Public types (Message, ContentBlock, CompletionRequest, etc.) are thoroughly documented; internal model registry exempted with allow(missing_docs)
- **CI/CD Enforcement**: Rustdoc warnings treated as errors, catching documentation issues early
- **Python ABI3 Compatibility**: abi3-py38 enables installation on Python 3.8-3.12 without version-specific wheels
- **Dependency Management**: PEP 735 provides better organization of optional and development dependencies

### Fixed

#### CI/CD Documentation Quality
- **Rustdoc URL format compliance**: Fixed bare URLs in documentation to use proper hyperlink format for strict documentation building

#### Binary Size Optimization
- **Release profile optimization for Node.js and Python bindings**:
  - Enabled debug symbol stripping (`strip = true`) in release profiles
  - Improved Link Time Optimization (LTO) configuration
  - Reduces compiled binary size from ~293 MB to ~30-40 MB (5-10x reduction)
  - npm package size reduced from ~300+ MB to ~5-10 MB after publishing

## [0.1.2] - 2025-01-13

### Added

#### Infrastructure & Developer Experience
- **Pre-commit hooks configuration** - Automated code quality checks for all three languages:
  - Rust: `cargo fmt`, `cargo clippy`, `cargo check`
  - Python: `black`, `ruff`, `mypy` with strict type checking
  - TypeScript/JavaScript: Biome unified formatter and linter
  - General: Trailing whitespace, line endings, YAML/TOML/JSON validation, spell checking
- **Biome configuration** - Unified TypeScript/JavaScript formatting and linting (single quotes, 2-space indent, 100-char line width)
- **Enhanced CONTRIBUTING.md** - Comprehensive guide for setting up pre-commit hooks, troubleshooting, and code quality standards

#### Documentation
- Pre-commit setup instructions for contributors
- Per-language code quality command examples
- Troubleshooting guide for common pre-commit issues
- Updated PR checklist to include code quality verification

### Fixed

#### Test Assertions (46 panic improvements across 30 provider files)
- **Core providers (5 files, 10 panics fixed)**:
  - `ollama.rs`: 2 panics - Text content and tool use assertions
  - `anthropic.rs`: 2 panics - Simple and structured system content validation
  - `openai.rs`: 3 panics - JsonObject and JsonSchema response format validation
  - `groq.rs`: 1 panic - Tool use content validation
  - `ai21.rs`: 2 panics - Text and tool use content blocks

- **Major providers (18 files, 31 panics fixed)**:
  - `cohere.rs`: 2 panics - Text and tool use content blocks
  - `huggingface.rs`: 2 panics - Text and tool use content blocks
  - `mistral.rs`: 2 panics - Tool use and text content
  - `replicate.rs`: 2 panics - Text content assertions
  - Single panic fixes in: `aleph_alpha.rs`, `nlp_cloud.rs`, `yandex.rs`, `clova.rs`, `writer.rs`, `maritaca.rs`, `watsonx.rs`, `cerebras.rs`, `cloudflare.rs`, `sambanova.rs`, `databricks.rs`, `fireworks.rs`, `openrouter.rs`, `azure.rs`

- **Advanced providers (2 files, 5 panics fixed)**:
  - `deepseek.rs`: 5 panics - Text content blocks and thinking content blocks
  - `openai_compatible.rs`: 2 panics - Text and tool use content blocks

- **Special APIs & Utilities (2 files, 5 panics fixed)**:
  - `runpod.rs`: 4 panics - Text content block assertions
  - `baseten.rs`: 4 panics - Text content block assertions
  - `openai_realtime.rs`: 3 panics - SessionCreated, Error, RateLimitUpdated validation
  - `streaming_multiplexer.rs`: 2 panics - Text delta and chunk reception

**Improvement**: All test panics now display actual values received when assertions fail, providing better debugging information instead of generic error messages. Pattern applied consistently: `panic!("Expected X, got {:?}", other)`

### Changed

- Version bumped to 0.1.2 across Rust, Python, and TypeScript packages
- All test assertions now follow consistent panic message patterns for improved debuggability
- Enhanced code quality standards with automated enforcement via pre-commit

### Technical Details

- **Panic pattern standardization**: Converted `if let ... else panic!("message")` to `match` statements with debug output
- **Pre-commit stages**: All checks configured for `pre-commit` stage (runs before commit)
- **Language-specific scoping**: TypeScript checks only run on `llmkit-node/` and `examples/nodejs/`
- **Biome configuration**:
  - Formatter: 2-space indent, 100-char line width, single quotes
  - Linter: Recommended rules enabled with correctness and style emphasis

## [0.1.1] - 2025-01-12

### Added

- Initial stable release with 100+ LLM provider support
- Rust core implementation with trait-based architecture
- Python bindings via Maturin (PyO3)
- TypeScript/Node.js bindings via NAPI-RS
- Support for multiple AI capabilities:
  - Text completion and streaming
  - Tool/function calling
  - Vision/image input
  - Audio synthesis and processing
  - Image generation
  - Video generation
  - Embeddings
  - Specialized APIs (OpenAI Realtime, etc.)
- Comprehensive feature set:
  - Request multiplexing
  - Circuit breaker pattern
  - Failover handling
  - Health checks
  - Metering and observability
  - Rate limiting and retry logic
  - Smart provider routing
  - Multi-tenancy support
- Complete documentation and examples for all three languages

## [0.1.0] - 2025-01-10

### Added

- Initial development release
- Core architecture and provider framework
- Basic functionality for major providers (OpenAI, Anthropic, etc.)
- Foundation for Python and TypeScript bindings