llmkit 0.1.2

Production-grade LLM client - 100+ providers, 11,000+ models. Pure Rust.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106

# Changelog

All notable changes to this project will be documented in this file.

The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [0.1.2] - 2025-01-13

### Added

#### Infrastructure & Developer Experience
- **Pre-commit hooks configuration** - Automated code quality checks for all three languages:
  - Rust: `cargo fmt`, `cargo clippy`, `cargo check`
  - Python: `black`, `ruff`, `mypy` with strict type checking
  - TypeScript/JavaScript: Biome unified formatter and linter
  - General: Trailing whitespace, line endings, YAML/TOML/JSON validation, spell checking
- **Biome configuration** - Unified TypeScript/JavaScript formatting and linting (single quotes, 2-space indent, 100-char line width)
- **Enhanced CONTRIBUTING.md** - Comprehensive guide for setting up pre-commit hooks, troubleshooting, and code quality standards

#### Documentation
- Pre-commit setup instructions for contributors
- Per-language code quality command examples
- Troubleshooting guide for common pre-commit issues
- Updated PR checklist to include code quality verification

### Fixed

#### Test Assertions (46 panic improvements across 30 provider files)
- **Core providers (5 files, 10 panics fixed)**:
  - `ollama.rs`: 2 panics - Text content and tool use assertions
  - `anthropic.rs`: 2 panics - Simple and structured system content validation
  - `openai.rs`: 3 panics - JsonObject and JsonSchema response format validation
  - `groq.rs`: 1 panic - Tool use content validation
  - `ai21.rs`: 2 panics - Text and tool use content blocks

- **Major providers (18 files, 31 panics fixed)**:
  - `cohere.rs`: 2 panics - Text and tool use content blocks
  - `huggingface.rs`: 2 panics - Text and tool use content blocks
  - `mistral.rs`: 2 panics - Tool use and text content
  - `replicate.rs`: 2 panics - Text content assertions
  - Single panic fixes in: `aleph_alpha.rs`, `nlp_cloud.rs`, `yandex.rs`, `clova.rs`, `writer.rs`, `maritaca.rs`, `watsonx.rs`, `cerebras.rs`, `cloudflare.rs`, `sambanova.rs`, `databricks.rs`, `fireworks.rs`, `openrouter.rs`, `azure.rs`

- **Advanced providers (2 files, 5 panics fixed)**:
  - `deepseek.rs`: 5 panics - Text content blocks and thinking content blocks
  - `openai_compatible.rs`: 2 panics - Text and tool use content blocks

- **Special APIs & Utilities (2 files, 5 panics fixed)**:
  - `runpod.rs`: 4 panics - Text content block assertions
  - `baseten.rs`: 4 panics - Text content block assertions
  - `openai_realtime.rs`: 3 panics - SessionCreated, Error, RateLimitUpdated validation
  - `streaming_multiplexer.rs`: 2 panics - Text delta and chunk reception

**Improvement**: All test panics now display actual values received when assertions fail, providing better debugging information instead of generic error messages. Pattern applied consistently: `panic!("Expected X, got {:?}", other)`

### Changed

- Version bumped to 0.1.2 across Rust, Python, and TypeScript packages
- All test assertions now follow consistent panic message patterns for improved debuggability
- Enhanced code quality standards with automated enforcement via pre-commit

### Technical Details

- **Panic pattern standardization**: Converted `if let ... else panic!("message")` to `match` statements with debug output
- **Pre-commit stages**: All checks configured for `pre-commit` stage (runs before commit)
- **Language-specific scoping**: TypeScript checks only run on `llmkit-node/` and `examples/nodejs/`
- **Biome configuration**:
  - Formatter: 2-space indent, 100-char line width, single quotes
  - Linter: Recommended rules enabled with correctness and style emphasis

## [0.1.1] - 2025-01-12

### Added

- Initial stable release with 100+ LLM provider support
- Rust core implementation with trait-based architecture
- Python bindings via Maturin (PyO3)
- TypeScript/Node.js bindings via NAPI-RS
- Support for multiple AI capabilities:
  - Text completion and streaming
  - Tool/function calling
  - Vision/image input
  - Audio synthesis and processing
  - Image generation
  - Video generation
  - Embeddings
  - Specialized APIs (OpenAI Realtime, etc.)
- Comprehensive feature set:
  - Request multiplexing
  - Circuit breaker pattern
  - Failover handling
  - Health checks
  - Metering and observability
  - Rate limiting and retry logic
  - Smart provider routing
  - Multi-tenancy support
- Complete documentation and examples for all three languages

## [0.1.0] - 2025-01-10

### Added

- Initial development release
- Core architecture and provider framework
- Basic functionality for major providers (OpenAI, Anthropic, etc.)
- Foundation for Python and TypeScript bindings