Releases

Python-style collection comprehensions in Rust.

macro based http client

For rendering HTML in Rust

A helper crate to read Rosalind test files

OpenAI-compatible HTTP API server for Ferrum inference

Hide internal rules when documenting `macro_rules!` macros.

Steane code for lay

Blueqat backend for lay

Self-referential zero-copy structure

A Rust wrapper for Facebook's RocksDB embeddable database.

The command line shell.

Native bindings to librocksdb

The embedding API: connections, prepared statements, configuration and results.

Model architectures (LLaMA, Qwen, BERT) for Ferrum inference

Model orchestration engine for Ferrum LLM inference

Based on UdpFramed from tokio-util but with some quality of life modifications to support shared ownership of `UdpSocket` and to split Send/Recv into their own types.

Operators, morsels, the scheduler, hash tables, sorting and spilling.

Belajar bilang hello dan goodbye

Weight-format abstraction (Dense / GPTQ / AWQ / GGUF) for Ferrum models

Opentelemetry recorder for metrics crate

Tokenization wrapper for Ferrum inference engine

Testing utilities for Ferrum LLM inference engine

Request scheduling for Ferrum LLM inference engine

Sampling strategies for Ferrum LLM inference engine

KV cache management with PagedAttention for Ferrum inference

Isolated source-build and packaging tools for Ferrum native operators

Unified compute kernels (CUDA/Metal/CPU) and model runner for Ferrum inference

Enhanced storage engines

Factom API client

Shared OpenPGP Certificate Directory