udb 0.3.7

Universal Data Broker — a Rust gRPC broker over multiple databases (Postgres, MySQL, SQLite, MongoDB, ClickHouse, Cassandra, MSSQL, Redis, Qdrant, S3, Neo4j, …) with per-tenant RLS, 2PC, sagas, and CDC.
Documentation

UDB is a public, schema-driven knowledge graph and data broker for applications that need one typed API in front of many data systems.

You describe your domain in normal .proto files, add UDB annotations for storage and security behavior, then run one broker in front of relational databases, object stores, caches, vector stores, document stores, graph stores, analytics systems, and native identity services. Application code calls UDB through gRPC or an SDK; UDB handles routing, metadata, authorization, migrations, CDC, and backend-specific execution.

What UDB Gives You

  • One DataBroker API for relational records, objects, vectors, cache entries, documents, graphs, analytics, catalog operations, migrations, transactions, CDC, and admin health.
  • A native control plane for authentication, authorization, API keys, identity providers, tenants, notifications, analytics, storage, assets, WebRTC, and versioned policy distribution.
  • A descriptor-driven contract: protos define services, tables, field security, endpoint security, SDK surfaces, event contracts, and generated docs.
  • Multi-tenant request context on every call: tenant, project, user, purpose, service identity, scopes, correlation id, and client catalog version.
  • SDKs for Go, Python, TypeScript/Node, Java, C#, and PHP/Laravel.
  • A single CLI named udb for proto export, formatting, SDK generation, native service setup, app integration, local dev, broker serving, and diagnostics.

Current Surface

Area Surface
Data plane 77 DataBroker RPCs
Native control plane 15 services, 188 RPCs
Contract manifest 733 messages, 49 table-backed models, 192 event contracts
Backends 18 backend kinds across SQL, cache, vector, object, document, graph, and column stores
SDKs Go, Python, TypeScript/Node, Java, C#, PHP/Laravel
Release crate/SDK version 0.3.7, wire protocol 1.0.0

The native-service table is generated from the embedded descriptor: docs/generated/native-services.md.

0.3.6 Release Focus

UDB 0.3.6 builds on the 0.3.5 native-store release with a workflow-oriented simple-client SDK layer over the full 265-RPC surface, so normal application code stays short without hiding correctness rules — read-after-write, idempotency, tenant binding, and typed errors stay explicit or broker-owned.

  • Simple-client facade across all SDKs: one connect + loginAndAdoptTenant, then storage.uploadFile / downloadFileBytes, data.table(...).select(...), authz.allowRole(...), metadata.afterWrite(receipt), and replay-safe typed retries with automatic idempotency keys.
  • New first-class StorageService.DownloadFile server-streaming RPC (the 265th RPC), with a presigned-default + streaming-fallback client helper.
  • Go, Python, TypeScript, and PHP each run the full-surface live perf bench green (0 failures / 265 RPCs) against real Postgres/Mongo/MinIO/Kafka/Redis/Qdrant/ Neo4j backends.
  • The 0.3.5 native-store base: notification and analytics flows run through the native entity store path instead of hand-built SQL call sites.
  • Storage, asset, WebRTC, tenant, auth, IdP, and control services share the same native runtime/store binding and generated contract checks.
  • SDKs were regenerated for Go, Python, TypeScript, Java, C#, and PHP, with cross-language conformance plus deep live coverage for the broker-backed SDK harnesses.
  • CI release gates now cover version consistency, native contract drift, SDK service coverage, MinIO-backed live SDK startup, and native-service live integration assumptions.

How It Feels

Your project owns the model:

syntax = "proto3";
package acme.billing.v1;

import "udb/core/common/v1/db.proto";

message Invoice {
  option (udb.core.common.v1.pg_table) = {
    schema: "billing"
    table: "invoices"
  };

  string invoice_id = 1 [(udb.core.common.v1.pg_column) = {
    primary_key: true
    sql_type: "text"
  }];

  string tenant_id = 2;
  string customer_id = 3;
  int64 total_cents = 4;
}

Application code calls the broker through an SDK:

from udb_client import Metadata, UdbClient, decode_records

meta = Metadata(
    tenant_id="acme",
    user_id="user-1",
    purpose="billing.api",
    scopes=("udb:read", "udb:write"),
    service_identity="billing-service",
    project_id="billing",
)

with UdbClient("127.0.0.1:50051", meta) as udb:
    rows = udb.select(message_type="acme.billing.v1.Invoice", limit=50)
    print(decode_records(rows))

Quick Start

Install the CLI from a release binary, through an SDK launcher, or from source:

cargo install --path .

Export UDB's shared protos into an application project:

udb proto export --fmt

Write app-owned protos that import UDB annotations:

import "udb/core/common/v1/db.proto";

Inspect the catalog and generated SQL:

udb catalog proto
udb sql proto
udb lint proto --human

Start a local broker:

udb serve proto "" 0.0.0.0:50051

Check runtime readiness:

udb doctor --human
udb compat-matrix

CLI

All public commands use the short binary name udb.

Command Purpose
udb init Build or preview a project-aware UDB setup plan
udb proto export --fmt Export UDB annotation and broker protos into an app
udb proto fmt --check Check annotation formatting
udb catalog, udb sql, udb plan, udb drift Inspect schemas, SQL, migrations, and drift
udb sdk generate Generate descriptor-aware SDK surfaces from templates
udb native list, udb native manifest, udb native docs Inspect native-service contracts
udb app init Add a language/framework integration scaffold
udb dev up, udb dev smoke Run and test the local playground
udb serve Start the gRPC broker
udb doctor, udb health-check Check runtime and dependency readiness
udb auth ... Use control-plane helpers for principals, sessions, API keys, roles, relations, and policies
udb dbops sync Sync generated database-operation artifacts

Backends

UDB knows these backend kinds:

postgres, mysql, sqlite, sqlserver, clickhouse, redis, memcached, qdrant, weaviate, pinecone, minio, s3, azureblob, gcs, mongodb, elasticsearch, neo4j, and cassandra.

The live capability matrix distinguishes compiled support from configured runtime availability:

udb compat-matrix

Native Control Plane

UDB ships a separate internal control-plane listener for native services. Bind it to an internal interface or place it behind a trusted gateway.

Service family What it covers
Authn Login, sessions, refresh tokens, JWT/JWKS, MFA, OTP, devices, WebAuthn
Authz RBAC, ABAC, ReBAC, decisions, policy bundles, native access, governance
API keys Hashed keys, scopes, rotation, revocation, usage stats
Identity providers OIDC, SAML, SCIM, JIT, external identity links
Control distribution Versioned policy/resource distribution with ACK/NACK
Tenant, notification, analytics Tenant config, messages, templates, metrics, SLA views
Storage and asset Object metadata, presigned URLs, asset pipelines, vector-ready workflows
WebRTC Rooms, peers, tracks, TURN credentials, signaling

Details: docs/native-services.md.

SDKs

Language Install
Go go get github.com/fahara02/udb/sdk/go@v0.3.7
Python pip install udb-client==0.3.7
TypeScript / Node npm i @udb_plus/sdk@0.3.7
PHP / Laravel composer require fahara02/udb-laravel:^0.3.7
C# dotnet add package Udb.Client --version 0.3.7
Java dev.udb:udb-java-client (0.3.7 target; build from checkout until publishing lands)

Start here: sdk/README.md.

Examples

Example Focus
examples/go_arbitary_project Go app with app-owned protos and UDB broker calls
examples/python_arbitary_project Python app flow with generated models and SDK calls
examples/php_arbitary_project PHP/Laravel app flow
examples/php_quickstart CRUD, authz scopes, and relationships
examples/native-services Native auth/authz/API-key/native-access examples
examples/multi_project One broker serving separate project catalogs
examples/toy_backend_plugin Minimal external backend plugin

Documentation

Development

Fast local checks:

cargo test --lib
buf lint
buf build
node scripts/check-versions.mjs

SDK conformance:

node sdk-conformance/run.mjs

The default Rust suite is designed to run without external services. Live backend, HA, and load checks are documented separately and require the matching infrastructure.

License

MIT. See LICENSE.