omp-llm 0.1.0

Unified facade for omp LLM providers, transports, runtimes, and services
docs.rs failed to build omp-llm-0.1.0
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.

omp-llm

omp-llm is the unified facade for omp's language-model integration crates. It gives callers one import surface for provider codecs, shared types, transport and egress infrastructure, gateway services, credential handling, middleware, and local runtimes.

Structure

The crate re-exports its constituent crates as named modules:

  • anthropic, google, openai, cursor, and devin expose provider-specific transport codecs and bridges.
  • types, error, transport, and egress provide provider-independent values, error policy, wire transport, streaming, and HTTP egress.
  • broker, catalog, gateway, and tower cover credentials, provider and model catalogs, service facades, and provider-attempt middleware.
  • local and fm expose local inference runtimes and Apple Foundation Models support.

Philosophy

This is a deliberately thin facade: implementations remain in focused crates, while this crate re-exports them under stable, discoverable module names. Provider-specific wire behavior stays separate from canonical types and shared transport policy, so consumers can use the unified surface without collapsing those boundaries.