mesh-native-serving-plugin-api 0.75.0

Stable native serving-plugin ABI for Mesh Skippy lifecycle and proposals
Documentation
  • Coverage
  • 2.22%
    4 out of 180 items documented0 out of 28 items with examples
  • Size
  • Source code size: 14.57 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 1.68 MB This is the summed size of all files generated by rustdoc for all configured targets
  • Ø build duration
  • this release: 7s Average build duration of successful builds.
  • all releases: 7s Average build duration of successful builds in releases after 2024-10-23.
  • Links
  • Homepage
  • Mesh-LLM/mesh-llm
    3305 398 75
  • crates.io
  • Dependencies
    • —
  • Versions
  • Owners
  • i386

Mesh native serving plugin API

This crate defines Mesh's versioned C-compatible ABI for native plugins that observe Skippy generation lifecycle events and supply speculative proposals. Mesh owns model execution, tokenization, verification, and the absolute proposal deadline. Plugins exchange only fixed-layout values, borrowed slices, opaque handles, and host-owned output buffers across the dynamic-library boundary.

Every host-provided event or query starts with struct_size. Plugins must validate that the supplied size covers the last field they read and ignore any trailing fields. This lets a newer host append fields without changing the layout of the prefix understood by an older plugin. Removing or reordering fields, changing a field's type, or changing a callback signature requires a new versioned ABI table and continued support for the previous table.

The V1 activation contract lends the complete native tokenizer inventory through ActivationContext. A plugin copies or transforms the inventory before returning from activate.

Each proposal query carries the capacity Skippy can verify at that exact decode position. The native host adapter also applies a bounded implementation cap so a request cannot force an unbounded host allocation.