Skip to main content

Crate ghostlink_core

Crate ghostlink_core 

Source
Expand description

Ghost-Link Core Library

A zero-config LAN fabric that turns spare local GPUs into a shared execution surface for large-model inference and training.

§Features

  • Zero-copy SPSC ring buffers for DMA-style hand-off
  • Binary protocol with CRC32 checksums for frame integrity
  • Thread-safe cluster state with metrics collection
  • Greedy layer assignment with fault tolerance
  • AF_XDP/eBPF socket integration (Linux)
  • Network health monitoring
  • Load balancing and tensor distribution

§Architecture

crates/
├── ghostlink-core/  # Shared runtime primitives
│   ├── ring.rs          # Zero-copy SPSC ring buffer
│   ├── protocol.rs      # Binary protocol with CRC32
│   ├── cluster.rs       # Thread-safe node state
│   ├── planning.rs      # Layer assignment + fault tolerance
│   ├── health.rs        # Network health monitoring
│   ├── load_balance.rs  # Tensor distribution
│   ├── xdp.rs           # AF_XDP/eBPF integration (Linux)
│   └── dashboard.rs     # Terminal UI with ratatui
└── ghost-link/          # CLI demo entrypoint

Re-exports§

pub use cluster::ClusterState;
pub use cluster::NodeMetrics;
pub use cluster::NodeStatus;
pub use planning::assign_layers_sequentially;
pub use planning::select_quantization_mode;
pub use planning::LayerAssignment;
pub use planning::LayerSpec;
pub use planning::PlacementPlan;
pub use planning::QuantizationMode;
pub use protocol::NodeResources;
pub use ring::RingConfig;
pub use ring::SpscRingBuffer;

Modules§

cluster
Thread-Safe Cluster State with Metrics Collection
dashboard
Terminal Dashboard with ratatui Integration for Ghost-Link Cluster
health
Network Health Monitoring for Ghost-Link Cluster
load_balance
Tensor Distribution and Load Balancing for Ghost-Link Cluster
planning
Greedy Layer Assignment with Fault Tolerance and Adaptive Quantization
protocol
Binary Protocol with CRC32 Checksums for Ghost-Link Discovery
ring
Zero-Copy SPSC Ring Buffer with AF_XDP Integration
xdp
AF_XDP/eBPF Socket Integration for Ghost-Link