Crate rrddmma

An RDMA library consisting of safe RDMA wrappings and several useful functionalities to build RDMA connections.

This library respects existing installation of MLNX_OFED or ibverbs. Depending on the environment, it will enable ibv_exp_* or RDMA-Core features correspondingly. You may build the documentation in your own environment to see which features are enabled.

Example

This example sends and receives a message via RDMA RC QPs.

use rrddmma::{ctrl, prelude::*, wrap::RegisteredMem};
use std::{net::Ipv4Addr, thread};

fn make_qp(dev: &str) -> anyhow::Result<Qp> {
    let Nic { context, ports } = Nic::finder().dev_name(dev).probe()?;
    let pd = Pd::new(&context)?;
    let cq = Cq::new(&context, Cq::DEFAULT_CQ_DEPTH)?;
    let mut qp = Qp::builder()
        .qp_type(QpType::Rc)
        .caps(QpCaps::default())
        .send_cq(&cq)
        .recv_cq(&cq)
        .sq_sig_all(true)
        .build(&pd)?;
    qp.bind_local_port(&ports[0], None)?;
    Ok(qp)
}

fn client() -> anyhow::Result<()> {
    let mut qp = make_qp("mlx5_0")?;
    ctrl::Connecter::new(Some(Ipv4Addr::LOCALHOST))?.connect(&mut qp)?;

    // Send the message to the server.
    let mem = RegisteredMem::new_with_content(qp.pd(), "Hello, rrddmma!".as_bytes())?;
    qp.send(&[mem.as_slice()], None, None, 0, true, true)?;
    qp.scq().poll_one_blocking()?;
    Ok(())
}

fn main() -> anyhow::Result<()> {
    let cli = thread::spawn(client);

    let mut qp = make_qp("mlx5_0")?;
    ctrl::Connecter::new(None)?.connect(&mut qp)?;

    // Receive a message from the client.
    let mem = RegisteredMem::new(qp.pd(), 4096)?;
    qp.recv(&[mem.as_slice()], 0)?;
    let wc = qp.rcq().poll_one_blocking()?;
    println!("{}", String::from_utf8_lossy(&mem[..wc.ok()?]));

    cli.join().unwrap()?;
    Ok(())
}

Modules

• bindings
  Bindings of libibverbs C interfaces.
• ctrl
  Connection management utilities.
• errors
  Error types generated by RDMA functionalities.
• prelude
  The RDMA prelude.
• rdma
  RDMA functionalities.
• wrap
  Higher-level wrappings of RDMA resources.