rdma 0.3.0

Low-level RDMA API
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110

# rdma

[![Latest Version]][crates.io]
[![Documentation]][docs.rs] 
![License]

Low-level RDMA API.

[crates.io]: https://crates.io/crates/rdma
[Latest Version]: https://img.shields.io/crates/v/rdma.svg
[Documentation]: https://docs.rs/rdma/badge.svg
[docs.rs]: https://docs.rs/rdma
[License]: https://img.shields.io/crates/l/rdma.svg

# Environment

This crate requires the latest [rdma-core](https://github.com/linux-rdma/rdma-core) installation.

Please make sure the following commands work:

```bash
$ pkg-config --modversion libibverbs
1.14.41.0
$ pkg-config --modversion librdmacm
1.3.41.0
```

The output also shows the minimum required versions.

# Develop

## Examples

Add a Soft-RoCE device:

```bash
sudo rdma link add rxe0 type rxe netdev ens33
```

`rxe0` is the RDMA device name. You can name it whatever you want. `ens33` is the name of a network device. The name of the network device may be different. You can see it by running command `ifconfig`. 

There is a tutorial for Chinese users: <https://zhuanlan.zhihu.com/p/361740115>.

Please install the tool [just](https://github.com/casey/just) if you don't have it.

Install the examples:

```bash
just install-examples
```

Run the example `rdma-devices`:

```
$ rdma-devices
| name | guid             |
| ---- | ---------------- |
| rxe0 | 26418cfffe021df9 |
```

Run the example `rdma-pingpong`:

+ RC service
    + server side
        ```bash
        rdma-pingpong rc
        ```
    + client side
        ```bash
        rdma-pingpong rc 127.0.0.1
        ```

+ UD service
    + server side
        ```bash
        rdma-pingpong ud
        ```
    + client side
        ```bash
        rdma-pingpong ud 127.0.0.1
        ```

Run the benchmarks:

```bash
just bench-pingpong-rc
just bench-pingpong-ud
```

Run the example `rdma-async`:

```bash
rdma-async-rpc
```

## Memory Management

All the APIs related with raw memory are unsafe.

We are exploring how to provide a safe and easy way to manage memory in RDMA.

The example [rdma-async](examples/rdma-async/src/bin/rdma-async-rpc.rs) may give you inspiration.

## Resource Management

The RDMA resources are managed by reference counting.

The graph below shows the relations between resources.

![docs/ref/ref.svg](docs/ref/ref.svg)