Crate hdfs_native

Expand description

Native HDFS client implementation in Rust

Usage

Create a client to a single NameNode

use hdfs_native::Client;
let client = Client::new("hdfs://localhost:9000")?;

Create a client for a Name Service

use hdfs_native::Client;
let client = Client::new("hdfs://ns")?;

kerberos - include support for Kerberos authentication. Uses the libgssapi package. Supports all RPC authentication and encryption methods.
token - include support for Token authentication. Uses the gsasl native library. Only supports authentication, not integrity or privacy modes.
object_store - an object_store implementation for HDFS.
rs - support Reed-Solomon codecs for erasure coded reads. It relies on a fork of https://github.com/rust-rse/reed-solomon-erasure with the PR https://github.com/rust-rse/reed-solomon-erasure/pull/108, so you must include a patch for it to compile:

[patch.crates-io]
reed-solomon-erasure = { git = "https://github.com/Kimahriman/reed-solomon-erasure.git", branch = "SNB/23C24_external_matrix" }