Struct ClientBuilder 

pub struct ClientBuilder { /* private fields */ }

Builds a new Client instance. By default, configs will be loaded from the default config directories with the following precedence:

• If the HADOOP_CONF_DIR environment variable is defined, configs will be loaded from ${HADOOP_CONF_DIR}/{core,hdfs}-site.xml
• If the HADOOP_HOME environment variable is defined, configs will be loaded from ${HADOOP_HOME}/etc/hadoop/{core,hdfs}-site.xml
• Otherwise no default configs are defined

If no URL is defined, the fs.defaultFS config must be defined and is used as the URL.

Examples

Create a new client using the fs.defaultFS config

let client = ClientBuilder::new()
    .with_config(vec![("fs.defaultFS", "hdfs://127.0.0.1:9000")])
    .build()
    .unwrap();

Create a new client connecting to a specific URL:

let client = ClientBuilder::new()
    .with_url("hdfs://127.0.0.1:9000")
    .build()
    .unwrap();

Create a new client using a dedicated tokio runtime for spawned tasks and IO operations

let client = ClientBuilder::new()
    .with_url("hdfs://127.0.0.1:9000")
    .with_io_runtime(tokio::runtime::Runtime::new().unwrap())
    .build()
    .unwrap();

Implementations

impl ClientBuilder

pub fn new() -> Self

Create a new ClientBuilder

pub fn with_url(self, url: impl Into<String>) -> Self

Set the URL to connect to. Can be the address of a single NameNode, or a logical NameService

pub fn with_config( self, config: impl IntoIterator<Item = (impl Into<String>, impl Into<String>)>, ) -> Self

Set configs to use for the client. The provided configs will override any found in the default config files loaded

pub fn with_io_runtime(self, runtime: impl Into<IORuntime>) -> Self

Use a dedicated tokio runtime for spawned tasks and IO operations. Can either take ownership of a whole Runtime or take a Handle to an externally owned runtime.

pub fn build(self) -> Result<Client>

Create the Client instance from the provided settings

Trait Implementations

impl Default for ClientBuilder

fn default() -> ClientBuilder

Returns the “default value” for a type.