Struct HdfsFs 

pub struct HdfsFs { /* private fields */ }

Hdfs Filesystem

It is basically thread safe because the native API for hdfsFs is thread-safe.

Implementations

impl HdfsFs

pub fn new( connection_properties: ConnectionProperties, ) -> Result<HdfsFs, HdfsErr>

Create an instance of HdfsFs. A global cache is used to ensure that only one instance is created per namenode uri.

• connection_properties - Namenode connection parameters

pub fn new_with_hdfs_params( connection_properties: ConnectionProperties, hdfs_params: HashMap<String, String>, ) -> Result<HdfsFs, HdfsErr>

Create an instance of HdfsFs. A global cache is used to ensure that only one instance is created per namenode uri.

• connection_properties - Namenode connection parameters
• hdfs_params - optional key value pairs that need to be passed to configure the HDFS client side. Example: key = ‘dfs.domain.socket.path’, value = ‘/var/lib/hadoop-fs/dn_socket’

pub fn append(&self, path: &str) -> Result<HdfsFile, HdfsErr>

Open a file for append

pub fn create(&self, path: &str) -> Result<HdfsFile, HdfsErr>

Create the given path as read-only

pub fn create_with_overwrite( &self, path: &str, overwrite: bool, ) -> Result<HdfsFile, HdfsErr>

Create the given path as writable

pub fn create_with_params( &self, path: &str, overwrite: bool, buf_size: i32, replica_num: i16, block_size: i64, ) -> Result<HdfsFile, HdfsErr>

Create the given path

pub fn get_file_status(&self, path: &str) -> Result<FileStatus, HdfsErr>

pub fn delete(&self, path: &str, recursive: bool) -> Result<bool, HdfsErr>

Delete the content at the given path.

• path - the path on the filesystem
• recursive - if true, delete the content recursively.

pub fn exist(&self, path: &str) -> bool

Check if the given path exists on the filesystem

pub fn list_status(&self, path: &str) -> Result<Vec<FileStatus>, HdfsErr>

Get the file status of each entry under the specified path Note that it is an error to list an empty directory.

pub fn mkdir(&self, path: &str) -> Result<bool, HdfsErr>

pub fn open(&self, path: &str) -> Result<HdfsFile, HdfsErr>

pub fn open_with_buf_size( &self, path: &str, buf_size: i32, ) -> Result<HdfsFile, HdfsErr>

pub fn open_for_writing(&self, path: &str) -> Result<HdfsFile, HdfsErr>

pub fn rename(&self, old_path: &str, new_path: &str) -> Result<bool, HdfsErr>

Rename a file

old_path - the path to rename new_path - the new name

Note that the destination directory must exist.

Trait Implementations

impl Clone for HdfsFs

fn clone(&self) -> HdfsFs

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for HdfsFs

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Send for HdfsFs

since HDFS client handles are completely thread safe, here we implement Send + Sync trait for HdfsFs

impl Sync for HdfsFs