Skip to main content

Crate opendal_service_webhdfs

Crate opendal_service_webhdfs 

Source
Expand description

§Apache OpenDAL™ WebHDFS Service

opendal-service-webhdfs provides access to Hadoop Distributed File System through WebHDFS for applications built with Apache OpenDAL™.

§Use through opendal

Applications should normally enable this service through the opendal facade with the services-webhdfs feature:

cargo add opendal --features services-webhdfs

The service is available as opendal::services::Webhdfs. Configure the service builder, then pass it to opendal::Operator::new.

§Use with opendal-core

Add the split crates directly:

cargo add opendal-core opendal-service-webhdfs

Pass a configured service builder to Operator::new:

use opendal_core::{Operator, OperatorRegistry, Result};
use opendal_service_webhdfs::{register_webhdfs_service, Webhdfs};

fn build_operator(builder: Webhdfs) -> Result<Operator> {
    Operator::new(builder)
}

fn register_for_uri() {
    register_webhdfs_service(OperatorRegistry::get());
}

register_for_uri is only needed for scheme-driven construction through Operator::from_uri or Operator::via_iter.

Services that send HTTP requests also require an HTTP transport in OperationContext. See the opendal-core composition example.

§Documentation

§License

Licensed under the Apache License, Version 2.0.

Structs§

Webhdfs
WebHDFS’s REST API support. There two implementations of WebHDFS REST API:
WebhdfsConfig
Config for WebHDFS support.

Constants§

WEBHDFS_SCHEME
URI scheme used for service registration and scheme-driven construction.

Functions§

register_webhdfs_service
Register this service’s URI scheme or schemes with an operator registry.