Struct aws_sdk_glue::types::HudiTarget

#[non_exhaustive]
pub struct HudiTarget {
    pub paths: Option<Vec<String>>,
    pub connection_name: Option<String>,
    pub exclusions: Option<Vec<String>>,
    pub maximum_traversal_depth: Option<i32>,
}

Specifies an Apache Hudi data source.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

paths: Option<Vec<String>>

An array of Amazon S3 location strings for Hudi, each indicating the root folder with which the metadata files for a Hudi table resides. The Hudi folder may be located in a child folder of the root folder.

The crawler will scan all folders underneath a path for a Hudi folder.

connection_name: Option<String>

The name of the connection to use to connect to the Hudi target. If your Hudi files are stored in buckets that require VPC authorization, you can set their connection properties here.

exclusions: Option<Vec<String>>

A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

maximum_traversal_depth: Option<i32>

The maximum depth of Amazon S3 paths that the crawler can traverse to discover the Hudi metadata folder in your Amazon S3 path. Used to limit the crawler run time.

Implementations

impl HudiTarget

pub fn paths(&self) -> &[String]

An array of Amazon S3 location strings for Hudi, each indicating the root folder with which the metadata files for a Hudi table resides. The Hudi folder may be located in a child folder of the root folder.

The crawler will scan all folders underneath a path for a Hudi folder.

If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .paths.is_none().

pub fn connection_name(&self) -> Option<&str>

The name of the connection to use to connect to the Hudi target. If your Hudi files are stored in buckets that require VPC authorization, you can set their connection properties here.

pub fn exclusions(&self) -> &[String]

A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .exclusions.is_none().

pub fn maximum_traversal_depth(&self) -> Option<i32>

The maximum depth of Amazon S3 paths that the crawler can traverse to discover the Hudi metadata folder in your Amazon S3 path. Used to limit the crawler run time.

impl HudiTarget

pub fn builder() -> HudiTargetBuilder

Creates a new builder-style object to manufacture HudiTarget.

Trait Implementations

impl Clone for HudiTarget

fn clone(&self) -> HudiTarget

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for HudiTarget

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for HudiTarget

fn eq(&self, other: &HudiTarget) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for HudiTarget