Struct aws_sdk_glue::types::Crawler

#[non_exhaustive]
pub struct Crawler {

    pub name: Option<String>,
    pub role: Option<String>,
    pub targets: Option<CrawlerTargets>,
    pub database_name: Option<String>,
    pub description: Option<String>,
    pub classifiers: Option<Vec<String>>,
    pub recrawl_policy: Option<RecrawlPolicy>,
    pub schema_change_policy: Option<SchemaChangePolicy>,
    pub lineage_configuration: Option<LineageConfiguration>,
    pub state: Option<CrawlerState>,
    pub table_prefix: Option<String>,
    pub schedule: Option<Schedule>,
    pub crawl_elapsed_time: i64,
    pub creation_time: Option<DateTime>,
    pub last_updated: Option<DateTime>,
    pub last_crawl: Option<LastCrawlInfo>,
    pub version: i64,
    pub configuration: Option<String>,
    pub crawler_security_configuration: Option<String>,
    pub lake_formation_configuration: Option<LakeFormationConfiguration>,
}

Specifies a crawler program that examines a data source and uses classifiers to try to determine its schema. If successful, the crawler records metadata concerning the data source in the Glue Data Catalog.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

name: Option<String>

The name of the crawler.

role: Option<String>

The Amazon Resource Name (ARN) of an IAM role that's used to access customer resources, such as Amazon Simple Storage Service (Amazon S3) data.

targets: Option<CrawlerTargets>

A collection of targets to crawl.

database_name: Option<String>

The name of the database in which the crawler's output is stored.

description: Option<String>

A description of the crawler.

classifiers: Option<Vec<String>>

A list of UTF-8 strings that specify the custom classifiers that are associated with the crawler.

recrawl_policy: Option<RecrawlPolicy>

A policy that specifies whether to crawl the entire dataset again, or to crawl only folders that were added since the last crawler run.

schema_change_policy: Option<SchemaChangePolicy>

The policy that specifies update and delete behaviors for the crawler.

lineage_configuration: Option<LineageConfiguration>

A configuration that specifies whether data lineage is enabled for the crawler.

state: Option<CrawlerState>

Indicates whether the crawler is running, or whether a run is pending.

table_prefix: Option<String>

The prefix added to the names of tables that are created.

schedule: Option<Schedule>

For scheduled crawlers, the schedule when the crawler runs.

crawl_elapsed_time: i64

If the crawler is running, contains the total time elapsed since the last crawl began.

creation_time: Option<DateTime>

The time that the crawler was created.

last_updated: Option<DateTime>

The time that the crawler was last updated.

last_crawl: Option<LastCrawlInfo>

The status of the last crawl, and potentially error information if an error occurred.

version: i64

The version of the crawler.

configuration: Option<String>

Crawler configuration information. This versioned JSON string allows users to specify aspects of a crawler's behavior. For more information, see Setting crawler configuration options.

crawler_security_configuration: Option<String>

The name of the SecurityConfiguration structure to be used by this crawler.

lake_formation_configuration: Option<LakeFormationConfiguration>

Specifies whether the crawler should use Lake Formation credentials for the crawler instead of the IAM role credentials.

Implementations

impl Crawler

pub fn name(&self) -> Option<&str>

The name of the crawler.

pub fn role(&self) -> Option<&str>

The Amazon Resource Name (ARN) of an IAM role that's used to access customer resources, such as Amazon Simple Storage Service (Amazon S3) data.

pub fn targets(&self) -> Option<&CrawlerTargets>

A collection of targets to crawl.

pub fn database_name(&self) -> Option<&str>

The name of the database in which the crawler's output is stored.

pub fn description(&self) -> Option<&str>

A description of the crawler.

pub fn classifiers(&self) -> &[String]

A list of UTF-8 strings that specify the custom classifiers that are associated with the crawler.

If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .classifiers.is_none().

pub fn recrawl_policy(&self) -> Option<&RecrawlPolicy>

A policy that specifies whether to crawl the entire dataset again, or to crawl only folders that were added since the last crawler run.

pub fn schema_change_policy(&self) -> Option<&SchemaChangePolicy>

The policy that specifies update and delete behaviors for the crawler.

pub fn lineage_configuration(&self) -> Option<&LineageConfiguration>

A configuration that specifies whether data lineage is enabled for the crawler.

pub fn state(&self) -> Option<&CrawlerState>

Indicates whether the crawler is running, or whether a run is pending.

pub fn table_prefix(&self) -> Option<&str>

The prefix added to the names of tables that are created.

pub fn schedule(&self) -> Option<&Schedule>

For scheduled crawlers, the schedule when the crawler runs.

pub fn crawl_elapsed_time(&self) -> i64

If the crawler is running, contains the total time elapsed since the last crawl began.

pub fn creation_time(&self) -> Option<&DateTime>

The time that the crawler was created.

pub fn last_updated(&self) -> Option<&DateTime>

The time that the crawler was last updated.

pub fn last_crawl(&self) -> Option<&LastCrawlInfo>

The status of the last crawl, and potentially error information if an error occurred.

pub fn version(&self) -> i64

The version of the crawler.

pub fn configuration(&self) -> Option<&str>

Crawler configuration information. This versioned JSON string allows users to specify aspects of a crawler's behavior. For more information, see Setting crawler configuration options.

pub fn crawler_security_configuration(&self) -> Option<&str>

The name of the SecurityConfiguration structure to be used by this crawler.

pub fn lake_formation_configuration( &self ) -> Option<&LakeFormationConfiguration>

Specifies whether the crawler should use Lake Formation credentials for the crawler instead of the IAM role credentials.

impl Crawler

pub fn builder() -> CrawlerBuilder

Creates a new builder-style object to manufacture Crawler.

Trait Implementations

impl Clone for Crawler

fn clone(&self) -> Crawler

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Crawler

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Crawler

fn eq(&self, other: &Crawler) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for Crawler