Struct aws_sdk_glue::client::Client

source ·
pub struct Client { /* private fields */ }
Expand description

Client for AWS Glue

Client for invoking operations on AWS Glue. Each operation on AWS Glue is a method on this this struct. .send() MUST be invoked on the generated operations to dispatch the request to the service.

§Constructing a Client

A Config is required to construct a client. For most use cases, the aws-config crate should be used to automatically resolve this config using aws_config::load_from_env(), since this will resolve an SdkConfig which can be shared across multiple different AWS SDK clients. This config resolution process can be customized by calling aws_config::from_env() instead, which returns a ConfigLoader that uses the builder pattern to customize the default config.

In the simplest case, creating a client looks as follows:

let config = aws_config::load_from_env().await;
let client = aws_sdk_glue::Client::new(&config);

Occasionally, SDKs may have additional service-specific values that can be set on the Config that is absent from SdkConfig, or slightly different settings for a specific client may be desired. The Config struct implements From<&SdkConfig>, so setting these specific settings can be done as follows:

let sdk_config = ::aws_config::load_from_env().await;
let config = aws_sdk_glue::config::Builder::from(&sdk_config)
    .some_service_specific_setting("value")
    .build();

See the aws-config docs and Config for more information on customizing configuration.

Note: Client construction is expensive due to connection thread pool initialization, and should be done once at application start-up.

§Using the Client

A client has a function for every operation that can be performed by the service. For example, the BatchCreatePartition operation has a Client::batch_create_partition, function which returns a builder for that operation. The fluent builder ultimately has a send() function that returns an async future that returns a result, as illustrated below:

let result = client.batch_create_partition()
    .catalog_id("example")
    .send()
    .await;

The underlying HTTP requests that get made by this can be modified with the customize_operation function on the fluent builder. See the customize module for more information.

Implementations§

source§

impl Client

source

pub fn batch_create_partition(&self) -> BatchCreatePartitionFluentBuilder

Constructs a fluent builder for the BatchCreatePartition operation.

source§

impl Client

source

pub fn batch_delete_connection(&self) -> BatchDeleteConnectionFluentBuilder

Constructs a fluent builder for the BatchDeleteConnection operation.

source§

impl Client

source

pub fn batch_delete_partition(&self) -> BatchDeletePartitionFluentBuilder

Constructs a fluent builder for the BatchDeletePartition operation.

source§

impl Client

source

pub fn batch_delete_table(&self) -> BatchDeleteTableFluentBuilder

Constructs a fluent builder for the BatchDeleteTable operation.

source§

impl Client

source

pub fn batch_delete_table_version(&self) -> BatchDeleteTableVersionFluentBuilder

Constructs a fluent builder for the BatchDeleteTableVersion operation.

source§

impl Client

source

pub fn batch_get_blueprints(&self) -> BatchGetBlueprintsFluentBuilder

Constructs a fluent builder for the BatchGetBlueprints operation.

source§

impl Client

source

pub fn batch_get_crawlers(&self) -> BatchGetCrawlersFluentBuilder

Constructs a fluent builder for the BatchGetCrawlers operation.

source§

impl Client

source

pub fn batch_get_custom_entity_types( &self ) -> BatchGetCustomEntityTypesFluentBuilder

Constructs a fluent builder for the BatchGetCustomEntityTypes operation.

source§

impl Client

source

pub fn batch_get_data_quality_result( &self ) -> BatchGetDataQualityResultFluentBuilder

Constructs a fluent builder for the BatchGetDataQualityResult operation.

source§

impl Client

source

pub fn batch_get_dev_endpoints(&self) -> BatchGetDevEndpointsFluentBuilder

Constructs a fluent builder for the BatchGetDevEndpoints operation.

source§

impl Client

source

pub fn batch_get_jobs(&self) -> BatchGetJobsFluentBuilder

Constructs a fluent builder for the BatchGetJobs operation.

source§

impl Client

source

pub fn batch_get_partition(&self) -> BatchGetPartitionFluentBuilder

Constructs a fluent builder for the BatchGetPartition operation.

source§

impl Client

source

pub fn batch_get_table_optimizer(&self) -> BatchGetTableOptimizerFluentBuilder

Constructs a fluent builder for the BatchGetTableOptimizer operation.

source§

impl Client

source

pub fn batch_get_triggers(&self) -> BatchGetTriggersFluentBuilder

Constructs a fluent builder for the BatchGetTriggers operation.

source§

impl Client

source

pub fn batch_get_workflows(&self) -> BatchGetWorkflowsFluentBuilder

Constructs a fluent builder for the BatchGetWorkflows operation.

source§

impl Client

source

pub fn batch_stop_job_run(&self) -> BatchStopJobRunFluentBuilder

Constructs a fluent builder for the BatchStopJobRun operation.

source§

impl Client

source

pub fn batch_update_partition(&self) -> BatchUpdatePartitionFluentBuilder

Constructs a fluent builder for the BatchUpdatePartition operation.

source§

impl Client

source

pub fn cancel_data_quality_rule_recommendation_run( &self ) -> CancelDataQualityRuleRecommendationRunFluentBuilder

Constructs a fluent builder for the CancelDataQualityRuleRecommendationRun operation.

source§

impl Client

source

pub fn cancel_data_quality_ruleset_evaluation_run( &self ) -> CancelDataQualityRulesetEvaluationRunFluentBuilder

Constructs a fluent builder for the CancelDataQualityRulesetEvaluationRun operation.

source§

impl Client

source

pub fn cancel_ml_task_run(&self) -> CancelMLTaskRunFluentBuilder

Constructs a fluent builder for the CancelMLTaskRun operation.

source§

impl Client

source

pub fn cancel_statement(&self) -> CancelStatementFluentBuilder

Constructs a fluent builder for the CancelStatement operation.

source§

impl Client

source

pub fn check_schema_version_validity( &self ) -> CheckSchemaVersionValidityFluentBuilder

Constructs a fluent builder for the CheckSchemaVersionValidity operation.

source§

impl Client

source

pub fn create_blueprint(&self) -> CreateBlueprintFluentBuilder

Constructs a fluent builder for the CreateBlueprint operation.

source§

impl Client

source

pub fn create_classifier(&self) -> CreateClassifierFluentBuilder

Constructs a fluent builder for the CreateClassifier operation.

source§

impl Client

source

pub fn create_connection(&self) -> CreateConnectionFluentBuilder

Constructs a fluent builder for the CreateConnection operation.

source§

impl Client

source

pub fn create_crawler(&self) -> CreateCrawlerFluentBuilder

Constructs a fluent builder for the CreateCrawler operation.

source§

impl Client

source

pub fn create_custom_entity_type(&self) -> CreateCustomEntityTypeFluentBuilder

Constructs a fluent builder for the CreateCustomEntityType operation.

source§

impl Client

source

pub fn create_data_quality_ruleset( &self ) -> CreateDataQualityRulesetFluentBuilder

Constructs a fluent builder for the CreateDataQualityRuleset operation.

source§

impl Client

source

pub fn create_database(&self) -> CreateDatabaseFluentBuilder

Constructs a fluent builder for the CreateDatabase operation.

source§

impl Client

source

pub fn create_dev_endpoint(&self) -> CreateDevEndpointFluentBuilder

Constructs a fluent builder for the CreateDevEndpoint operation.

source§

impl Client

source

pub fn create_job(&self) -> CreateJobFluentBuilder

Constructs a fluent builder for the CreateJob operation.

  • The fluent builder is configurable:
    • name(impl Into<String>) / set_name(Option<String>):
      required: true

      The name you assign to this job definition. It must be unique in your account.


    • description(impl Into<String>) / set_description(Option<String>):
      required: false

      Description of the job being defined.


    • log_uri(impl Into<String>) / set_log_uri(Option<String>):
      required: false

      This field is reserved for future use.


    • role(impl Into<String>) / set_role(Option<String>):
      required: true

      The name or Amazon Resource Name (ARN) of the IAM role associated with this job.


    • execution_property(ExecutionProperty) / set_execution_property(Option<ExecutionProperty>):
      required: false

      An ExecutionProperty specifying the maximum number of concurrent runs allowed for this job.


    • command(JobCommand) / set_command(Option<JobCommand>):
      required: true

      The JobCommand that runs this job.


    • default_arguments(impl Into<String>, impl Into<String>) / set_default_arguments(Option<HashMap::<String, String>>):
      required: false

      The default arguments for every run of this job, specified as name-value pairs.

      You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

      Job arguments may be logged. Do not pass plaintext secrets as arguments. Retrieve secrets from a Glue Connection, Secrets Manager or other secret management mechanism if you intend to keep them within the Job.

      For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

      For information about the arguments you can provide to this field when configuring Spark jobs, see the Special Parameters Used by Glue topic in the developer guide.

      For information about the arguments you can provide to this field when configuring Ray jobs, see Using job parameters in Ray jobs in the developer guide.


    • non_overridable_arguments(impl Into<String>, impl Into<String>) / set_non_overridable_arguments(Option<HashMap::<String, String>>):
      required: false

      Arguments for this job that are not overridden when providing job arguments in a job run, specified as name-value pairs.


    • connections(ConnectionsList) / set_connections(Option<ConnectionsList>):
      required: false

      The connections used for this job.


    • max_retries(i32) / set_max_retries(Option<i32>):
      required: false

      The maximum number of times to retry this job if it fails.


    • allocated_capacity(i32) / set_allocated_capacity(Option<i32>):
      required: false

      This parameter is deprecated. Use MaxCapacity instead.

      The number of Glue data processing units (DPUs) to allocate to this Job. You can allocate a minimum of 2 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.


    • timeout(i32) / set_timeout(Option<i32>):
      required: false

      The job timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).


    • max_capacity(f64) / set_max_capacity(Option<f64>):
      required: false

      For Glue version 1.0 or earlier jobs, using the standard worker type, the number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

      For Glue version 2.0+ jobs, you cannot specify a Maximum capacity. Instead, you should specify a Worker type and the Number of workers.

      Do not set MaxCapacity if using WorkerType and NumberOfWorkers.

      The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job, an Apache Spark ETL job, or an Apache Spark streaming ETL job:

      • When you specify a Python shell job (JobCommand.Name=“pythonshell”), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.

      • When you specify an Apache Spark ETL job (JobCommand.Name=“glueetl”) or Apache Spark streaming ETL job (JobCommand.Name=“gluestreaming”), you can allocate from 2 to 100 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.


    • security_configuration(impl Into<String>) / set_security_configuration(Option<String>):
      required: false

      The name of the SecurityConfiguration structure to be used with this job.


    • tags(impl Into<String>, impl Into<String>) / set_tags(Option<HashMap::<String, String>>):
      required: false

      The tags to use with this job. You may use tags to limit access to the job. For more information about tags in Glue, see Amazon Web Services Tags in Glue in the developer guide.


    • notification_property(NotificationProperty) / set_notification_property(Option<NotificationProperty>):
      required: false

      Specifies configuration properties of a job notification.


    • glue_version(impl Into<String>) / set_glue_version(Option<String>):
      required: false

      In Spark jobs, GlueVersion determines the versions of Apache Spark and Python that Glue available in a job. The Python version indicates the version supported for jobs of type Spark.

      Ray jobs should set GlueVersion to 4.0 or greater. However, the versions of Ray, Python and additional libraries available in your Ray job are determined by the Runtime parameter of the Job command.

      For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

      Jobs that are created without specifying a Glue version default to Glue 0.9.


    • number_of_workers(i32) / set_number_of_workers(Option<i32>):
      required: false

      The number of workers of a defined workerType that are allocated when a job runs.


    • worker_type(WorkerType) / set_worker_type(Option<WorkerType>):
      required: false

      The type of predefined worker that is allocated when a job runs. Accepts a value of G.1X, G.2X, G.4X, G.8X or G.025X for Spark jobs. Accepts the value Z.2X for Ray jobs.

      • For the G.1X worker type, each worker maps to 1 DPU (4 vCPUs, 16 GB of memory) with 84GB disk (approximately 34GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs.

      • For the G.2X worker type, each worker maps to 2 DPU (8 vCPUs, 32 GB of memory) with 128GB disk (approximately 77GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs.

      • For the G.4X worker type, each worker maps to 4 DPU (16 vCPUs, 64 GB of memory) with 256GB disk (approximately 235GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs in the following Amazon Web Services Regions: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm).

      • For the G.8X worker type, each worker maps to 8 DPU (32 vCPUs, 128 GB of memory) with 512GB disk (approximately 487GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs, in the same Amazon Web Services Regions as supported for the G.4X worker type.

      • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPUs, 4 GB of memory) with 84GB disk (approximately 34GB free), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

      • For the Z.2X worker type, each worker maps to 2 M-DPU (8vCPUs, 64 GB of memory) with 128 GB disk (approximately 120GB free), and provides up to 8 Ray workers based on the autoscaler.


    • code_gen_configuration_nodes(impl Into<String>, CodeGenConfigurationNode) / set_code_gen_configuration_nodes(Option<HashMap::<String, CodeGenConfigurationNode>>):
      required: false

      The representation of a directed acyclic graph on which both the Glue Studio visual component and Glue Studio code generation is based.


    • execution_class(ExecutionClass) / set_execution_class(Option<ExecutionClass>):
      required: false

      Indicates whether the job is run with a standard or flexible execution class. The standard execution-class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

      The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

      Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.


    • source_control_details(SourceControlDetails) / set_source_control_details(Option<SourceControlDetails>):
      required: false

      The details for a source control configuration for a job, allowing synchronization of job artifacts to or from a remote repository.


  • On success, responds with CreateJobOutput with field(s):
  • On failure, responds with SdkError<CreateJobError>
source§

impl Client

source

pub fn create_ml_transform(&self) -> CreateMLTransformFluentBuilder

Constructs a fluent builder for the CreateMLTransform operation.

  • The fluent builder is configurable:
    • name(impl Into<String>) / set_name(Option<String>):
      required: true

      The unique name that you give the transform when you create it.


    • description(impl Into<String>) / set_description(Option<String>):
      required: false

      A description of the machine learning transform that is being defined. The default is an empty string.


    • input_record_tables(GlueTable) / set_input_record_tables(Option<Vec::<GlueTable>>):
      required: true

      A list of Glue table definitions used by the transform.


    • parameters(TransformParameters) / set_parameters(Option<TransformParameters>):
      required: true

      The algorithmic parameters that are specific to the transform type used. Conditionally dependent on the transform type.


    • role(impl Into<String>) / set_role(Option<String>):
      required: true

      The name or Amazon Resource Name (ARN) of the IAM role with the required permissions. The required permissions include both Glue service role permissions to Glue resources, and Amazon S3 permissions required by the transform.

      • This role needs Glue service role permissions to allow access to resources in Glue. See Attach a Policy to IAM Users That Access Glue.

      • This role needs permission to your Amazon Simple Storage Service (Amazon S3) sources, targets, temporary directory, scripts, and any libraries used by the task run for this transform.


    • glue_version(impl Into<String>) / set_glue_version(Option<String>):
      required: false

      This value determines which version of Glue this machine learning transform is compatible with. Glue 1.0 is recommended for most customers. If the value is not set, the Glue compatibility defaults to Glue 0.9. For more information, see Glue Versions in the developer guide.


    • max_capacity(f64) / set_max_capacity(Option<f64>):
      required: false

      The number of Glue data processing units (DPUs) that are allocated to task runs for this transform. You can allocate from 2 to 100 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

      MaxCapacity is a mutually exclusive option with NumberOfWorkers and WorkerType.

      • If either NumberOfWorkers or WorkerType is set, then MaxCapacity cannot be set.

      • If MaxCapacity is set then neither NumberOfWorkers or WorkerType can be set.

      • If WorkerType is set, then NumberOfWorkers is required (and vice versa).

      • MaxCapacity and NumberOfWorkers must both be at least 1.

      When the WorkerType field is set to a value other than Standard, the MaxCapacity field is set automatically and becomes read-only.

      When the WorkerType field is set to a value other than Standard, the MaxCapacity field is set automatically and becomes read-only.


    • worker_type(WorkerType) / set_worker_type(Option<WorkerType>):
      required: false

      The type of predefined worker that is allocated when this task runs. Accepts a value of Standard, G.1X, or G.2X.

      • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.

      • For the G.1X worker type, each worker provides 4 vCPU, 16 GB of memory and a 64GB disk, and 1 executor per worker.

      • For the G.2X worker type, each worker provides 8 vCPU, 32 GB of memory and a 128GB disk, and 1 executor per worker.

      MaxCapacity is a mutually exclusive option with NumberOfWorkers and WorkerType.

      • If either NumberOfWorkers or WorkerType is set, then MaxCapacity cannot be set.

      • If MaxCapacity is set then neither NumberOfWorkers or WorkerType can be set.

      • If WorkerType is set, then NumberOfWorkers is required (and vice versa).

      • MaxCapacity and NumberOfWorkers must both be at least 1.


    • number_of_workers(i32) / set_number_of_workers(Option<i32>):
      required: false

      The number of workers of a defined workerType that are allocated when this task runs.

      If WorkerType is set, then NumberOfWorkers is required (and vice versa).


    • timeout(i32) / set_timeout(Option<i32>):
      required: false

      The timeout of the task run for this transform in minutes. This is the maximum time that a task run for this transform can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).


    • max_retries(i32) / set_max_retries(Option<i32>):
      required: false

      The maximum number of times to retry a task for this transform after a task run fails.


    • tags(impl Into<String>, impl Into<String>) / set_tags(Option<HashMap::<String, String>>):
      required: false

      The tags to use with this machine learning transform. You may use tags to limit access to the machine learning transform. For more information about tags in Glue, see Amazon Web Services Tags in Glue in the developer guide.


    • transform_encryption(TransformEncryption) / set_transform_encryption(Option<TransformEncryption>):
      required: false

      The encryption-at-rest settings of the transform that apply to accessing user data. Machine learning transforms can access user data encrypted in Amazon S3 using KMS.


  • On success, responds with CreateMlTransformOutput with field(s):
  • On failure, responds with SdkError<CreateMLTransformError>
source§

impl Client

source

pub fn create_partition(&self) -> CreatePartitionFluentBuilder

Constructs a fluent builder for the CreatePartition operation.

source§

impl Client

source

pub fn create_partition_index(&self) -> CreatePartitionIndexFluentBuilder

Constructs a fluent builder for the CreatePartitionIndex operation.

source§

impl Client

source

pub fn create_registry(&self) -> CreateRegistryFluentBuilder

Constructs a fluent builder for the CreateRegistry operation.

source§

impl Client

source

pub fn create_schema(&self) -> CreateSchemaFluentBuilder

Constructs a fluent builder for the CreateSchema operation.

  • The fluent builder is configurable:
    • registry_id(RegistryId) / set_registry_id(Option<RegistryId>):
      required: false

      This is a wrapper shape to contain the registry identity fields. If this is not provided, the default registry will be used. The ARN format for the same will be: arn:aws:glue:us-east-2: :registry/default-registry:random-5-letter-id .


    • schema_name(impl Into<String>) / set_schema_name(Option<String>):
      required: true

      Name of the schema to be created of max length of 255, and may only contain letters, numbers, hyphen, underscore, dollar sign, or hash mark. No whitespace.


    • data_format(DataFormat) / set_data_format(Option<DataFormat>):
      required: true

      The data format of the schema definition. Currently AVRO, JSON and PROTOBUF are supported.


    • compatibility(Compatibility) / set_compatibility(Option<Compatibility>):
      required: false

      The compatibility mode of the schema. The possible values are:

      • NONE: No compatibility mode applies. You can use this choice in development scenarios or if you do not know the compatibility mode that you want to apply to schemas. Any new version added will be accepted without undergoing a compatibility check.

      • DISABLED: This compatibility choice prevents versioning for a particular schema. You can use this choice to prevent future versioning of a schema.

      • BACKWARD: This compatibility choice is recommended as it allows data receivers to read both the current and one previous schema version. This means that for instance, a new schema version cannot drop data fields or change the type of these fields, so they can’t be read by readers using the previous version.

      • BACKWARD_ALL: This compatibility choice allows data receivers to read both the current and all previous schema versions. You can use this choice when you need to delete fields or add optional fields, and check compatibility against all previous schema versions.

      • FORWARD: This compatibility choice allows data receivers to read both the current and one next schema version, but not necessarily later versions. You can use this choice when you need to add fields or delete optional fields, but only check compatibility against the last schema version.

      • FORWARD_ALL: This compatibility choice allows data receivers to read written by producers of any new registered schema. You can use this choice when you need to add fields or delete optional fields, and check compatibility against all previous schema versions.

      • FULL: This compatibility choice allows data receivers to read data written by producers using the previous or next version of the schema, but not necessarily earlier or later versions. You can use this choice when you need to add or remove optional fields, but only check compatibility against the last schema version.

      • FULL_ALL: This compatibility choice allows data receivers to read data written by producers using all previous schema versions. You can use this choice when you need to add or remove optional fields, and check compatibility against all previous schema versions.


    • description(impl Into<String>) / set_description(Option<String>):
      required: false

      An optional description of the schema. If description is not provided, there will not be any automatic default value for this.


    • tags(impl Into<String>, impl Into<String>) / set_tags(Option<HashMap::<String, String>>):
      required: false

      Amazon Web Services tags that contain a key value pair and may be searched by console, command line, or API. If specified, follows the Amazon Web Services tags-on-create pattern.


    • schema_definition(impl Into<String>) / set_schema_definition(Option<String>):
      required: false

      The schema definition using the DataFormat setting for SchemaName.


  • On success, responds with CreateSchemaOutput with field(s):
  • On failure, responds with SdkError<CreateSchemaError>
source§

impl Client

source

pub fn create_script(&self) -> CreateScriptFluentBuilder

Constructs a fluent builder for the CreateScript operation.

source§

impl Client

source

pub fn create_security_configuration( &self ) -> CreateSecurityConfigurationFluentBuilder

Constructs a fluent builder for the CreateSecurityConfiguration operation.

source§

impl Client

source

pub fn create_session(&self) -> CreateSessionFluentBuilder

Constructs a fluent builder for the CreateSession operation.

source§

impl Client

source

pub fn create_table(&self) -> CreateTableFluentBuilder

Constructs a fluent builder for the CreateTable operation.

source§

impl Client

source

pub fn create_table_optimizer(&self) -> CreateTableOptimizerFluentBuilder

Constructs a fluent builder for the CreateTableOptimizer operation.

source§

impl Client

source

pub fn create_trigger(&self) -> CreateTriggerFluentBuilder

Constructs a fluent builder for the CreateTrigger operation.

source§

impl Client

source

pub fn create_user_defined_function( &self ) -> CreateUserDefinedFunctionFluentBuilder

Constructs a fluent builder for the CreateUserDefinedFunction operation.

source§

impl Client

source

pub fn create_workflow(&self) -> CreateWorkflowFluentBuilder

Constructs a fluent builder for the CreateWorkflow operation.

source§

impl Client

source

pub fn delete_blueprint(&self) -> DeleteBlueprintFluentBuilder

Constructs a fluent builder for the DeleteBlueprint operation.

source§

impl Client

source

pub fn delete_classifier(&self) -> DeleteClassifierFluentBuilder

Constructs a fluent builder for the DeleteClassifier operation.

source§

impl Client

source

pub fn delete_column_statistics_for_partition( &self ) -> DeleteColumnStatisticsForPartitionFluentBuilder

Constructs a fluent builder for the DeleteColumnStatisticsForPartition operation.

source§

impl Client

source

pub fn delete_column_statistics_for_table( &self ) -> DeleteColumnStatisticsForTableFluentBuilder

Constructs a fluent builder for the DeleteColumnStatisticsForTable operation.

source§

impl Client

source

pub fn delete_connection(&self) -> DeleteConnectionFluentBuilder

Constructs a fluent builder for the DeleteConnection operation.

source§

impl Client

source

pub fn delete_crawler(&self) -> DeleteCrawlerFluentBuilder

Constructs a fluent builder for the DeleteCrawler operation.

source§

impl Client

source

pub fn delete_custom_entity_type(&self) -> DeleteCustomEntityTypeFluentBuilder

Constructs a fluent builder for the DeleteCustomEntityType operation.

source§

impl Client

source

pub fn delete_data_quality_ruleset( &self ) -> DeleteDataQualityRulesetFluentBuilder

Constructs a fluent builder for the DeleteDataQualityRuleset operation.

source§

impl Client

source

pub fn delete_database(&self) -> DeleteDatabaseFluentBuilder

Constructs a fluent builder for the DeleteDatabase operation.

source§

impl Client

source

pub fn delete_dev_endpoint(&self) -> DeleteDevEndpointFluentBuilder

Constructs a fluent builder for the DeleteDevEndpoint operation.

source§

impl Client

source

pub fn delete_job(&self) -> DeleteJobFluentBuilder

Constructs a fluent builder for the DeleteJob operation.

source§

impl Client

source

pub fn delete_ml_transform(&self) -> DeleteMLTransformFluentBuilder

Constructs a fluent builder for the DeleteMLTransform operation.

source§

impl Client

source

pub fn delete_partition(&self) -> DeletePartitionFluentBuilder

Constructs a fluent builder for the DeletePartition operation.

source§

impl Client

source

pub fn delete_partition_index(&self) -> DeletePartitionIndexFluentBuilder

Constructs a fluent builder for the DeletePartitionIndex operation.

source§

impl Client

source

pub fn delete_registry(&self) -> DeleteRegistryFluentBuilder

Constructs a fluent builder for the DeleteRegistry operation.

source§

impl Client

source

pub fn delete_resource_policy(&self) -> DeleteResourcePolicyFluentBuilder

Constructs a fluent builder for the DeleteResourcePolicy operation.

source§

impl Client

source

pub fn delete_schema(&self) -> DeleteSchemaFluentBuilder

Constructs a fluent builder for the DeleteSchema operation.

source§

impl Client

source

pub fn delete_schema_versions(&self) -> DeleteSchemaVersionsFluentBuilder

Constructs a fluent builder for the DeleteSchemaVersions operation.

source§

impl Client

source

pub fn delete_security_configuration( &self ) -> DeleteSecurityConfigurationFluentBuilder

Constructs a fluent builder for the DeleteSecurityConfiguration operation.

source§

impl Client

source

pub fn delete_session(&self) -> DeleteSessionFluentBuilder

Constructs a fluent builder for the DeleteSession operation.

source§

impl Client

source

pub fn delete_table(&self) -> DeleteTableFluentBuilder

Constructs a fluent builder for the DeleteTable operation.

source§

impl Client

source

pub fn delete_table_optimizer(&self) -> DeleteTableOptimizerFluentBuilder

Constructs a fluent builder for the DeleteTableOptimizer operation.

source§

impl Client

source

pub fn delete_table_version(&self) -> DeleteTableVersionFluentBuilder

Constructs a fluent builder for the DeleteTableVersion operation.

source§

impl Client

source

pub fn delete_trigger(&self) -> DeleteTriggerFluentBuilder

Constructs a fluent builder for the DeleteTrigger operation.

source§

impl Client

source

pub fn delete_user_defined_function( &self ) -> DeleteUserDefinedFunctionFluentBuilder

Constructs a fluent builder for the DeleteUserDefinedFunction operation.

source§

impl Client

source

pub fn delete_workflow(&self) -> DeleteWorkflowFluentBuilder

Constructs a fluent builder for the DeleteWorkflow operation.

source§

impl Client

source

pub fn get_blueprint(&self) -> GetBlueprintFluentBuilder

Constructs a fluent builder for the GetBlueprint operation.

source§

impl Client

source

pub fn get_blueprint_run(&self) -> GetBlueprintRunFluentBuilder

Constructs a fluent builder for the GetBlueprintRun operation.

source§

impl Client

source

pub fn get_blueprint_runs(&self) -> GetBlueprintRunsFluentBuilder

Constructs a fluent builder for the GetBlueprintRuns operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_catalog_import_status(&self) -> GetCatalogImportStatusFluentBuilder

Constructs a fluent builder for the GetCatalogImportStatus operation.

source§

impl Client

source

pub fn get_classifier(&self) -> GetClassifierFluentBuilder

Constructs a fluent builder for the GetClassifier operation.

source§

impl Client

source

pub fn get_classifiers(&self) -> GetClassifiersFluentBuilder

Constructs a fluent builder for the GetClassifiers operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_column_statistics_for_partition( &self ) -> GetColumnStatisticsForPartitionFluentBuilder

Constructs a fluent builder for the GetColumnStatisticsForPartition operation.

source§

impl Client

source

pub fn get_column_statistics_for_table( &self ) -> GetColumnStatisticsForTableFluentBuilder

Constructs a fluent builder for the GetColumnStatisticsForTable operation.

source§

impl Client

source

pub fn get_column_statistics_task_run( &self ) -> GetColumnStatisticsTaskRunFluentBuilder

Constructs a fluent builder for the GetColumnStatisticsTaskRun operation.

source§

impl Client

source

pub fn get_column_statistics_task_runs( &self ) -> GetColumnStatisticsTaskRunsFluentBuilder

Constructs a fluent builder for the GetColumnStatisticsTaskRuns operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_connection(&self) -> GetConnectionFluentBuilder

Constructs a fluent builder for the GetConnection operation.

source§

impl Client

source

pub fn get_connections(&self) -> GetConnectionsFluentBuilder

Constructs a fluent builder for the GetConnections operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_crawler(&self) -> GetCrawlerFluentBuilder

Constructs a fluent builder for the GetCrawler operation.

source§

impl Client

source

pub fn get_crawler_metrics(&self) -> GetCrawlerMetricsFluentBuilder

Constructs a fluent builder for the GetCrawlerMetrics operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_crawlers(&self) -> GetCrawlersFluentBuilder

Constructs a fluent builder for the GetCrawlers operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_custom_entity_type(&self) -> GetCustomEntityTypeFluentBuilder

Constructs a fluent builder for the GetCustomEntityType operation.

source§

impl Client

source

pub fn get_data_catalog_encryption_settings( &self ) -> GetDataCatalogEncryptionSettingsFluentBuilder

Constructs a fluent builder for the GetDataCatalogEncryptionSettings operation.

source§

impl Client

source

pub fn get_data_quality_result(&self) -> GetDataQualityResultFluentBuilder

Constructs a fluent builder for the GetDataQualityResult operation.

source§

impl Client

source

pub fn get_data_quality_rule_recommendation_run( &self ) -> GetDataQualityRuleRecommendationRunFluentBuilder

Constructs a fluent builder for the GetDataQualityRuleRecommendationRun operation.

source§

impl Client

source

pub fn get_data_quality_ruleset(&self) -> GetDataQualityRulesetFluentBuilder

Constructs a fluent builder for the GetDataQualityRuleset operation.

source§

impl Client

source

pub fn get_data_quality_ruleset_evaluation_run( &self ) -> GetDataQualityRulesetEvaluationRunFluentBuilder

Constructs a fluent builder for the GetDataQualityRulesetEvaluationRun operation.

source§

impl Client

source

pub fn get_database(&self) -> GetDatabaseFluentBuilder

Constructs a fluent builder for the GetDatabase operation.

source§

impl Client

source

pub fn get_databases(&self) -> GetDatabasesFluentBuilder

Constructs a fluent builder for the GetDatabases operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_dataflow_graph(&self) -> GetDataflowGraphFluentBuilder

Constructs a fluent builder for the GetDataflowGraph operation.

source§

impl Client

source

pub fn get_dev_endpoint(&self) -> GetDevEndpointFluentBuilder

Constructs a fluent builder for the GetDevEndpoint operation.

source§

impl Client

source

pub fn get_dev_endpoints(&self) -> GetDevEndpointsFluentBuilder

Constructs a fluent builder for the GetDevEndpoints operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_job(&self) -> GetJobFluentBuilder

Constructs a fluent builder for the GetJob operation.

source§

impl Client

source

pub fn get_job_bookmark(&self) -> GetJobBookmarkFluentBuilder

Constructs a fluent builder for the GetJobBookmark operation.

source§

impl Client

source

pub fn get_job_run(&self) -> GetJobRunFluentBuilder

Constructs a fluent builder for the GetJobRun operation.

source§

impl Client

source

pub fn get_job_runs(&self) -> GetJobRunsFluentBuilder

Constructs a fluent builder for the GetJobRuns operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_jobs(&self) -> GetJobsFluentBuilder

Constructs a fluent builder for the GetJobs operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_mapping(&self) -> GetMappingFluentBuilder

Constructs a fluent builder for the GetMapping operation.

source§

impl Client

source

pub fn get_ml_task_run(&self) -> GetMLTaskRunFluentBuilder

Constructs a fluent builder for the GetMLTaskRun operation.

source§

impl Client

source

pub fn get_ml_task_runs(&self) -> GetMLTaskRunsFluentBuilder

Constructs a fluent builder for the GetMLTaskRuns operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_ml_transform(&self) -> GetMLTransformFluentBuilder

Constructs a fluent builder for the GetMLTransform operation.

source§

impl Client

source

pub fn get_ml_transforms(&self) -> GetMLTransformsFluentBuilder

Constructs a fluent builder for the GetMLTransforms operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_partition(&self) -> GetPartitionFluentBuilder

Constructs a fluent builder for the GetPartition operation.

source§

impl Client

source

pub fn get_partition_indexes(&self) -> GetPartitionIndexesFluentBuilder

Constructs a fluent builder for the GetPartitionIndexes operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_partitions(&self) -> GetPartitionsFluentBuilder

Constructs a fluent builder for the GetPartitions operation. This operation supports pagination; See into_paginator().

  • The fluent builder is configurable:
    • catalog_id(impl Into<String>) / set_catalog_id(Option<String>):
      required: false

      The ID of the Data Catalog where the partitions in question reside. If none is provided, the Amazon Web Services account ID is used by default.


    • database_name(impl Into<String>) / set_database_name(Option<String>):
      required: true

      The name of the catalog database where the partitions reside.


    • table_name(impl Into<String>) / set_table_name(Option<String>):
      required: true

      The name of the partitions’ table.


    • expression(impl Into<String>) / set_expression(Option<String>):
      required: false

      An expression that filters the partitions to be returned.

      The expression uses SQL syntax similar to the SQL WHERE filter clause. The SQL statement parser JSQLParser parses the expression.

      Operators: The following are the operators that you can use in the Expression API call:

      =

      Checks whether the values of the two operands are equal; if yes, then the condition becomes true.

      Example: Assume ‘variable a’ holds 10 and ‘variable b’ holds 20.

      (a = b) is not true.

      < >

      Checks whether the values of two operands are equal; if the values are not equal, then the condition becomes true.

      Example: (a < > b) is true.

      >

      Checks whether the value of the left operand is greater than the value of the right operand; if yes, then the condition becomes true.

      Example: (a > b) is not true.

      <

      Checks whether the value of the left operand is less than the value of the right operand; if yes, then the condition becomes true.

      Example: (a < b) is true.

      >=

      Checks whether the value of the left operand is greater than or equal to the value of the right operand; if yes, then the condition becomes true.

      Example: (a >= b) is not true.

      <=

      Checks whether the value of the left operand is less than or equal to the value of the right operand; if yes, then the condition becomes true.

      Example: (a <= b) is true.

      AND, OR, IN, BETWEEN, LIKE, NOT, IS NULL

      Logical operators.

      Supported Partition Key Types: The following are the supported partition keys.

      • string

      • date

      • timestamp

      • int

      • bigint

      • long

      • tinyint

      • smallint

      • decimal

      If an type is encountered that is not valid, an exception is thrown.

      The following list shows the valid operators on each type. When you define a crawler, the partitionKey type is created as a STRING, to be compatible with the catalog partitions.

      Sample API Call:


    • next_token(impl Into<String>) / set_next_token(Option<String>):
      required: false

      A continuation token, if this is not the first call to retrieve these partitions.


    • segment(Segment) / set_segment(Option<Segment>):
      required: false

      The segment of the table’s partitions to scan in this request.


    • max_results(i32) / set_max_results(Option<i32>):
      required: false

      The maximum number of partitions to return in a single response.


    • exclude_column_schema(bool) / set_exclude_column_schema(Option<bool>):
      required: false

      When true, specifies not returning the partition column schema. Useful when you are interested only in other partition attributes such as partition values or location. This approach avoids the problem of a large response by not returning duplicate data.


    • transaction_id(impl Into<String>) / set_transaction_id(Option<String>):
      required: false

      The transaction ID at which to read the partition contents.


    • query_as_of_time(DateTime) / set_query_as_of_time(Option<DateTime>):
      required: false

      The time as of when to read the partition contents. If not set, the most recent transaction commit time will be used. Cannot be specified along with TransactionId.


  • On success, responds with GetPartitionsOutput with field(s):
  • On failure, responds with SdkError<GetPartitionsError>
source§

impl Client

source

pub fn get_plan(&self) -> GetPlanFluentBuilder

Constructs a fluent builder for the GetPlan operation.

source§

impl Client

source

pub fn get_registry(&self) -> GetRegistryFluentBuilder

Constructs a fluent builder for the GetRegistry operation.

source§

impl Client

source

pub fn get_resource_policies(&self) -> GetResourcePoliciesFluentBuilder

Constructs a fluent builder for the GetResourcePolicies operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_resource_policy(&self) -> GetResourcePolicyFluentBuilder

Constructs a fluent builder for the GetResourcePolicy operation.

source§

impl Client

source

pub fn get_schema(&self) -> GetSchemaFluentBuilder

Constructs a fluent builder for the GetSchema operation.

source§

impl Client

source

pub fn get_schema_by_definition(&self) -> GetSchemaByDefinitionFluentBuilder

Constructs a fluent builder for the GetSchemaByDefinition operation.

source§

impl Client

source

pub fn get_schema_version(&self) -> GetSchemaVersionFluentBuilder

Constructs a fluent builder for the GetSchemaVersion operation.

source§

impl Client

source

pub fn get_schema_versions_diff(&self) -> GetSchemaVersionsDiffFluentBuilder

Constructs a fluent builder for the GetSchemaVersionsDiff operation.

source§

impl Client

source

pub fn get_security_configuration( &self ) -> GetSecurityConfigurationFluentBuilder

Constructs a fluent builder for the GetSecurityConfiguration operation.

source§

impl Client

source

pub fn get_security_configurations( &self ) -> GetSecurityConfigurationsFluentBuilder

Constructs a fluent builder for the GetSecurityConfigurations operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_session(&self) -> GetSessionFluentBuilder

Constructs a fluent builder for the GetSession operation.

source§

impl Client

source

pub fn get_statement(&self) -> GetStatementFluentBuilder

Constructs a fluent builder for the GetStatement operation.

source§

impl Client

source

pub fn get_table(&self) -> GetTableFluentBuilder

Constructs a fluent builder for the GetTable operation.

source§

impl Client

source

pub fn get_table_optimizer(&self) -> GetTableOptimizerFluentBuilder

Constructs a fluent builder for the GetTableOptimizer operation.

source§

impl Client

source

pub fn get_table_version(&self) -> GetTableVersionFluentBuilder

Constructs a fluent builder for the GetTableVersion operation.

source§

impl Client

source

pub fn get_table_versions(&self) -> GetTableVersionsFluentBuilder

Constructs a fluent builder for the GetTableVersions operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_tables(&self) -> GetTablesFluentBuilder

Constructs a fluent builder for the GetTables operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_tags(&self) -> GetTagsFluentBuilder

Constructs a fluent builder for the GetTags operation.

source§

impl Client

source

pub fn get_trigger(&self) -> GetTriggerFluentBuilder

Constructs a fluent builder for the GetTrigger operation.

source§

impl Client

source

pub fn get_triggers(&self) -> GetTriggersFluentBuilder

Constructs a fluent builder for the GetTriggers operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_unfiltered_partition_metadata( &self ) -> GetUnfilteredPartitionMetadataFluentBuilder

Constructs a fluent builder for the GetUnfilteredPartitionMetadata operation.

source§

impl Client

source

pub fn get_unfiltered_partitions_metadata( &self ) -> GetUnfilteredPartitionsMetadataFluentBuilder

Constructs a fluent builder for the GetUnfilteredPartitionsMetadata operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_unfiltered_table_metadata( &self ) -> GetUnfilteredTableMetadataFluentBuilder

Constructs a fluent builder for the GetUnfilteredTableMetadata operation.

source§

impl Client

source

pub fn get_user_defined_function(&self) -> GetUserDefinedFunctionFluentBuilder

Constructs a fluent builder for the GetUserDefinedFunction operation.

source§

impl Client

source

pub fn get_user_defined_functions(&self) -> GetUserDefinedFunctionsFluentBuilder

Constructs a fluent builder for the GetUserDefinedFunctions operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn get_workflow(&self) -> GetWorkflowFluentBuilder

Constructs a fluent builder for the GetWorkflow operation.

source§

impl Client

source

pub fn get_workflow_run(&self) -> GetWorkflowRunFluentBuilder

Constructs a fluent builder for the GetWorkflowRun operation.

source§

impl Client

source

pub fn get_workflow_run_properties( &self ) -> GetWorkflowRunPropertiesFluentBuilder

Constructs a fluent builder for the GetWorkflowRunProperties operation.

source§

impl Client

source

pub fn get_workflow_runs(&self) -> GetWorkflowRunsFluentBuilder

Constructs a fluent builder for the GetWorkflowRuns operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn import_catalog_to_glue(&self) -> ImportCatalogToGlueFluentBuilder

Constructs a fluent builder for the ImportCatalogToGlue operation.

source§

impl Client

source

pub fn list_blueprints(&self) -> ListBlueprintsFluentBuilder

Constructs a fluent builder for the ListBlueprints operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_column_statistics_task_runs( &self ) -> ListColumnStatisticsTaskRunsFluentBuilder

Constructs a fluent builder for the ListColumnStatisticsTaskRuns operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_crawlers(&self) -> ListCrawlersFluentBuilder

Constructs a fluent builder for the ListCrawlers operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_crawls(&self) -> ListCrawlsFluentBuilder

Constructs a fluent builder for the ListCrawls operation.

source§

impl Client

source

pub fn list_custom_entity_types(&self) -> ListCustomEntityTypesFluentBuilder

Constructs a fluent builder for the ListCustomEntityTypes operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_data_quality_results(&self) -> ListDataQualityResultsFluentBuilder

Constructs a fluent builder for the ListDataQualityResults operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_data_quality_rule_recommendation_runs( &self ) -> ListDataQualityRuleRecommendationRunsFluentBuilder

Constructs a fluent builder for the ListDataQualityRuleRecommendationRuns operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_data_quality_ruleset_evaluation_runs( &self ) -> ListDataQualityRulesetEvaluationRunsFluentBuilder

Constructs a fluent builder for the ListDataQualityRulesetEvaluationRuns operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_data_quality_rulesets(&self) -> ListDataQualityRulesetsFluentBuilder

Constructs a fluent builder for the ListDataQualityRulesets operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_dev_endpoints(&self) -> ListDevEndpointsFluentBuilder

Constructs a fluent builder for the ListDevEndpoints operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_jobs(&self) -> ListJobsFluentBuilder

Constructs a fluent builder for the ListJobs operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_ml_transforms(&self) -> ListMLTransformsFluentBuilder

Constructs a fluent builder for the ListMLTransforms operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_registries(&self) -> ListRegistriesFluentBuilder

Constructs a fluent builder for the ListRegistries operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_schema_versions(&self) -> ListSchemaVersionsFluentBuilder

Constructs a fluent builder for the ListSchemaVersions operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_schemas(&self) -> ListSchemasFluentBuilder

Constructs a fluent builder for the ListSchemas operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_sessions(&self) -> ListSessionsFluentBuilder

Constructs a fluent builder for the ListSessions operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_statements(&self) -> ListStatementsFluentBuilder

Constructs a fluent builder for the ListStatements operation.

source§

impl Client

source

pub fn list_table_optimizer_runs(&self) -> ListTableOptimizerRunsFluentBuilder

Constructs a fluent builder for the ListTableOptimizerRuns operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_triggers(&self) -> ListTriggersFluentBuilder

Constructs a fluent builder for the ListTriggers operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn list_workflows(&self) -> ListWorkflowsFluentBuilder

Constructs a fluent builder for the ListWorkflows operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn put_data_catalog_encryption_settings( &self ) -> PutDataCatalogEncryptionSettingsFluentBuilder

Constructs a fluent builder for the PutDataCatalogEncryptionSettings operation.

source§

impl Client

source

pub fn put_resource_policy(&self) -> PutResourcePolicyFluentBuilder

Constructs a fluent builder for the PutResourcePolicy operation.

source§

impl Client

source

pub fn put_schema_version_metadata( &self ) -> PutSchemaVersionMetadataFluentBuilder

Constructs a fluent builder for the PutSchemaVersionMetadata operation.

source§

impl Client

source

pub fn put_workflow_run_properties( &self ) -> PutWorkflowRunPropertiesFluentBuilder

Constructs a fluent builder for the PutWorkflowRunProperties operation.

source§

impl Client

source

pub fn query_schema_version_metadata( &self ) -> QuerySchemaVersionMetadataFluentBuilder

Constructs a fluent builder for the QuerySchemaVersionMetadata operation.

source§

impl Client

source

pub fn register_schema_version(&self) -> RegisterSchemaVersionFluentBuilder

Constructs a fluent builder for the RegisterSchemaVersion operation.

source§

impl Client

source

pub fn remove_schema_version_metadata( &self ) -> RemoveSchemaVersionMetadataFluentBuilder

Constructs a fluent builder for the RemoveSchemaVersionMetadata operation.

source§

impl Client

source

pub fn reset_job_bookmark(&self) -> ResetJobBookmarkFluentBuilder

Constructs a fluent builder for the ResetJobBookmark operation.

source§

impl Client

source

pub fn resume_workflow_run(&self) -> ResumeWorkflowRunFluentBuilder

Constructs a fluent builder for the ResumeWorkflowRun operation.

source§

impl Client

source

pub fn run_statement(&self) -> RunStatementFluentBuilder

Constructs a fluent builder for the RunStatement operation.

source§

impl Client

source

pub fn search_tables(&self) -> SearchTablesFluentBuilder

Constructs a fluent builder for the SearchTables operation. This operation supports pagination; See into_paginator().

source§

impl Client

source

pub fn start_blueprint_run(&self) -> StartBlueprintRunFluentBuilder

Constructs a fluent builder for the StartBlueprintRun operation.

source§

impl Client

source

pub fn start_column_statistics_task_run( &self ) -> StartColumnStatisticsTaskRunFluentBuilder

Constructs a fluent builder for the StartColumnStatisticsTaskRun operation.

source§

impl Client

source

pub fn start_crawler(&self) -> StartCrawlerFluentBuilder

Constructs a fluent builder for the StartCrawler operation.

source§

impl Client

source

pub fn start_crawler_schedule(&self) -> StartCrawlerScheduleFluentBuilder

Constructs a fluent builder for the StartCrawlerSchedule operation.

source§

impl Client

source

pub fn start_data_quality_rule_recommendation_run( &self ) -> StartDataQualityRuleRecommendationRunFluentBuilder

Constructs a fluent builder for the StartDataQualityRuleRecommendationRun operation.

source§

impl Client

source

pub fn start_data_quality_ruleset_evaluation_run( &self ) -> StartDataQualityRulesetEvaluationRunFluentBuilder

Constructs a fluent builder for the StartDataQualityRulesetEvaluationRun operation.

source§

impl Client

source

pub fn start_export_labels_task_run( &self ) -> StartExportLabelsTaskRunFluentBuilder

Constructs a fluent builder for the StartExportLabelsTaskRun operation.

source§

impl Client

source

pub fn start_import_labels_task_run( &self ) -> StartImportLabelsTaskRunFluentBuilder

Constructs a fluent builder for the StartImportLabelsTaskRun operation.

source§

impl Client

source

pub fn start_job_run(&self) -> StartJobRunFluentBuilder

Constructs a fluent builder for the StartJobRun operation.

  • The fluent builder is configurable:
    • job_name(impl Into<String>) / set_job_name(Option<String>):
      required: true

      The name of the job definition to use.


    • job_run_id(impl Into<String>) / set_job_run_id(Option<String>):
      required: false

      The ID of a previous JobRun to retry.


    • arguments(impl Into<String>, impl Into<String>) / set_arguments(Option<HashMap::<String, String>>):
      required: false

      The job arguments associated with this run. For this job run, they replace the default arguments set in the job definition itself.

      You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

      Job arguments may be logged. Do not pass plaintext secrets as arguments. Retrieve secrets from a Glue Connection, Secrets Manager or other secret management mechanism if you intend to keep them within the Job.

      For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

      For information about the arguments you can provide to this field when configuring Spark jobs, see the Special Parameters Used by Glue topic in the developer guide.

      For information about the arguments you can provide to this field when configuring Ray jobs, see Using job parameters in Ray jobs in the developer guide.


    • allocated_capacity(i32) / set_allocated_capacity(Option<i32>):
      required: false

      This field is deprecated. Use MaxCapacity instead.

      The number of Glue data processing units (DPUs) to allocate to this JobRun. You can allocate a minimum of 2 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.


    • timeout(i32) / set_timeout(Option<i32>):
      required: false

      The JobRun timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. This value overrides the timeout value set in the parent job.

      Streaming jobs do not have a timeout. The default for non-streaming jobs is 2,880 minutes (48 hours).


    • max_capacity(f64) / set_max_capacity(Option<f64>):
      required: false

      For Glue version 1.0 or earlier jobs, using the standard worker type, the number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

      For Glue version 2.0+ jobs, you cannot specify a Maximum capacity. Instead, you should specify a Worker type and the Number of workers.

      Do not set MaxCapacity if using WorkerType and NumberOfWorkers.

      The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job, an Apache Spark ETL job, or an Apache Spark streaming ETL job:

      • When you specify a Python shell job (JobCommand.Name=“pythonshell”), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.

      • When you specify an Apache Spark ETL job (JobCommand.Name=“glueetl”) or Apache Spark streaming ETL job (JobCommand.Name=“gluestreaming”), you can allocate from 2 to 100 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.


    • security_configuration(impl Into<String>) / set_security_configuration(Option<String>):
      required: false

      The name of the SecurityConfiguration structure to be used with this job run.


    • notification_property(NotificationProperty) / set_notification_property(Option<NotificationProperty>):
      required: false

      Specifies configuration properties of a job run notification.


    • worker_type(WorkerType) / set_worker_type(Option<WorkerType>):
      required: false

      The type of predefined worker that is allocated when a job runs. Accepts a value of G.1X, G.2X, G.4X, G.8X or G.025X for Spark jobs. Accepts the value Z.2X for Ray jobs.

      • For the G.1X worker type, each worker maps to 1 DPU (4 vCPUs, 16 GB of memory) with 84GB disk (approximately 34GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs.

      • For the G.2X worker type, each worker maps to 2 DPU (8 vCPUs, 32 GB of memory) with 128GB disk (approximately 77GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs.

      • For the G.4X worker type, each worker maps to 4 DPU (16 vCPUs, 64 GB of memory) with 256GB disk (approximately 235GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs in the following Amazon Web Services Regions: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm).

      • For the G.8X worker type, each worker maps to 8 DPU (32 vCPUs, 128 GB of memory) with 512GB disk (approximately 487GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs, in the same Amazon Web Services Regions as supported for the G.4X worker type.

      • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPUs, 4 GB of memory) with 84GB disk (approximately 34GB free), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

      • For the Z.2X worker type, each worker maps to 2 M-DPU (8vCPUs, 64 GB of memory) with 128 GB disk (approximately 120GB free), and provides up to 8 Ray workers based on the autoscaler.


    • number_of_workers(i32) / set_number_of_workers(Option<i32>):
      required: false

      The number of workers of a defined workerType that are allocated when a job runs.


    • execution_class(ExecutionClass) / set_execution_class(Option<ExecutionClass>):
      required: false

      Indicates whether the job is run with a standard or flexible execution class. The standard execution-class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

      The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

      Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.


  • On success, responds with StartJobRunOutput with field(s):
  • On failure, responds with SdkError<StartJobRunError>
source§

impl Client

source

pub fn start_ml_evaluation_task_run( &self ) -> StartMLEvaluationTaskRunFluentBuilder

Constructs a fluent builder for the StartMLEvaluationTaskRun operation.

source§

impl Client

source

pub fn start_ml_labeling_set_generation_task_run( &self ) -> StartMLLabelingSetGenerationTaskRunFluentBuilder

Constructs a fluent builder for the StartMLLabelingSetGenerationTaskRun operation.

source§

impl Client

source

pub fn start_trigger(&self) -> StartTriggerFluentBuilder

Constructs a fluent builder for the StartTrigger operation.

source§

impl Client

source

pub fn start_workflow_run(&self) -> StartWorkflowRunFluentBuilder

Constructs a fluent builder for the StartWorkflowRun operation.

source§

impl Client

source

pub fn stop_column_statistics_task_run( &self ) -> StopColumnStatisticsTaskRunFluentBuilder

Constructs a fluent builder for the StopColumnStatisticsTaskRun operation.

source§

impl Client

source

pub fn stop_crawler(&self) -> StopCrawlerFluentBuilder

Constructs a fluent builder for the StopCrawler operation.

source§

impl Client

source

pub fn stop_crawler_schedule(&self) -> StopCrawlerScheduleFluentBuilder

Constructs a fluent builder for the StopCrawlerSchedule operation.

source§

impl Client

source

pub fn stop_session(&self) -> StopSessionFluentBuilder

Constructs a fluent builder for the StopSession operation.

source§

impl Client

source

pub fn stop_trigger(&self) -> StopTriggerFluentBuilder

Constructs a fluent builder for the StopTrigger operation.

source§

impl Client

source

pub fn stop_workflow_run(&self) -> StopWorkflowRunFluentBuilder

Constructs a fluent builder for the StopWorkflowRun operation.

source§

impl Client

source

pub fn tag_resource(&self) -> TagResourceFluentBuilder

Constructs a fluent builder for the TagResource operation.

source§

impl Client

source

pub fn untag_resource(&self) -> UntagResourceFluentBuilder

Constructs a fluent builder for the UntagResource operation.

source§

impl Client

source

pub fn update_blueprint(&self) -> UpdateBlueprintFluentBuilder

Constructs a fluent builder for the UpdateBlueprint operation.

source§

impl Client

source

pub fn update_classifier(&self) -> UpdateClassifierFluentBuilder

Constructs a fluent builder for the UpdateClassifier operation.

source§

impl Client

source

pub fn update_column_statistics_for_partition( &self ) -> UpdateColumnStatisticsForPartitionFluentBuilder

Constructs a fluent builder for the UpdateColumnStatisticsForPartition operation.

source§

impl Client

source

pub fn update_column_statistics_for_table( &self ) -> UpdateColumnStatisticsForTableFluentBuilder

Constructs a fluent builder for the UpdateColumnStatisticsForTable operation.

source§

impl Client

source

pub fn update_connection(&self) -> UpdateConnectionFluentBuilder

Constructs a fluent builder for the UpdateConnection operation.

source§

impl Client

source

pub fn update_crawler(&self) -> UpdateCrawlerFluentBuilder

Constructs a fluent builder for the UpdateCrawler operation.

source§

impl Client

source

pub fn update_crawler_schedule(&self) -> UpdateCrawlerScheduleFluentBuilder

Constructs a fluent builder for the UpdateCrawlerSchedule operation.

source§

impl Client

source

pub fn update_data_quality_ruleset( &self ) -> UpdateDataQualityRulesetFluentBuilder

Constructs a fluent builder for the UpdateDataQualityRuleset operation.

source§

impl Client

source

pub fn update_database(&self) -> UpdateDatabaseFluentBuilder

Constructs a fluent builder for the UpdateDatabase operation.

source§

impl Client

source

pub fn update_dev_endpoint(&self) -> UpdateDevEndpointFluentBuilder

Constructs a fluent builder for the UpdateDevEndpoint operation.

source§

impl Client

source

pub fn update_job(&self) -> UpdateJobFluentBuilder

Constructs a fluent builder for the UpdateJob operation.

source§

impl Client

source

pub fn update_job_from_source_control( &self ) -> UpdateJobFromSourceControlFluentBuilder

Constructs a fluent builder for the UpdateJobFromSourceControl operation.

source§

impl Client

source

pub fn update_ml_transform(&self) -> UpdateMLTransformFluentBuilder

Constructs a fluent builder for the UpdateMLTransform operation.

source§

impl Client

source

pub fn update_partition(&self) -> UpdatePartitionFluentBuilder

Constructs a fluent builder for the UpdatePartition operation.

source§

impl Client

source

pub fn update_registry(&self) -> UpdateRegistryFluentBuilder

Constructs a fluent builder for the UpdateRegistry operation.

source§

impl Client

source

pub fn update_schema(&self) -> UpdateSchemaFluentBuilder

Constructs a fluent builder for the UpdateSchema operation.

source§

impl Client

source

pub fn update_source_control_from_job( &self ) -> UpdateSourceControlFromJobFluentBuilder

Constructs a fluent builder for the UpdateSourceControlFromJob operation.

source§

impl Client

source

pub fn update_table(&self) -> UpdateTableFluentBuilder

Constructs a fluent builder for the UpdateTable operation.

source§

impl Client

source

pub fn update_table_optimizer(&self) -> UpdateTableOptimizerFluentBuilder

Constructs a fluent builder for the UpdateTableOptimizer operation.

source§

impl Client

source

pub fn update_trigger(&self) -> UpdateTriggerFluentBuilder

Constructs a fluent builder for the UpdateTrigger operation.

source§

impl Client

source

pub fn update_user_defined_function( &self ) -> UpdateUserDefinedFunctionFluentBuilder

Constructs a fluent builder for the UpdateUserDefinedFunction operation.

source§

impl Client

source

pub fn update_workflow(&self) -> UpdateWorkflowFluentBuilder

Constructs a fluent builder for the UpdateWorkflow operation.

source§

impl Client

source

pub fn from_conf(conf: Config) -> Self

Creates a new client from the service Config.

§Panics

This method will panic in the following cases:

  • Retries or timeouts are enabled without a sleep_impl configured.
  • Identity caching is enabled without a sleep_impl and time_source configured.
  • No behavior_version is provided.

The panic message for each of these will have instructions on how to resolve them.

source

pub fn config(&self) -> &Config

Returns the client’s configuration.

source§

impl Client

source

pub fn new(sdk_config: &SdkConfig) -> Self

Creates a new client from an SDK Config.

§Panics
  • This method will panic if the sdk_config is missing an async sleep implementation. If you experience this panic, set the sleep_impl on the Config passed into this function to fix it.
  • This method will panic if the sdk_config is missing an HTTP connector. If you experience this panic, set the http_connector on the Config passed into this function to fix it.
  • This method will panic if no BehaviorVersion is provided. If you experience this panic, set behavior_version on the Config or enable the behavior-version-latest Cargo feature.

Trait Implementations§

source§

impl Clone for Client

source§

fn clone(&self) -> Client

Returns a copy of the value. Read more
1.0.0 · source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
source§

impl Debug for Client

source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

§

impl Freeze for Client

§

impl !RefUnwindSafe for Client

§

impl Send for Client

§

impl Sync for Client

§

impl Unpin for Client

§

impl !UnwindSafe for Client

Blanket Implementations§

source§

impl<T> Any for T
where T: 'static + ?Sized,

source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
source§

impl<T> Borrow<T> for T
where T: ?Sized,

source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
source§

impl<T> From<T> for T

source§

fn from(t: T) -> T

Returns the argument unchanged.

source§

impl<T> Instrument for T

source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
source§

impl<T, U> Into<U> for T
where U: From<T>,

source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

source§

impl<T> IntoEither for T

source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
source§

impl<Unshared, Shared> IntoShared<Shared> for Unshared
where Shared: FromUnshared<Unshared>,

source§

fn into_shared(self) -> Shared

Creates a shared type from an unshared type.
source§

impl<T> Same for T

§

type Output = T

Should always be Self
source§

impl<T> ToOwned for T
where T: Clone,

§

type Owned = T

The resulting type after obtaining ownership.
source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

§

type Error = Infallible

The type returned in the event of a conversion error.
source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
source§

impl<T> WithSubscriber for T

source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more