#[non_exhaustive]pub struct DevEndpoint {Show 25 fields
pub endpoint_name: Option<String>,
pub role_arn: Option<String>,
pub security_group_ids: Option<Vec<String>>,
pub subnet_id: Option<String>,
pub yarn_endpoint_address: Option<String>,
pub private_address: Option<String>,
pub zeppelin_remote_spark_interpreter_port: i32,
pub public_address: Option<String>,
pub status: Option<String>,
pub worker_type: Option<WorkerType>,
pub glue_version: Option<String>,
pub number_of_workers: Option<i32>,
pub number_of_nodes: i32,
pub availability_zone: Option<String>,
pub vpc_id: Option<String>,
pub extra_python_libs_s3_path: Option<String>,
pub extra_jars_s3_path: Option<String>,
pub failure_reason: Option<String>,
pub last_update_status: Option<String>,
pub created_timestamp: Option<DateTime>,
pub last_modified_timestamp: Option<DateTime>,
pub public_key: Option<String>,
pub public_keys: Option<Vec<String>>,
pub security_configuration: Option<String>,
pub arguments: Option<HashMap<String, String>>,
}
Expand description
A development endpoint where a developer can remotely debug extract, transform, and load (ETL) scripts.
Fields (Non-exhaustive)§
This struct is marked as non-exhaustive
Struct { .. }
syntax; cannot be matched against without a wildcard ..
; and struct update syntax will not work.endpoint_name: Option<String>
The name of the DevEndpoint
.
role_arn: Option<String>
The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint
.
security_group_ids: Option<Vec<String>>
A list of security group identifiers used in this DevEndpoint
.
subnet_id: Option<String>
The subnet ID for this DevEndpoint
.
yarn_endpoint_address: Option<String>
The YARN endpoint address used by this DevEndpoint
.
private_address: Option<String>
A private IP address to access the DevEndpoint
within a VPC if the DevEndpoint
is created within one. The PrivateAddress
field is present only when you create the DevEndpoint
within your VPC.
zeppelin_remote_spark_interpreter_port: i32
The Apache Zeppelin port for the remote Apache Spark interpreter.
public_address: Option<String>
The public IP address used by this DevEndpoint
. The PublicAddress
field is present only when you create a non-virtual private cloud (VPC) DevEndpoint
.
status: Option<String>
The current status of this DevEndpoint
.
worker_type: Option<WorkerType>
The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.
-
For the
Standard
worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker. -
For the
G.1X
worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs. -
For the
G.2X
worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X
WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.
glue_version: Option<String>
Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for running your ETL scripts on development endpoints.
For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.
Development endpoints that are created without specifying a Glue version default to Glue 0.9.
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint
or UpdateDevEndpoint
APIs. If no arguments are provided, the version defaults to Python 2.
number_of_workers: Option<i32>
The number of workers of a defined workerType
that are allocated to the development endpoint.
The maximum number of workers you can define are 299 for G.1X
, and 149 for G.2X
.
number_of_nodes: i32
The number of Glue Data Processing Units (DPUs) allocated to this DevEndpoint
.
availability_zone: Option<String>
The Amazon Web Services Availability Zone where this DevEndpoint
is located.
vpc_id: Option<String>
The ID of the virtual private cloud (VPC) used by this DevEndpoint
.
extra_python_libs_s3_path: Option<String>
The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint
. Multiple values must be complete paths separated by a comma.
You can only use pure Python libraries with a DevEndpoint
. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.
extra_jars_s3_path: Option<String>
The path to one or more Java .jar
files in an S3 bucket that should be loaded in your DevEndpoint
.
You can only use pure Java/Scala libraries with a DevEndpoint
.
failure_reason: Option<String>
The reason for a current failure in this DevEndpoint
.
last_update_status: Option<String>
The status of the last update.
created_timestamp: Option<DateTime>
The point in time at which this DevEndpoint was created.
last_modified_timestamp: Option<DateTime>
The point in time at which this DevEndpoint
was last modified.
public_key: Option<String>
The public key to be used by this DevEndpoint
for authentication. This attribute is provided for backward compatibility because the recommended attribute to use is public keys.
public_keys: Option<Vec<String>>
A list of public keys to be used by the DevEndpoints
for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.
If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint
API operation with the public key content in the deletePublicKeys
attribute, and the list of new keys in the addPublicKeys
attribute.
security_configuration: Option<String>
The name of the SecurityConfiguration
structure to be used with this DevEndpoint
.
arguments: Option<HashMap<String, String>>
A map of arguments used to configure the DevEndpoint
.
Valid arguments are:
-
"--enable-glue-datacatalog": ""
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint
or UpdateDevEndpoint
APIs. If no arguments are provided, the version defaults to Python 2.
Implementations§
Source§impl DevEndpoint
impl DevEndpoint
Sourcepub fn endpoint_name(&self) -> Option<&str>
pub fn endpoint_name(&self) -> Option<&str>
The name of the DevEndpoint
.
Sourcepub fn role_arn(&self) -> Option<&str>
pub fn role_arn(&self) -> Option<&str>
The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint
.
Sourcepub fn security_group_ids(&self) -> &[String]
pub fn security_group_ids(&self) -> &[String]
A list of security group identifiers used in this DevEndpoint
.
If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .security_group_ids.is_none()
.
Sourcepub fn yarn_endpoint_address(&self) -> Option<&str>
pub fn yarn_endpoint_address(&self) -> Option<&str>
The YARN endpoint address used by this DevEndpoint
.
Sourcepub fn private_address(&self) -> Option<&str>
pub fn private_address(&self) -> Option<&str>
A private IP address to access the DevEndpoint
within a VPC if the DevEndpoint
is created within one. The PrivateAddress
field is present only when you create the DevEndpoint
within your VPC.
Sourcepub fn zeppelin_remote_spark_interpreter_port(&self) -> i32
pub fn zeppelin_remote_spark_interpreter_port(&self) -> i32
The Apache Zeppelin port for the remote Apache Spark interpreter.
Sourcepub fn public_address(&self) -> Option<&str>
pub fn public_address(&self) -> Option<&str>
The public IP address used by this DevEndpoint
. The PublicAddress
field is present only when you create a non-virtual private cloud (VPC) DevEndpoint
.
Sourcepub fn worker_type(&self) -> Option<&WorkerType>
pub fn worker_type(&self) -> Option<&WorkerType>
The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.
-
For the
Standard
worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker. -
For the
G.1X
worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs. -
For the
G.2X
worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X
WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.
Sourcepub fn glue_version(&self) -> Option<&str>
pub fn glue_version(&self) -> Option<&str>
Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for running your ETL scripts on development endpoints.
For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.
Development endpoints that are created without specifying a Glue version default to Glue 0.9.
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint
or UpdateDevEndpoint
APIs. If no arguments are provided, the version defaults to Python 2.
Sourcepub fn number_of_workers(&self) -> Option<i32>
pub fn number_of_workers(&self) -> Option<i32>
The number of workers of a defined workerType
that are allocated to the development endpoint.
The maximum number of workers you can define are 299 for G.1X
, and 149 for G.2X
.
Sourcepub fn number_of_nodes(&self) -> i32
pub fn number_of_nodes(&self) -> i32
The number of Glue Data Processing Units (DPUs) allocated to this DevEndpoint
.
Sourcepub fn availability_zone(&self) -> Option<&str>
pub fn availability_zone(&self) -> Option<&str>
The Amazon Web Services Availability Zone where this DevEndpoint
is located.
Sourcepub fn vpc_id(&self) -> Option<&str>
pub fn vpc_id(&self) -> Option<&str>
The ID of the virtual private cloud (VPC) used by this DevEndpoint
.
Sourcepub fn extra_python_libs_s3_path(&self) -> Option<&str>
pub fn extra_python_libs_s3_path(&self) -> Option<&str>
The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint
. Multiple values must be complete paths separated by a comma.
You can only use pure Python libraries with a DevEndpoint
. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.
Sourcepub fn extra_jars_s3_path(&self) -> Option<&str>
pub fn extra_jars_s3_path(&self) -> Option<&str>
The path to one or more Java .jar
files in an S3 bucket that should be loaded in your DevEndpoint
.
You can only use pure Java/Scala libraries with a DevEndpoint
.
Sourcepub fn failure_reason(&self) -> Option<&str>
pub fn failure_reason(&self) -> Option<&str>
The reason for a current failure in this DevEndpoint
.
Sourcepub fn last_update_status(&self) -> Option<&str>
pub fn last_update_status(&self) -> Option<&str>
The status of the last update.
Sourcepub fn created_timestamp(&self) -> Option<&DateTime>
pub fn created_timestamp(&self) -> Option<&DateTime>
The point in time at which this DevEndpoint was created.
Sourcepub fn last_modified_timestamp(&self) -> Option<&DateTime>
pub fn last_modified_timestamp(&self) -> Option<&DateTime>
The point in time at which this DevEndpoint
was last modified.
Sourcepub fn public_key(&self) -> Option<&str>
pub fn public_key(&self) -> Option<&str>
The public key to be used by this DevEndpoint
for authentication. This attribute is provided for backward compatibility because the recommended attribute to use is public keys.
Sourcepub fn public_keys(&self) -> &[String]
pub fn public_keys(&self) -> &[String]
A list of public keys to be used by the DevEndpoints
for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.
If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint
API operation with the public key content in the deletePublicKeys
attribute, and the list of new keys in the addPublicKeys
attribute.
If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .public_keys.is_none()
.
Sourcepub fn security_configuration(&self) -> Option<&str>
pub fn security_configuration(&self) -> Option<&str>
The name of the SecurityConfiguration
structure to be used with this DevEndpoint
.
Sourcepub fn arguments(&self) -> Option<&HashMap<String, String>>
pub fn arguments(&self) -> Option<&HashMap<String, String>>
A map of arguments used to configure the DevEndpoint
.
Valid arguments are:
-
"--enable-glue-datacatalog": ""
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint
or UpdateDevEndpoint
APIs. If no arguments are provided, the version defaults to Python 2.
Source§impl DevEndpoint
impl DevEndpoint
Sourcepub fn builder() -> DevEndpointBuilder
pub fn builder() -> DevEndpointBuilder
Creates a new builder-style object to manufacture DevEndpoint
.
Trait Implementations§
Source§impl Clone for DevEndpoint
impl Clone for DevEndpoint
Source§fn clone(&self) -> DevEndpoint
fn clone(&self) -> DevEndpoint
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read moreSource§impl Debug for DevEndpoint
impl Debug for DevEndpoint
Source§impl PartialEq for DevEndpoint
impl PartialEq for DevEndpoint
impl StructuralPartialEq for DevEndpoint
Auto Trait Implementations§
impl Freeze for DevEndpoint
impl RefUnwindSafe for DevEndpoint
impl Send for DevEndpoint
impl Sync for DevEndpoint
impl Unpin for DevEndpoint
impl UnwindSafe for DevEndpoint
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self
into a Left
variant of Either<Self, Self>
if into_left
is true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self
into a Left
variant of Either<Self, Self>
if into_left(&self)
returns true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Paint for Twhere
T: ?Sized,
impl<T> Paint for Twhere
T: ?Sized,
Source§fn fg(&self, value: Color) -> Painted<&T>
fn fg(&self, value: Color) -> Painted<&T>
Returns a styled value derived from self
with the foreground set to
value
.
This method should be used rarely. Instead, prefer to use color-specific
builder methods like red()
and
green()
, which have the same functionality but are
pithier.
§Example
Set foreground color to white using fg()
:
use yansi::{Paint, Color};
painted.fg(Color::White);
Set foreground color to white using white()
.
use yansi::Paint;
painted.white();
Source§fn bright_black(&self) -> Painted<&T>
fn bright_black(&self) -> Painted<&T>
Source§fn bright_red(&self) -> Painted<&T>
fn bright_red(&self) -> Painted<&T>
Source§fn bright_green(&self) -> Painted<&T>
fn bright_green(&self) -> Painted<&T>
Source§fn bright_yellow(&self) -> Painted<&T>
fn bright_yellow(&self) -> Painted<&T>
Source§fn bright_blue(&self) -> Painted<&T>
fn bright_blue(&self) -> Painted<&T>
Source§fn bright_magenta(&self) -> Painted<&T>
fn bright_magenta(&self) -> Painted<&T>
Source§fn bright_cyan(&self) -> Painted<&T>
fn bright_cyan(&self) -> Painted<&T>
Source§fn bright_white(&self) -> Painted<&T>
fn bright_white(&self) -> Painted<&T>
Source§fn bg(&self, value: Color) -> Painted<&T>
fn bg(&self, value: Color) -> Painted<&T>
Returns a styled value derived from self
with the background set to
value
.
This method should be used rarely. Instead, prefer to use color-specific
builder methods like on_red()
and
on_green()
, which have the same functionality but
are pithier.
§Example
Set background color to red using fg()
:
use yansi::{Paint, Color};
painted.bg(Color::Red);
Set background color to red using on_red()
.
use yansi::Paint;
painted.on_red();
Source§fn on_primary(&self) -> Painted<&T>
fn on_primary(&self) -> Painted<&T>
Source§fn on_magenta(&self) -> Painted<&T>
fn on_magenta(&self) -> Painted<&T>
Source§fn on_bright_black(&self) -> Painted<&T>
fn on_bright_black(&self) -> Painted<&T>
Source§fn on_bright_red(&self) -> Painted<&T>
fn on_bright_red(&self) -> Painted<&T>
Source§fn on_bright_green(&self) -> Painted<&T>
fn on_bright_green(&self) -> Painted<&T>
Source§fn on_bright_yellow(&self) -> Painted<&T>
fn on_bright_yellow(&self) -> Painted<&T>
Source§fn on_bright_blue(&self) -> Painted<&T>
fn on_bright_blue(&self) -> Painted<&T>
Source§fn on_bright_magenta(&self) -> Painted<&T>
fn on_bright_magenta(&self) -> Painted<&T>
Source§fn on_bright_cyan(&self) -> Painted<&T>
fn on_bright_cyan(&self) -> Painted<&T>
Source§fn on_bright_white(&self) -> Painted<&T>
fn on_bright_white(&self) -> Painted<&T>
Source§fn attr(&self, value: Attribute) -> Painted<&T>
fn attr(&self, value: Attribute) -> Painted<&T>
Enables the styling Attribute
value
.
This method should be used rarely. Instead, prefer to use
attribute-specific builder methods like bold()
and
underline()
, which have the same functionality
but are pithier.
§Example
Make text bold using attr()
:
use yansi::{Paint, Attribute};
painted.attr(Attribute::Bold);
Make text bold using using bold()
.
use yansi::Paint;
painted.bold();
Source§fn rapid_blink(&self) -> Painted<&T>
fn rapid_blink(&self) -> Painted<&T>
Source§fn quirk(&self, value: Quirk) -> Painted<&T>
fn quirk(&self, value: Quirk) -> Painted<&T>
Enables the yansi
Quirk
value
.
This method should be used rarely. Instead, prefer to use quirk-specific
builder methods like mask()
and
wrap()
, which have the same functionality but are
pithier.
§Example
Enable wrapping using .quirk()
:
use yansi::{Paint, Quirk};
painted.quirk(Quirk::Wrap);
Enable wrapping using wrap()
.
use yansi::Paint;
painted.wrap();
Source§fn clear(&self) -> Painted<&T>
👎Deprecated since 1.0.1: renamed to resetting()
due to conflicts with Vec::clear()
.
The clear()
method will be removed in a future release.
fn clear(&self) -> Painted<&T>
resetting()
due to conflicts with Vec::clear()
.
The clear()
method will be removed in a future release.Source§fn whenever(&self, value: Condition) -> Painted<&T>
fn whenever(&self, value: Condition) -> Painted<&T>
Conditionally enable styling based on whether the Condition
value
applies. Replaces any previous condition.
See the crate level docs for more details.
§Example
Enable styling painted
only when both stdout
and stderr
are TTYs:
use yansi::{Paint, Condition};
painted.red().on_yellow().whenever(Condition::STDOUTERR_ARE_TTY);