Struct SparkStatistics 

pub struct SparkStatistics {
    pub endpoints: Option<HashMap<String, String>>,
    pub gcs_staging_bucket: Option<String>,
    pub kms_key_name: Option<String>,
    pub logging_info: Option<SparkLoggingInfo>,
    pub spark_job_id: Option<String>,
    pub spark_job_location: Option<String>,
}

Statistics for a BigSpark query. Populated as part of JobStatistics2

This type is not used in any activity, and only used as part of another schema.

Fields

endpoints: Option<HashMap<String, String>>

Output only. Endpoints returned from Dataproc. Key list: - history_server_endpoint: A link to Spark job UI.

gcs_staging_bucket: Option<String>

Output only. The Google Cloud Storage bucket that is used as the default file system by the Spark application. This field is only filled when the Spark procedure uses the invoker security mode. The gcsStagingBucket bucket is inferred from the @@spark_proc_properties.staging_bucket system variable (if it is provided). Otherwise, BigQuery creates a default staging bucket for the job and returns the bucket name in this field. Example: * gs://[bucket_name]

kms_key_name: Option<String>

Output only. The Cloud KMS encryption key that is used to protect the resources created by the Spark job. If the Spark procedure uses the invoker security mode, the Cloud KMS encryption key is either inferred from the provided system variable, @@spark_proc_properties.kms_key_name, or the default key of the BigQuery job’s project (if the CMEK organization policy is enforced). Otherwise, the Cloud KMS key is either inferred from the Spark connection associated with the procedure (if it is provided), or from the default key of the Spark connection’s project if the CMEK organization policy is enforced. Example: * projects/[kms_project_id]/locations/[region]/keyRings/[key_region]/cryptoKeys/[key]

logging_info: Option<SparkLoggingInfo>

Output only. Logging info is used to generate a link to Cloud Logging.

spark_job_id: Option<String>

Output only. Spark job ID if a Spark job is created successfully.

spark_job_location: Option<String>

Output only. Location where the Spark job is executed. A location is selected by BigQueury for jobs configured to run in a multi-region.

Trait Implementations

impl Clone for SparkStatistics

fn clone(&self) -> SparkStatistics

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparkStatistics

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SparkStatistics

fn default() -> SparkStatistics

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for SparkStatistics

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for SparkStatistics

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Part for SparkStatistics