Struct ImportDataConfig

#[non_exhaustive]
pub struct ImportDataConfig {
    pub data_item_labels: HashMap<String, String>,
    pub annotation_labels: HashMap<String, String>,
    pub import_schema_uri: String,
    pub source: Option<Source>,
    /* private fields */
}

Describes the location from where we import data into a Dataset, together with the labels that will be applied to the DataItems and the Annotations.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

data_item_labels: HashMap<String, String>

Labels that will be applied to newly imported DataItems. If an identical DataItem as one being imported already exists in the Dataset, then these labels will be appended to these of the already existing one, and if labels with identical key is imported before, the old label value will be overwritten. If two DataItems are identical in the same import data operation, the labels will be combined and if key collision happens in this case, one of the values will be picked randomly. Two DataItems are considered identical if their content bytes are identical (e.g. image bytes or pdf bytes). These labels will be overridden by Annotation labels specified inside index file referenced by import_schema_uri, e.g. jsonl file.

annotation_labels: HashMap<String, String>

Labels that will be applied to newly imported Annotations. If two Annotations are identical, one of them will be deduped. Two Annotations are considered identical if their payload, payload_schema_uri and all of their labels are the same. These labels will be overridden by Annotation labels specified inside index file referenced by import_schema_uri, e.g. jsonl file.

import_schema_uri: String

Required. Points to a YAML file stored on Google Cloud Storage describing the import format. Validation will be done against the schema. The schema is defined as an OpenAPI 3.0.2 Schema Object.

source: Option<Source>

The source of the input.

Implementations

impl ImportDataConfig

pub fn new() -> Self

pub fn set_data_item_labels<T, K, V>(self, v: T) -> Self

where T: IntoIterator<Item = (K, V)>, K: Into<String>, V: Into<String>,

Sets the value of data_item_labels.

pub fn set_annotation_labels<T, K, V>(self, v: T) -> Self

where T: IntoIterator<Item = (K, V)>, K: Into<String>, V: Into<String>,

Sets the value of annotation_labels.

pub fn set_import_schema_uri<T: Into<String>>(self, v: T) -> Self

Sets the value of import_schema_uri.

pub fn set_source<T: Into<Option<Source>>>(self, v: T) -> Self

Sets the value of source.

Note that all the setters affecting source are mutually exclusive.

pub fn gcs_source(&self) -> Option<&Box<GcsSource>>

The value of source if it holds a GcsSource, None if the field is not set or holds a different branch.

pub fn set_gcs_source<T: Into<Box<GcsSource>>>(self, v: T) -> Self

Sets the value of source to hold a GcsSource.

Note that all the setters affecting source are mutually exclusive.

Trait Implementations

impl Clone for ImportDataConfig

fn clone(&self) -> ImportDataConfig

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ImportDataConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ImportDataConfig

fn default() -> ImportDataConfig

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ImportDataConfig

where ImportDataConfig: Default,

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Message for ImportDataConfig

fn typename() -> &'static str

The typename of this message.

impl PartialEq for ImportDataConfig

fn eq(&self, other: &ImportDataConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ImportDataConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ImportDataConfig