Endpoint

Struct Endpoint 

Source
#[non_exhaustive]
pub struct Endpoint {
Show 22 fields pub name: String, pub display_name: String, pub description: String, pub deployed_models: Vec<DeployedModel>, pub traffic_split: HashMap<String, i32>, pub etag: String, pub labels: HashMap<String, String>, pub create_time: Option<Timestamp>, pub update_time: Option<Timestamp>, pub encryption_spec: Option<EncryptionSpec>, pub network: String, pub enable_private_service_connect: bool, pub private_service_connect_config: Option<PrivateServiceConnectConfig>, pub model_deployment_monitoring_job: String, pub predict_request_response_logging_config: Option<PredictRequestResponseLoggingConfig>, pub dedicated_endpoint_enabled: bool, pub dedicated_endpoint_dns: String, pub client_connection_config: Option<ClientConnectionConfig>, pub satisfies_pzs: bool, pub satisfies_pzi: bool, pub gen_ai_advanced_features_config: Option<GenAiAdvancedFeaturesConfig>, pub private_model_server_enabled: bool, /* private fields */
}
Available on crate feature endpoint-service only.
Expand description

Models are deployed into it, and afterwards Endpoint is called to obtain predictions and explanations.

Fields (Non-exhaustive)§

This struct is marked as non-exhaustive
Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.
§name: String

Output only. The resource name of the Endpoint.

§display_name: String

Required. The display name of the Endpoint. The name can be up to 128 characters long and can consist of any UTF-8 characters.

§description: String

The description of the Endpoint.

§deployed_models: Vec<DeployedModel>

Output only. The models deployed in this Endpoint. To add or remove DeployedModels use EndpointService.DeployModel and EndpointService.UndeployModel respectively.

§traffic_split: HashMap<String, i32>

A map from a DeployedModel’s ID to the percentage of this Endpoint’s traffic that should be forwarded to that DeployedModel.

If a DeployedModel’s ID is not listed in this map, then it receives no traffic.

The traffic percentage values must add up to 100, or map must be empty if the Endpoint is to not accept any traffic at a moment.

§etag: String

Used to perform consistent read-modify-write updates. If not set, a blind “overwrite” update happens.

§labels: HashMap<String, String>

The labels with user-defined metadata to organize your Endpoints.

Label keys and values can be no longer than 64 characters (Unicode codepoints), can only contain lowercase letters, numeric characters, underscores and dashes. International characters are allowed.

See https://goo.gl/xmQnxf for more information and examples of labels.

§create_time: Option<Timestamp>

Output only. Timestamp when this Endpoint was created.

§update_time: Option<Timestamp>

Output only. Timestamp when this Endpoint was last updated.

§encryption_spec: Option<EncryptionSpec>

Customer-managed encryption key spec for an Endpoint. If set, this Endpoint and all sub-resources of this Endpoint will be secured by this key.

§network: String

Optional. The full name of the Google Compute Engine network to which the Endpoint should be peered.

Private services access must already be configured for the network. If left unspecified, the Endpoint is not peered with any network.

Only one of the fields, network or enable_private_service_connect, can be set.

Format: projects/{project}/global/networks/{network}. Where {project} is a project number, as in 12345, and {network} is network name.

§enable_private_service_connect: bool
👎Deprecated

Deprecated: If true, expose the Endpoint via private service connect.

Only one of the fields, network or enable_private_service_connect, can be set.

§private_service_connect_config: Option<PrivateServiceConnectConfig>

Optional. Configuration for private service connect.

network and private_service_connect_config are mutually exclusive.

§model_deployment_monitoring_job: String

Output only. Resource name of the Model Monitoring job associated with this Endpoint if monitoring is enabled by JobService.CreateModelDeploymentMonitoringJob. Format: projects/{project}/locations/{location}/modelDeploymentMonitoringJobs/{model_deployment_monitoring_job}

§predict_request_response_logging_config: Option<PredictRequestResponseLoggingConfig>

Configures the request-response logging for online prediction.

§dedicated_endpoint_enabled: bool

If true, the endpoint will be exposed through a dedicated DNS [Endpoint.dedicated_endpoint_dns]. Your request to the dedicated DNS will be isolated from other users’ traffic and will have better performance and reliability. Note: Once you enabled dedicated endpoint, you won’t be able to send request to the shared DNS {region}-aiplatform.googleapis.com. The limitation will be removed soon.

§dedicated_endpoint_dns: String

Output only. DNS of the dedicated endpoint. Will only be populated if dedicated_endpoint_enabled is true. Depending on the features enabled, uid might be a random number or a string. For example, if fast_tryout is enabled, uid will be fasttryout. Format: https://{endpoint_id}.{region}-{uid}.prediction.vertexai.goog.

§client_connection_config: Option<ClientConnectionConfig>

Configurations that are applied to the endpoint for online prediction.

§satisfies_pzs: bool

Output only. Reserved for future use.

§satisfies_pzi: bool

Output only. Reserved for future use.

§gen_ai_advanced_features_config: Option<GenAiAdvancedFeaturesConfig>

Optional. Configuration for GenAiAdvancedFeatures. If the endpoint is serving GenAI models, advanced features like native RAG integration can be configured. Currently, only Model Garden models are supported.

§private_model_server_enabled: bool

If true, the model server will be isolated from the external internet.

Implementations§

Source§

impl Endpoint

Source

pub fn new() -> Self

Source

pub fn set_name<T: Into<String>>(self, v: T) -> Self

Sets the value of name.

Source

pub fn set_display_name<T: Into<String>>(self, v: T) -> Self

Sets the value of display_name.

Source

pub fn set_description<T: Into<String>>(self, v: T) -> Self

Sets the value of description.

Source

pub fn set_deployed_models<T, V>(self, v: T) -> Self
where T: IntoIterator<Item = V>, V: Into<DeployedModel>,

Sets the value of deployed_models.

Source

pub fn set_traffic_split<T, K, V>(self, v: T) -> Self
where T: IntoIterator<Item = (K, V)>, K: Into<String>, V: Into<i32>,

Sets the value of traffic_split.

Source

pub fn set_etag<T: Into<String>>(self, v: T) -> Self

Sets the value of etag.

Source

pub fn set_labels<T, K, V>(self, v: T) -> Self
where T: IntoIterator<Item = (K, V)>, K: Into<String>, V: Into<String>,

Sets the value of labels.

Source

pub fn set_create_time<T>(self, v: T) -> Self
where T: Into<Timestamp>,

Sets the value of create_time.

Source

pub fn set_or_clear_create_time<T>(self, v: Option<T>) -> Self
where T: Into<Timestamp>,

Sets or clears the value of create_time.

Source

pub fn set_update_time<T>(self, v: T) -> Self
where T: Into<Timestamp>,

Sets the value of update_time.

Source

pub fn set_or_clear_update_time<T>(self, v: Option<T>) -> Self
where T: Into<Timestamp>,

Sets or clears the value of update_time.

Source

pub fn set_encryption_spec<T>(self, v: T) -> Self
where T: Into<EncryptionSpec>,

Sets the value of encryption_spec.

Source

pub fn set_or_clear_encryption_spec<T>(self, v: Option<T>) -> Self
where T: Into<EncryptionSpec>,

Sets or clears the value of encryption_spec.

Source

pub fn set_network<T: Into<String>>(self, v: T) -> Self

Sets the value of network.

Source

pub fn set_enable_private_service_connect<T: Into<bool>>(self, v: T) -> Self

👎Deprecated

Sets the value of enable_private_service_connect.

Source

pub fn set_private_service_connect_config<T>(self, v: T) -> Self

Sets the value of private_service_connect_config.

Source

pub fn set_or_clear_private_service_connect_config<T>( self, v: Option<T>, ) -> Self

Sets or clears the value of private_service_connect_config.

Source

pub fn set_model_deployment_monitoring_job<T: Into<String>>(self, v: T) -> Self

Source

pub fn set_predict_request_response_logging_config<T>(self, v: T) -> Self

Source

pub fn set_or_clear_predict_request_response_logging_config<T>( self, v: Option<T>, ) -> Self

Sets or clears the value of predict_request_response_logging_config.

Source

pub fn set_dedicated_endpoint_enabled<T: Into<bool>>(self, v: T) -> Self

Sets the value of dedicated_endpoint_enabled.

Source

pub fn set_dedicated_endpoint_dns<T: Into<String>>(self, v: T) -> Self

Sets the value of dedicated_endpoint_dns.

Source

pub fn set_client_connection_config<T>(self, v: T) -> Self

Sets the value of client_connection_config.

Source

pub fn set_or_clear_client_connection_config<T>(self, v: Option<T>) -> Self

Sets or clears the value of client_connection_config.

Source

pub fn set_satisfies_pzs<T: Into<bool>>(self, v: T) -> Self

Sets the value of satisfies_pzs.

Source

pub fn set_satisfies_pzi<T: Into<bool>>(self, v: T) -> Self

Sets the value of satisfies_pzi.

Source

pub fn set_gen_ai_advanced_features_config<T>(self, v: T) -> Self

Source

pub fn set_or_clear_gen_ai_advanced_features_config<T>( self, v: Option<T>, ) -> Self

Sets or clears the value of gen_ai_advanced_features_config.

Source

pub fn set_private_model_server_enabled<T: Into<bool>>(self, v: T) -> Self

Sets the value of private_model_server_enabled.

Trait Implementations§

Source§

impl Clone for Endpoint

Source§

fn clone(&self) -> Endpoint

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for Endpoint

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for Endpoint

Source§

fn default() -> Endpoint

Returns the “default value” for a type. Read more
Source§

impl Message for Endpoint

Source§

fn typename() -> &'static str

The typename of this message.
Source§

impl PartialEq for Endpoint

Source§

fn eq(&self, other: &Endpoint) -> bool

Tests for self and other values to be equal, and is used by ==.
1.0.0 · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.
Source§

impl StructuralPartialEq for Endpoint

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,