Struct EncodeRequest 

pub struct EncodeRequest { /* private fields */ }

Embeds one or more items. Build with Client::encode.

Implementations

impl EncodeRequest

pub fn gpu(self, gpu: impl Into<String>) -> Self

Route to a machine profile, optionally pool-qualified as "pool/profile".

pub fn wait_for_capacity(self, wait: bool) -> Self

Whether to wait out provisioning and model loading, or fail fast.

pub fn provision_timeout(self, timeout: Duration) -> Self

Total wall-clock budget for this call, retries included.

pub fn max_oom_retries(self, retries: u32) -> Self

Cap on RESOURCE_EXHAUSTED retries. Zero fails fast.

pub fn output_types(self, types: impl IntoIterator<Item = OutputType>) -> Self

Which representations to return. Defaults to whatever the model produces.

pub fn instruction(self, instruction: impl Into<String>) -> Self

Task instruction prepended by instruction-tuned models.

pub fn output_dtype(self, dtype: OutputDType) -> Self

Quantize the returned embeddings.

pub fn is_query(self, is_query: bool) -> Self

Encode as a query rather than a document, for asymmetric models.

pub fn options(self, options: Value) -> Self

Adapter-specific runtime options, merged over the client defaults.

pub async fn send(self) -> Result<Vec<EncodeResult>>

Send the request.

pub async fn send_one(self) -> Result<EncodeResult>

Send the request and return the single expected result.