Skip to main content

ResourceLimits

Struct ResourceLimits 

Source
pub struct ResourceLimits {
    pub max_encoded_bytes: usize,
    pub max_decoded_bytes: usize,
    pub max_tensor_elements: usize,
    pub max_image_dimension: usize,
    pub max_records: usize,
    pub max_columns: usize,
    pub max_string_bytes: usize,
    pub max_tokens: usize,
    pub max_columnar_bytes: usize,
    pub max_media_seconds: u64,
    pub max_streams: usize,
}
Expand description

Resource ceilings applied before allocation whenever metadata permits.

These bound logical input/output payloads, not native decoder RSS. Loader queue bytes remain a separate crate::MemoryFootprint budget.

use rusttorch_data::ResourceLimits;
let limits = ResourceLimits::default();
limits.check("tokens", 128, limits.max_tokens)?;
assert!(limits.check("tokens", usize::MAX, limits.max_tokens).is_err());

Fields§

§max_encoded_bytes: usize

Maximum encoded bytes per local file or bounded input (64 MiB).

§max_decoded_bytes: usize

Maximum decoded sample or explicitly bounded batch payload (256 MiB).

§max_tensor_elements: usize

Maximum elements in one tensor (64 million).

§max_image_dimension: usize

Maximum image width or height (16,384).

§max_records: usize

Maximum records in a dataset or explicitly bounded batch (1 million).

§max_columns: usize

Maximum fields per tabular record (4,096).

§max_string_bytes: usize

Maximum UTF-8 bytes per field or text sample (1 MiB).

§max_tokens: usize

Maximum tokens per sequence or padded batch (1 million).

§max_columnar_bytes: usize

Maximum Arrow record-batch or Parquet row-group payload (256 MiB).

§max_media_seconds: u64

Maximum media duration in whole seconds (one hour).

§max_streams: usize

Maximum streams per media container (32).

Implementations§

Source§

impl ResourceLimits

Source

pub const fn unlimited() -> Self

Explicitly disables logical ceilings; integer overflow is still rejected.

Source

pub fn check( &self, field: &'static str, actual: usize, maximum: usize, ) -> Result<()>

Rejects a value above its named ceiling.

Source

pub fn tensor_elements(&self, dimensions: &[usize]) -> Result<usize>

Checks multiplication and the resulting tensor-element ceiling.

Source

pub fn read_encoded(&self, reader: impl Read) -> Result<Vec<u8>>

Reads at most the encoded ceiling plus one sentinel byte, then rejects oversized input. The limit is enforced even if file metadata changes.

Trait Implementations§

Source§

impl Clone for ResourceLimits

Source§

fn clone(&self) -> Self

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Copy for ResourceLimits

Source§

impl Debug for ResourceLimits

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for ResourceLimits

Source§

fn default() -> Self

Returns the “default value” for a type. Read more
Source§

impl<'de> Deserialize<'de> for ResourceLimits

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl Eq for ResourceLimits

Source§

impl PartialEq for ResourceLimits

Source§

fn eq(&self, other: &Self) -> bool

Equality operator ==. Read more
1.0.0 (const: unstable) · Source§

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=. Read more
Source§

impl Serialize for ResourceLimits

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more
Source§

impl StructuralPartialEq for ResourceLimits

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V