Skip to main content

TransferOptions

Struct TransferOptions 

Source
pub struct TransferOptions {
    pub layer_range: Option<Range<usize>>,
    pub nixl_write_notification: Option<u64>,
    pub bounce_buffer: Option<BounceBuffer>,
    pub cuda_stream: Option<Arc<CudaStream>>,
    pub src_kv_layout: Option<KvBlockLayout>,
    pub dst_kv_layout: Option<KvBlockLayout>,
}
Expand description

Options for configuring transfer operations.

This structure provides configuration for block and layer transfers, including layer ranges, NIXL write notifications, and bounce buffers.

§Examples

let options = TransferOptions::builder()
    .nixl_write_notification(42)
    .layer_range(0..10)
    .build();

Fields§

§layer_range: Option<Range<usize>>

Range of layers to transfer (None = all layers).

When specified, only the layers in this range will be transferred. This is useful for partial block transfers or layer-specific operations.

§nixl_write_notification: Option<u64>

NIXL write notification value delivered after RDMA write completes.

When specified, NIXL will deliver this notification value to the remote node after the RDMA write operation completes. This enables efficient notification of transfer completion without requiring polling.

§bounce_buffer: Option<BounceBuffer>

Bounce buffer specification for multi-hop transfers.

When direct transfers are not allowed or efficient, this specifies an intermediate staging area. The transfer will be split into two hops: source → bounce buffer → destination.

§cuda_stream: Option<Arc<CudaStream>>

Optional caller-provided CUDA stream for the transfer.

When provided, the transfer executor will use this stream instead of acquiring one from the pool. The caller is responsible for synchronization - no event is recorded by the executor.

This is useful for layer-wise transfers where all layers must execute on the same stream to allow proper event sequencing.

§src_kv_layout: Option<KvBlockLayout>

Override source block layout interpretation.

When set, the transfer executor will treat source blocks as having this layout instead of the layout’s default block_layout(). This enables transferring blocks that are stored in one format but should be interpreted as another (e.g., operational → universal).

§dst_kv_layout: Option<KvBlockLayout>

Override destination block layout interpretation.

When set, the transfer executor will treat destination blocks as having this layout instead of the layout’s default block_layout(). This enables writing blocks in a different format than the destination layout’s native format.

Implementations§

Source§

impl TransferOptions

Auto-generated by derive_getters::Dissolve.

Source

pub fn dissolve( self, ) -> (Option<Range<usize>>, Option<u64>, Option<BounceBuffer>, Option<Arc<CudaStream>>, Option<KvBlockLayout>, Option<KvBlockLayout>)

Dissolve TransferOptions into a tuple consisting of its fields in order of declaration.

Source§

impl TransferOptions

Source

pub fn builder() -> TransferOptionsBuilder

Create a new builder for transfer options.

Source

pub fn from_layer_range(layer_range: Option<Range<usize>>) -> Self

Create transfer options from an optional layer range.

Source

pub fn new() -> Self

Create default transfer options.

This transfers all layers with no special configuration.

Trait Implementations§

Source§

impl Clone for TransferOptions

Source§

fn clone(&self) -> TransferOptions

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Default for TransferOptions

Source§

fn default() -> TransferOptions

Returns the “default value” for a type. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> FromRef<T> for T
where T: Clone,

Source§

fn from_ref(input: &T) -> T

Converts to this type from a reference to the input type.
Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoRequest<T> for T

Source§

fn into_request(self) -> Request<T>

Wrap the input message T in a tonic::Request
Source§

impl<L> LayerExt<L> for L

Source§

fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>
where L: Layer<S>,

Applies the layer to a service and wraps it in Layered.
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more