pub struct FederatedSplitCoordinator { /* private fields */ }Expand description
Federated split coordination (no raw data leaves nodes)
Implementations§
Source§impl FederatedSplitCoordinator
impl FederatedSplitCoordinator
Sourcepub fn new(strategy: FederatedSplitStrategy) -> Self
pub fn new(strategy: FederatedSplitStrategy) -> Self
Create a new coordinator with the given strategy
Sourcepub fn strategy(&self) -> &FederatedSplitStrategy
pub fn strategy(&self) -> &FederatedSplitStrategy
Get the current strategy
Sourcepub fn compute_split_plan(
&self,
manifests: &[NodeSplitManifest],
) -> Result<Vec<NodeSplitInstruction>>
pub fn compute_split_plan( &self, manifests: &[NodeSplitManifest], ) -> Result<Vec<NodeSplitInstruction>>
Compute split instructions for each node (runs on coordinator)
The coordinator only sees manifests (metadata), never raw data.
Sourcepub fn execute_local_split(
dataset: &ArrowDataset,
instruction: &NodeSplitInstruction,
) -> Result<DatasetSplit>
pub fn execute_local_split( dataset: &ArrowDataset, instruction: &NodeSplitInstruction, ) -> Result<DatasetSplit>
Execute split locally (runs on each node)
This function runs on the data-owning node - raw data never leaves.
Sourcepub fn verify_global_split(
manifests: &[NodeSplitManifest],
) -> Result<GlobalSplitReport>
pub fn verify_global_split( manifests: &[NodeSplitManifest], ) -> Result<GlobalSplitReport>
Verify global split quality (runs on coordinator)
Only examines manifests - no access to raw data.
Trait Implementations§
Source§impl Clone for FederatedSplitCoordinator
impl Clone for FederatedSplitCoordinator
Source§fn clone(&self) -> FederatedSplitCoordinator
fn clone(&self) -> FederatedSplitCoordinator
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for FederatedSplitCoordinator
impl RefUnwindSafe for FederatedSplitCoordinator
impl Send for FederatedSplitCoordinator
impl Sync for FederatedSplitCoordinator
impl Unpin for FederatedSplitCoordinator
impl UnsafeUnpin for FederatedSplitCoordinator
impl UnwindSafe for FederatedSplitCoordinator
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreCreates a shared type from an unshared type.