pub struct ShardConfig {
pub num_shards: u64,
pub shard_size: u64,
pub shard_headers: Vec<String>,
}
Expand description
Shard config contains the parameters of the Sharding operation, namely:
- number of shards into which input dataset will be split,
- size of each shard, i.e., the number of rows in each shard,
- headers of columns whose rows are hashed to find the index of a shard where the corresponding row will be placed.
Fields§
§num_shards: u64
§shard_size: u64
§shard_headers: Vec<String>
headers of columns whose rows are hashed to find the index of a shard where the corresponding row will be placed
Trait Implementations§
Source§impl Clone for ShardConfig
impl Clone for ShardConfig
Source§fn clone(&self) -> ShardConfig
fn clone(&self) -> ShardConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§const fn clone_from(&mut self, source: &Self)
const fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moreSource§impl Debug for ShardConfig
impl Debug for ShardConfig
Source§impl<'de> Deserialize<'de> for ShardConfig
impl<'de> Deserialize<'de> for ShardConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Hash for ShardConfig
impl Hash for ShardConfig
Source§impl PartialEq for ShardConfig
impl PartialEq for ShardConfig
Source§impl Serialize for ShardConfig
impl Serialize for ShardConfig
impl Eq for ShardConfig
impl StructuralPartialEq for ShardConfig
Auto Trait Implementations§
impl Freeze for ShardConfig
impl RefUnwindSafe for ShardConfig
impl Send for ShardConfig
impl Sync for ShardConfig
impl Unpin for ShardConfig
impl UnwindSafe for ShardConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key
and return true
if they are equal.