Skip to main content

CpcUnion

Struct CpcUnion 

Source
pub struct CpcUnion { /* private fields */ }
Expand description

Merges multiple CpcSketches into one, e.g. combining per-shard or per-day counts into a total distinct count across all of them. Build one with CpcUnionBuilder.

Unlike HLL’s HllUnion, CpcUnion has no get_estimate/is_empty/reset convenience methods of its own — upstream’s cpc_union doesn’t have them either; query the sketch returned by Self::get_result instead.

Implementations§

Source§

impl CpcUnion

Source

pub fn update(&mut self, sketch: &CpcSketch)

Merges the given sketch’s state into this union.

Examples found in repository?
examples/cpc.rs (line 46)
8fn main() {
9    // A sketch estimates the number of distinct items seen, using bounded
10    // memory regardless of how many items are added. `lg_k` (4..=26)
11    // trades memory for accuracy: higher values are more accurate but use
12    // more space.
13    let mut visitors_day1 = CpcSketchBuilder::new()
14        .lg_k(11)
15        .build()
16        .expect("valid lg_k");
17    for id in 0..10_000u64 {
18        visitors_day1.update_u64(id);
19    }
20
21    let mut visitors_day2 = CpcSketchBuilder::new()
22        .lg_k(11)
23        .build()
24        .expect("valid lg_k");
25    for id in 5_000..15_000u64 {
26        visitors_day2.update_u64(id);
27    }
28
29    println!(
30        "Day 1 unique visitors (estimate): {:.0}",
31        visitors_day1.get_estimate()
32    );
33    println!(
34        "Day 2 unique visitors (estimate): {:.0}",
35        visitors_day2.get_estimate()
36    );
37    println!(
38        "Day 1, 95% confidence interval: [{:.0}, {:.0}]",
39        visitors_day1.get_lower_bound(2).unwrap(),
40        visitors_day1.get_upper_bound(2).unwrap()
41    );
42
43    // CpcUnion merges multiple sketches into one, e.g. combining per-day
44    // counts into a total distinct count across both days.
45    let mut union = CpcUnionBuilder::new().lg_k(11).build().expect("valid lg_k");
46    union.update(&visitors_day1);
47    union.update(&visitors_day2);
48    let total_unique = union.get_result();
49    println!(
50        "Total unique visitors across both days (true count = 15000): {:.0}",
51        total_unique.get_estimate()
52    );
53
54    // Sketches can be serialized to bytes (e.g. to store or send over the
55    // network) and reconstructed later. CPC's serialized form is always
56    // compressed, so there's a single serialize()/deserialize() pair
57    // (unlike Theta, which has separate compressed/uncompressed formats).
58    let bytes = visitors_day1.serialize();
59    let restored = CpcSketch::deserialize(&bytes).expect("valid sketch bytes");
60    println!(
61        "serialized day-1 sketch to {} bytes and restored successfully (estimate {:.0})",
62        bytes.len(),
63        restored.get_estimate()
64    );
65}
Source

pub fn get_result(&self) -> CpcSketch

Returns the current merged result as a standalone CpcSketch.

Examples found in repository?
examples/cpc.rs (line 48)
8fn main() {
9    // A sketch estimates the number of distinct items seen, using bounded
10    // memory regardless of how many items are added. `lg_k` (4..=26)
11    // trades memory for accuracy: higher values are more accurate but use
12    // more space.
13    let mut visitors_day1 = CpcSketchBuilder::new()
14        .lg_k(11)
15        .build()
16        .expect("valid lg_k");
17    for id in 0..10_000u64 {
18        visitors_day1.update_u64(id);
19    }
20
21    let mut visitors_day2 = CpcSketchBuilder::new()
22        .lg_k(11)
23        .build()
24        .expect("valid lg_k");
25    for id in 5_000..15_000u64 {
26        visitors_day2.update_u64(id);
27    }
28
29    println!(
30        "Day 1 unique visitors (estimate): {:.0}",
31        visitors_day1.get_estimate()
32    );
33    println!(
34        "Day 2 unique visitors (estimate): {:.0}",
35        visitors_day2.get_estimate()
36    );
37    println!(
38        "Day 1, 95% confidence interval: [{:.0}, {:.0}]",
39        visitors_day1.get_lower_bound(2).unwrap(),
40        visitors_day1.get_upper_bound(2).unwrap()
41    );
42
43    // CpcUnion merges multiple sketches into one, e.g. combining per-day
44    // counts into a total distinct count across both days.
45    let mut union = CpcUnionBuilder::new().lg_k(11).build().expect("valid lg_k");
46    union.update(&visitors_day1);
47    union.update(&visitors_day2);
48    let total_unique = union.get_result();
49    println!(
50        "Total unique visitors across both days (true count = 15000): {:.0}",
51        total_unique.get_estimate()
52    );
53
54    // Sketches can be serialized to bytes (e.g. to store or send over the
55    // network) and reconstructed later. CPC's serialized form is always
56    // compressed, so there's a single serialize()/deserialize() pair
57    // (unlike Theta, which has separate compressed/uncompressed formats).
58    let bytes = visitors_day1.serialize();
59    let restored = CpcSketch::deserialize(&bytes).expect("valid sketch bytes");
60    println!(
61        "serialized day-1 sketch to {} bytes and restored successfully (estimate {:.0})",
62        bytes.len(),
63        restored.get_estimate()
64    );
65}

Trait Implementations§

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.