Struct polars::chunked_array::ChunkedArray[][src]

pub struct ChunkedArray<T> { /* fields omitted */ }
Expand description

ChunkedArray

Every Series contains a ChunkedArray<T>. Unlike Series, ChunkedArray’s are typed. This allows us to apply closures to the data and collect the results to a ChunkedArray of the same type T. Below we use an apply to use the cosine function to the values of a ChunkedArray.

fn apply_cosine(ca: &Float32Chunked) -> Float32Chunked {
    ca.apply(|v| v.cos())
}

If we would like to cast the result we could use a Rust Iterator instead of an apply method. Note that Iterators are slightly slower as the null values aren’t ignored implicitly.

fn apply_cosine_and_cast(ca: &Float32Chunked) -> Float64Chunked {
    ca.into_iter()
        .map(|opt_v| {
        opt_v.map(|v| v.cos() as f64)
    }).collect()
}

Another option is to first cast and then use an apply.

fn apply_cosine_and_cast(ca: &Float32Chunked) -> Float64Chunked {
    ca.cast::<Float64Type>()
        .unwrap()
        .apply(|v| v.cos())
}

Conversion between Series and ChunkedArray’s

Conversion from a Series to a ChunkedArray is effortless.

fn to_chunked_array(series: &Series) -> Result<&Int32Chunked>{
    series.i32()
}

fn to_series(ca: Int32Chunked) -> Series {
    ca.into_series()
}

Iterators

ChunkedArrays fully support Rust native Iterator and DoubleEndedIterator traits, thereby giving access to all the excellent methods available for Iterators.


fn iter_forward(ca: &Float32Chunked) {
    ca.into_iter()
        .for_each(|opt_v| println!("{:?}", opt_v))
}

fn iter_backward(ca: &Float32Chunked) {
    ca.into_iter()
        .rev()
        .for_each(|opt_v| println!("{:?}", opt_v))
}

Memory layout

ChunkedArray’s use Apache Arrow as backend for the memory layout. Arrows memory is immutable which makes it possible to make multiple zero copy (sub)-views from a single array.

To be able to append data, Polars uses chunks to append new memory locations, hence the ChunkedArray<T> data structure. Appends are cheap, because it will not lead to a full reallocation of the whole array (as could be the case with a Rust Vec).

However, multiple chunks in a ChunkArray will slow down the Iterators, arithmetic and other operations. When multiplying two ChunkArray's with different chunk sizes they cannot utilize SIMD for instance. However, when chunk size don’t match, Iterators will be used to do the operation (instead of arrows upstream implementation, which may utilize SIMD) and the result will be a single chunked array.

The key takeaway is that by applying operations on a ChunkArray of multiple chunks, the results will converge to a ChunkArray of a single chunk! It is recommended to leave them as is. If you want to have predictable performance (no unexpected re-allocation of memory), it is advised to call the rechunk after multiple append operations.

Implementations

Check if all values are true

Check if all values are false

If data is aligned in a single chunk and has no Null values a zero copy view is returned as an ndarray

If all nested Series have the same length, a 2 dimensional ndarray::Array is returned.

Get a hold to an object that can be formatted or downcasted via the Any trait.

Safety

No bounds checks

Get a hold to an object that can be formatted or downcasted via the Any trait.

Sample n datapoints from this ChunkedArray.

Sample a fraction between 0.0-1.0 of this ChunkedArray.

Create ChunkedArray with samples from a Normal distribution.

Create ChunkedArray with samples from a Standard Normal distribution.

Create ChunkedArray with samples from a Uniform distribution.

Create ChunkedArray with samples from a Bernoulli distribution.

Extract json path, first match Refer to https://goessner.net/articles/JsonPath/

Get the length of the string values.

Check if strings contain a regex pattern

Replace the leftmost (sub)string by a regex pattern

Replace all (sub)strings by a regex pattern

Modify the strings to their lowercase equivalent

Modify the strings to their uppercase equivalent

Concat with the values from a second Utf8Chunked

Slice the string values Determines a substring starting from start and with optional length length of each of the elements in array. start can be negative, in which case the start counts from the end of the string.

Extract month from underlying NaiveDateTime representation. Returns the year number in the calendar date.

Extract month from underlying NaiveDateTime representation. Returns the month number starting from 1.

The return value ranges from 1 to 12.

Extract weekday from underlying NaiveDateTime representation. Returns the weekday number where monday = 0 and sunday = 6

Returns the ISO week number starting from 1. The return value ranges from 1 to 53. (The last week of year differs by years.)

Extract day from underlying NaiveDateTime representation. Returns the day of month starting from 1.

The return value ranges from 1 to 31. (The last day of month differs by months.)

Extract hour from underlying NaiveDateTime representation. Returns the hour number from 0 to 23.

Extract minute from underlying NaiveDateTime representation. Returns the minute number from 0 to 59.

Extract second from underlying NaiveDateTime representation. Returns the second number from 0 to 59.

Extract second from underlying NaiveDateTime representation. Returns the number of nanoseconds since the whole non-leap second. The range from 1,000,000,000 to 1,999,999,999 represents the leap second.

Returns the day of year starting from 1.

The return value ranges from 1 to 366. (The last day of year differs by years.)

Format Date64 with a fmt rule. See chrono strftime/strptime.

Extract month from underlying NaiveDate representation. Returns the year number in the calendar date.

Extract month from underlying NaiveDateTime representation. Returns the month number starting from 1.

The return value ranges from 1 to 12.

Extract weekday from underlying NaiveDate representation. Returns the weekday number where monday = 0 and sunday = 6

Returns the ISO week number starting from 1. The return value ranges from 1 to 53. (The last week of year differs by years.)

Extract day from underlying NaiveDate representation. Returns the day of month starting from 1.

The return value ranges from 1 to 31. (The last day of month differs by months.)

Returns the day of year starting from 1.

The return value ranges from 1 to 366. (The last day of year differs by years.)

Format Date32 with a fmt rule. See chrono strftime/strptime.

This is an iterator over a ListChunked that save allocations. A Series is: 1. Arc ChunkedArray is: 2. Vec< 3. ArrayRef>

The ArrayRef we indicated with 3. will be updated during iteration. The Series will be pinned in memory, saving an allocation for

  1. Arc<..>
  2. Vec<…>

Warning

Though memory safe in the sense that it will not read unowned memory, UB, or memory leaks this function still needs precautions. The returned should never be cloned or taken longer than a single iteration, as every call on next of the iterator will change the contents of that Series.

Apply a closure F elementwise.

Get a reference to the mapping of categorical types to the string values.

Get the index of the first non null value in this ChunkedArray.

Get the buffer of bits representing null values

Shrink the capacity of this array to fit it’s length.

Series to ChunkedArray

Combined length of all the chunks.

Check if ChunkedArray is empty.

Unique id representing the number of chunks

A reference to the chunks

Returns true if contains a single chunk and has no null values

Count the null values.

Take a view of top n elements

Append arrow array in place.

let mut array = Int32Chunked::new_from_slice("array", &[1, 2]);
let array_2 = Int32Chunked::new_from_slice("2nd", &[3]);

array.append(&array_2);
assert_eq!(Vec::from(&array), [Some(1), Some(2), Some(3)])

Slice the array. The chunks are reallocated the underlying data slices are zero copy.

When offset is negative it will be counted from the end of the array. This method will never error, and will slice the best match when offset, or length is out of bounds

Get a mask of the null values.

Get a mask of the valid values.

Get data type of ChunkedArray.

Get the head of the ChunkedArray

Get the tail of the ChunkedArray

Append in place.

Name of the ChunkedArray.

Get a reference to the field.

Rename this ChunkedArray.

Create a new ChunkedArray from existing chunks.

Create a new ChunkedArray by taking ownership of the AlignedVec. This operation is zero copy.

Nullify values in slice with an existing null bitmap

Contiguous slice

Get slices of the underlying arrow data. NOTE: null values should be taken into account by the user of these slices as they are handled separately

If cont_slice is successful a closure is mapped over the elements.

Example

use polars_core::prelude::*;
fn multiply(ca: &UInt32Chunked) -> Result<Series> {
    let mapped = ca.map(|v| v * 2)?;
    Ok(mapped.collect())
}

If cont_slice fails we can fallback on an iterator with null checks and map a closure over the elements.

Example

use polars_core::prelude::*;
use itertools::Itertools;
fn multiply(ca: &UInt32Chunked) -> Series {
    let mapped_result = ca.map(|v| v * 2);

    if let Ok(mapped) = mapped_result {
        mapped.collect()
    } else {
        ca
        .map_null_checks(|opt_v| opt_v.map(|v |v * 2)).collect()
    }
}

If cont_slice is successful a closure can be applied as aggregation

Example

use polars_core::prelude::*;
fn compute_sum(ca: &UInt32Chunked) -> Result<u32> {
    ca.fold(0, |acc, value| acc + value)
}

If cont_slice fails we can fallback on an iterator with null checks and a closure for aggregation

Example

use polars_core::prelude::*;
fn compute_sum(ca: &UInt32Chunked) -> u32 {
    match ca.fold(0, |acc, value| acc + value) {
        // faster sum without null checks was successful
        Ok(sum) => sum,
        // Null values or multiple chunks in ChunkedArray, we need to do more bounds checking
        Err(_) => ca.fold_null_checks(0, |acc, opt_value| {
            match opt_value {
                Some(v) => acc + v,
                None => acc
            }
        })
    }
}

Get the inner data type of the list.

We cannot override the left hand side behaviour. So we create a trait LhsNumOps. This allows for 1.add(&Series)

Apply lhs - self

Apply lhs / self

Apply lhs % self

Trait Implementations

The resulting type after applying the + operator.

Performs the + operation. Read more

The resulting type after applying the + operator.

Performs the + operation. Read more

The resulting type after applying the + operator.

Performs the + operation. Read more

The resulting type after applying the + operator.

Performs the + operation. Read more

The resulting type after applying the + operator.

Performs the + operation. Read more

The resulting type after applying the + operator.

Performs the + operation. Read more

The resulting type after applying the + operator.

Performs the + operation. Read more

Get the index of the minimal value

Get the index of the maximal value

Get the index of the minimal value

Get the index of the maximal value

Get the index of the minimal value

Get the index of the maximal value

Get the index of the minimal value

Get the index of the maximal value

Get the index of the minimal value

Get the index of the maximal value

Get the index of the minimal value

Get the index of the maximal value

Performs the conversion.

Performs the conversion.

The resulting type after applying the & operator.

Performs the & operation. Read more

The resulting type after applying the & operator.

Performs the & operation. Read more

The resulting type after applying the | operator.

Performs the | operation. Read more

The resulting type after applying the | operator.

Performs the | operation. Read more

Aggregate the sum of the ChunkedArray. Returns None if the array is empty or only contains null values. Read more

Returns the maximum value in the array, according to the natural order. Returns None if the array is empty or only contains null values. Read more

Returns the mean value in the array. Returns None if the array is empty or only contains null values. Read more

Returns the mean value in the array. Returns None if the array is empty or only contains null values. Read more

Aggregate a given quantile of the ChunkedArray. Returns None if the array is empty or only contains null values. Read more

Aggregate the sum of the ChunkedArray. Returns None if the array is empty or only contains null values. Read more

Returns the maximum value in the array, according to the natural order. Returns None if the array is empty or only contains null values. Read more

Returns the mean value in the array. Returns None if the array is empty or only contains null values. Read more

Returns the mean value in the array. Returns None if the array is empty or only contains null values. Read more

Aggregate a given quantile of the ChunkedArray. Returns None if the array is empty or only contains null values. Read more

Aggregate the sum of the ChunkedArray. Returns None if the array is empty or only contains null values. Read more

Returns the maximum value in the array, according to the natural order. Returns None if the array is empty or only contains null values. Read more

Returns the mean value in the array. Returns None if the array is empty or only contains null values. Read more

Returns the mean value in the array. Returns None if the array is empty or only contains null values. Read more

Aggregate a given quantile of the ChunkedArray. Returns None if the array is empty or only contains null values. Read more

Booleans are casted to 1 or 0.

Returns None if the array is empty or only contains null values.

Returns the maximum value in the array, according to the natural order. Returns None if the array is empty or only contains null values. Read more

Returns the mean value in the array. Returns None if the array is empty or only contains null values. Read more

Returns the mean value in the array. Returns None if the array is empty or only contains null values. Read more

Aggregate a given quantile of the ChunkedArray. Returns None if the array is empty or only contains null values. Read more

Get the sum of the ChunkedArray as a new Series of length 1.

Get the max of the ChunkedArray as a new Series of length 1.

Get the min of the ChunkedArray as a new Series of length 1.

Get the mean of the ChunkedArray as a new Series of length 1.

Get the median of the ChunkedArray as a new Series of length 1.

Get the quantile of the ChunkedArray as a new Series of length 1.

Get the sum of the ChunkedArray as a new Series of length 1.

Get the max of the ChunkedArray as a new Series of length 1.

Get the min of the ChunkedArray as a new Series of length 1.

Get the mean of the ChunkedArray as a new Series of length 1.

Get the median of the ChunkedArray as a new Series of length 1.

Get the quantile of the ChunkedArray as a new Series of length 1.

Get the sum of the ChunkedArray as a new Series of length 1.

Get the max of the ChunkedArray as a new Series of length 1.

Get the min of the ChunkedArray as a new Series of length 1.

Get the mean of the ChunkedArray as a new Series of length 1.

Get the median of the ChunkedArray as a new Series of length 1.

Get the quantile of the ChunkedArray as a new Series of length 1.

Get the sum of the ChunkedArray as a new Series of length 1.

Get the max of the ChunkedArray as a new Series of length 1.

Get the min of the ChunkedArray as a new Series of length 1.

Get the mean of the ChunkedArray as a new Series of length 1.

Get the median of the ChunkedArray as a new Series of length 1.

Get the quantile of the ChunkedArray as a new Series of length 1.

Get the sum of the ChunkedArray as a new Series of length 1.

Get the max of the ChunkedArray as a new Series of length 1.

Get the min of the ChunkedArray as a new Series of length 1.

Get the mean of the ChunkedArray as a new Series of length 1.

Get the median of the ChunkedArray as a new Series of length 1.

Get the quantile of the ChunkedArray as a new Series of length 1.

Get the sum of the ChunkedArray as a new Series of length 1.

Get the max of the ChunkedArray as a new Series of length 1.

Get the min of the ChunkedArray as a new Series of length 1.

Get the mean of the ChunkedArray as a new Series of length 1.

Get the median of the ChunkedArray as a new Series of length 1.

Get the quantile of the ChunkedArray as a new Series of length 1.

Get a single value. Beware this is slow. If you need to use this slightly performant, cast Categorical to UInt32 Read more

Get a single value. Beware this is slow.

Get a single value. Beware this is slow. If you need to use this slightly performant, cast Categorical to UInt32 Read more

Get a single value. Beware this is slow.

Get a single value. Beware this is slow. If you need to use this slightly performant, cast Categorical to UInt32 Read more

Get a single value. Beware this is slow.

Get a single value. Beware this is slow. If you need to use this slightly performant, cast Categorical to UInt32 Read more

Get a single value. Beware this is slow.

Get a single value. Beware this is slow. If you need to use this slightly performant, cast Categorical to UInt32 Read more

Get a single value. Beware this is slow.

Get a single value. Beware this is slow. If you need to use this slightly performant, cast Categorical to UInt32 Read more

Get a single value. Beware this is slow.

Apply a closure elementwise and cast to a Numeric ChunkedArray. This is fastest when the null check branching is more expensive than the closure application. Read more

Apply a closure on optional values and cast to Numeric ChunkedArray without null values.

Apply a closure elementwise. This is fastest when the null check branching is more expensive than the closure application. Often it is. Read more

Apply a closure elementwise including null values.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise and write results to a mutable slice.

Apply a closure elementwise and cast to a Numeric ChunkedArray. This is fastest when the null check branching is more expensive than the closure application. Read more

Apply a closure on optional values and cast to Numeric ChunkedArray without null values.

Apply a closure elementwise. This is fastest when the null check branching is more expensive than the closure application. Often it is. Read more

Apply a closure elementwise including null values.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise and write results to a mutable slice.

Apply a closure elementwise and cast to a Numeric ChunkedArray. This is fastest when the null check branching is more expensive than the closure application. Read more

Apply a closure on optional values and cast to Numeric ChunkedArray without null values.

Apply a closure elementwise. This is fastest when the null check branching is more expensive than the closure application. Often it is. Read more

Apply a closure elementwise including null values.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise and write results to a mutable slice.

Apply a closure F elementwise.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise and cast to a Numeric ChunkedArray. This is fastest when the null check branching is more expensive than the closure application. Read more

Apply a closure on optional values and cast to Numeric ChunkedArray without null values.

Apply a closure elementwise including null values.

Apply a closure elementwise and write results to a mutable slice.

Apply a closure elementwise and cast to a Numeric ChunkedArray. This is fastest when the null check branching is more expensive than the closure application. Read more

Apply a closure on optional values and cast to Numeric ChunkedArray without null values.

Apply a closure elementwise. This is fastest when the null check branching is more expensive than the closure application. Often it is. Read more

Apply a closure elementwise including null values.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise. The closure gets the index of the element as first argument.

Apply a closure elementwise and write results to a mutable slice.

Apply kernel and return result as a new ChunkedArray.

Apply a kernel that outputs an array of different type.

Apply kernel and return result as a new ChunkedArray.

Apply a kernel that outputs an array of different type.

Apply kernel and return result as a new ChunkedArray.

Apply a kernel that outputs an array of different type.

Cast ChunkedArray<T> to ChunkedArray<N>

We cannot cast anything to or from List/LargeList So this implementation casts the inner type

Cast ChunkedArray<T> to ChunkedArray<N>

Cast ChunkedArray<T> to ChunkedArray<N>

Cast ChunkedArray<T> to ChunkedArray<N>

Cast ChunkedArray<T> to ChunkedArray<N>

Check for equality and regard missing values as equal.

Check for equality.

Check for inequality.

Greater than comparison.

Greater than or equal comparison.

Less than comparison.

Less than or equal comparison

Check for equality and regard missing values as equal.

Check for equality.

Check for inequality.

Greater than comparison.

Greater than or equal comparison.

Less than comparison.

Less than or equal comparison

Check for equality and regard missing values as equal.

Check for equality.

Check for inequality.

Greater than comparison.

Greater than or equal comparison.

Less than comparison.

Less than or equal comparison

Check for equality and regard missing values as equal.

Check for equality.

Check for inequality.

Greater than comparison.

Greater than or equal comparison.

Less than comparison.

Less than or equal comparison

Check for equality and regard missing values as equal.

Check for equality.

Check for inequality.

Greater than comparison.

Greater than or equal comparison.

Less than comparison.

Less than or equal comparison

Check for equality and regard missing values as equal.

Check for equality.

Check for inequality.

Greater than comparison.

Greater than or equal comparison.

Less than comparison.

Less than or equal comparison

Get an array with the cumulative max computed at every element

Get an array with the cumulative min computed at every element

Get an array with the cumulative sum computed at every element

Get an array with the cumulative max computed at every element

Get an array with the cumulative min computed at every element

Get an array with the cumulative sum computed at every element

Get an array with the cumulative max computed at every element

Get an array with the cumulative min computed at every element

Get an array with the cumulative sum computed at every element

Get an array with the cumulative max computed at every element

Get an array with the cumulative min computed at every element

Get an array with the cumulative sum computed at every element

Get an array with the cumulative max computed at every element

Get an array with the cumulative min computed at every element

Get an array with the cumulative sum computed at every element

Get an array with the cumulative max computed at every element

Get an array with the cumulative min computed at every element

Get an array with the cumulative sum computed at every element

Create a new ChunkedArray filled with values at that index.

Create a new ChunkedArray filled with values at that index.

Create a new ChunkedArray filled with values at that index.

Create a new ChunkedArray filled with values at that index.

Create a new ChunkedArray filled with values at that index.

Create a new ChunkedArray filled with values at that index.

Replace None values with one of the following strategies: Read more

Replace None values with one of the following strategies: Read more

Replace None values with one of the following strategies: Read more

Replace None values with one of the following strategies: Read more

Replace None values with one of the following strategies: Read more

Replace None values with one of the following strategies: Read more

Replace None values with a give value T.

Replace None values with a give value T.

Replace None values with a give value T.

Replace None values with a give value T.

Replace None values with a give value T.

Filter values in the ChunkedArray with a boolean mask. Read more

Filter values in the ChunkedArray with a boolean mask. Read more

Filter values in the ChunkedArray with a boolean mask. Read more

Filter values in the ChunkedArray with a boolean mask. Read more

Filter values in the ChunkedArray with a boolean mask. Read more

Filter values in the ChunkedArray with a boolean mask. Read more

Create a ChunkedArray with a single value.

Create a ChunkedArray with a single value.

Create a ChunkedArray with a single value.

Create a ChunkedArray with a single value.

Aggregate to contiguous memory.

Aggregate to contiguous memory.

Aggregate to contiguous memory.

Aggregate to contiguous memory.

Aggregate to contiguous memory.

Aggregate to contiguous memory.

Get a boolean mask of the local maximum peaks.

Get a boolean mask of the local minimum peaks.

Get a boolean mask of the local maximum peaks.

Get a boolean mask of the local minimum peaks.

Get a boolean mask of the local maximum peaks.

Get a boolean mask of the local minimum peaks.

Get a boolean mask of the local maximum peaks.

Get a boolean mask of the local minimum peaks.

Get a boolean mask of the local maximum peaks.

Get a boolean mask of the local minimum peaks.

Get a boolean mask of the local maximum peaks.

Get a boolean mask of the local minimum peaks.

Return a reversed version of this array.

Return a reversed version of this array.

Return a reversed version of this array.

Return a reversed version of this array.

Return a reversed version of this array.

Return a reversed version of this array.

Set the values at indexes idx to some optional value Option<T>. Read more

Set the values at indexes idx by applying a closure to these values. Read more

Set the values where the mask evaluates to true to some optional value Option<T>. Read more

Set the values where the mask evaluates to true by applying a closure to these values. Read more

Set the values at indexes idx to some optional value Option<T>. Read more

Set the values at indexes idx by applying a closure to these values. Read more

Set the values where the mask evaluates to true to some optional value Option<T>. Read more

Set the values where the mask evaluates to true by applying a closure to these values. Read more

Set the values at indexes idx to some optional value Option<T>. Read more

Set the values at indexes idx by applying a closure to these values. Read more

Set the values where the mask evaluates to true to some optional value Option<T>. Read more

Set the values where the mask evaluates to true by applying a closure to these values. Read more

Shift the values by a given period and fill the parts that will be empty due to this operation with fill_value. Read more

Shift the values by a given period and fill the parts that will be empty due to this operation with fill_value. Read more

Shift the values by a given period and fill the parts that will be empty due to this operation with fill_value. Read more

Shift the values by a given period and fill the parts that will be empty due to this operation with fill_value. Read more

Shift the values by a given period and fill the parts that will be empty due to this operation with fill_value. Read more

Returned a sorted ChunkedArray.

Sort this array in place.

Retrieve the indexes needed to sort this array.

Retrieve the indexes need to sort this and the other arrays.

Returned a sorted ChunkedArray.

Sort this array in place.

Retrieve the indexes needed to sort this array.

Retrieve the indexes need to sort this and the other arrays.

Returned a sorted ChunkedArray.

Sort this array in place.

Retrieve the indexes needed to sort this array.

Retrieve the indexes need to sort this and the other arrays.

Returned a sorted ChunkedArray.

Sort this array in place.

Retrieve the indexes needed to sort this array.

Retrieve the indexes need to sort this and the other arrays.

Panics

This function is very opinionated. We assume that all numeric Series are of the same type, if not it will panic

Returned a sorted ChunkedArray.

Sort this array in place.

Retrieve the indexes needed to sort this array.

Panics

This function is very opinionated. On the implementation of ChunkedArray<T> for numeric types, we assume that all numeric Series are of the same type.

In this case we assume that all numeric Series are f64 types. The caller needs to uphold this contract. If not, it will panic.

Returned a sorted ChunkedArray.

Sort this array in place.

Retrieve the indexes needed to sort this array.

Take values from ChunkedArray by index. Read more

Take values from ChunkedArray by index. Note that the iterator will be cloned, so prefer an iterator that takes the owned memory by reference. Read more

Take values from ChunkedArray by index. Read more

Take values from ChunkedArray by index. Note that the iterator will be cloned, so prefer an iterator that takes the owned memory by reference. Read more

Take values from ChunkedArray by index. Read more

Take values from ChunkedArray by index. Note that the iterator will be cloned, so prefer an iterator that takes the owned memory by reference. Read more

Take values from ChunkedArray by index. Read more

Take values from ChunkedArray by index. Note that the iterator will be cloned, so prefer an iterator that takes the owned memory by reference. Read more

Take values from ChunkedArray by index. Read more

Take values from ChunkedArray by index. Note that the iterator will be cloned, so prefer an iterator that takes the owned memory by reference. Read more

Take values from ChunkedArray by index. Read more

Take values from ChunkedArray by index. Note that the iterator will be cloned, so prefer an iterator that takes the owned memory by reference. Read more

Traverse and collect every nth element in a new array.

Traverse and collect every nth element in a new array.

Traverse and collect every nth element in a new array.

Traverse and collect every nth element in a new array.

Traverse and collect every nth element in a new array.

Traverse and collect every nth element in a new array.

Get unique values of a ChunkedArray

Get first index of the unique values in a ChunkedArray. This Vec is sorted. Read more

Get a mask of all the unique values.

Get a mask of all the duplicated values.

Number of unique values in the ChunkedArray

Count the unique values.

The most occurring value(s). Can return multiple Values

Get unique values of a ChunkedArray

Get first index of the unique values in a ChunkedArray. This Vec is sorted. Read more

Get a mask of all the unique values.

Get a mask of all the duplicated values.

Count the unique values.

Number of unique values in the ChunkedArray

The most occurring value(s). Can return multiple Values

Get unique values of a ChunkedArray

Get first index of the unique values in a ChunkedArray. This Vec is sorted. Read more

Get a mask of all the unique values.

Get a mask of all the duplicated values.

Count the unique values.

Number of unique values in the ChunkedArray

The most occurring value(s). Can return multiple Values

Get unique values of a ChunkedArray

Get first index of the unique values in a ChunkedArray. This Vec is sorted. Read more

Get a mask of all the unique values.

Get a mask of all the duplicated values.

Count the unique values.

Number of unique values in the ChunkedArray

The most occurring value(s). Can return multiple Values

Get unique values of a ChunkedArray

Get first index of the unique values in a ChunkedArray. This Vec is sorted. Read more

Number of unique values in the ChunkedArray

Get a mask of all the unique values.

Get a mask of all the duplicated values.

Count the unique values.

The most occurring value(s). Can return multiple Values

Get unique values of a ChunkedArray

Get first index of the unique values in a ChunkedArray. This Vec is sorted. Read more

Number of unique values in the ChunkedArray

Get a mask of all the unique values.

Get a mask of all the duplicated values.

Count the unique values.

The most occurring value(s). Can return multiple Values

Get unique values of a ChunkedArray

Get first index of the unique values in a ChunkedArray. This Vec is sorted. Read more

Get a mask of all the unique values.

Get a mask of all the duplicated values.

Count the unique values.

Number of unique values in the ChunkedArray

The most occurring value(s). Can return multiple Values

Get unique values of a ChunkedArray

Get first index of the unique values in a ChunkedArray. This Vec is sorted. Read more

Get a mask of all the unique values.

Get a mask of all the duplicated values.

Count the unique values.

Number of unique values in the ChunkedArray

The most occurring value(s). Can return multiple Values

Compute the variance of this ChunkedArray/Series.

Compute the standard deviation of this ChunkedArray/Series.

Compute the variance of this ChunkedArray/Series.

Compute the standard deviation of this ChunkedArray/Series.

Compute the variance of this ChunkedArray/Series.

Compute the standard deviation of this ChunkedArray/Series.

Compute the variance of this ChunkedArray/Series.

Compute the standard deviation of this ChunkedArray/Series.

Compute the variance of this ChunkedArray/Series.

Compute the standard deviation of this ChunkedArray/Series.

Compute the variance of this ChunkedArray/Series.

Compute the standard deviation of this ChunkedArray/Series.

Compute the variance of this ChunkedArray/Series.

Compute the standard deviation of this ChunkedArray/Series.

Compute the variance of this ChunkedArray/Series.

Compute the standard deviation of this ChunkedArray/Series.

apply a rolling sum (moving sum) over the values in this array. a window of length window_size will traverse the array. the values that fill this window will (optionally) be multiplied with the weights given by the weight vector. the resulting values will be aggregated to their sum. Read more

Apply a rolling mean (moving mean) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their mean. Read more

Apply a rolling min (moving min) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their min. Read more

Apply a rolling max (moving max) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their max. Read more

apply a rolling sum (moving sum) over the values in this array. a window of length window_size will traverse the array. the values that fill this window will (optionally) be multiplied with the weights given by the weight vector. the resulting values will be aggregated to their sum. Read more

Apply a rolling mean (moving mean) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their mean. Read more

Apply a rolling min (moving min) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their min. Read more

Apply a rolling max (moving max) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their max. Read more

apply a rolling sum (moving sum) over the values in this array. a window of length window_size will traverse the array. the values that fill this window will (optionally) be multiplied with the weights given by the weight vector. the resulting values will be aggregated to their sum. Read more

Apply a rolling mean (moving mean) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their mean. Read more

Apply a rolling min (moving min) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their min. Read more

Apply a rolling max (moving max) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their max. Read more

apply a rolling sum (moving sum) over the values in this array. a window of length window_size will traverse the array. the values that fill this window will (optionally) be multiplied with the weights given by the weight vector. the resulting values will be aggregated to their sum. Read more

Apply a rolling mean (moving mean) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their mean. Read more

Apply a rolling min (moving min) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their min. Read more

Apply a rolling max (moving max) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their max. Read more

apply a rolling sum (moving sum) over the values in this array. a window of length window_size will traverse the array. the values that fill this window will (optionally) be multiplied with the weights given by the weight vector. the resulting values will be aggregated to their sum. Read more

Apply a rolling mean (moving mean) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their mean. Read more

Apply a rolling min (moving min) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their min. Read more

Apply a rolling max (moving max) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their max. Read more

apply a rolling sum (moving sum) over the values in this array. a window of length window_size will traverse the array. the values that fill this window will (optionally) be multiplied with the weights given by the weight vector. the resulting values will be aggregated to their sum. Read more

Apply a rolling mean (moving mean) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their mean. Read more

Apply a rolling min (moving min) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their min. Read more

Apply a rolling max (moving max) over the values in this array. A window of length window_size will traverse the array. The values that fill this window will (optionally) be multiplied with the weights given by the weight vector. The resulting values will be aggregated to their max. Read more

This is similar to how rolling_min, sum, max, mean is implemented. It takes a window, weights it and applies a fold aggregator

Apply a rolling aggregation over the values in this array. Read more

Create a new ChunkedArray with values from self where the mask evaluates true and values from other where the mask evaluates false Read more

Create a new ChunkedArray with values from self where the mask evaluates true and values from other where the mask evaluates false Read more

Create a new ChunkedArray with values from self where the mask evaluates true and values from other where the mask evaluates false Read more

Create a new ChunkedArray with values from self where the mask evaluates true and values from other where the mask evaluates false Read more

Create a new ChunkedArray with values from self where the mask evaluates true and values from other where the mask evaluates false Read more

Create a new ChunkedArray with values from self where the mask evaluates true and values from other where the mask evaluates false Read more

Returns a copy of the value. Read more

Performs copy-assignment from source. Read more

Formats the value using the given formatter. Read more

Formats the value using the given formatter. Read more

Formats the value using the given formatter. Read more

Formats the value using the given formatter. Read more

Formats the value using the given formatter. Read more

Formats the value using the given formatter. Read more

Returns the “default value” for a type. Read more

The resulting type after dereferencing.

Dereferences the value.

Mutably dereferences the value.

The resulting type after applying the / operator.

Performs the / operation. Read more

The resulting type after applying the / operator.

Performs the / operation. Read more

The resulting type after applying the / operator.

Performs the / operation. Read more

The resulting type after applying the / operator.

Performs the / operation. Read more

Conversion from UInt32Chunked to Unchecked TakeIdx

Performs the conversion.

Performs the conversion.

Performs the conversion.

Performs the conversion.

Creates a value from an iterator. Read more

FromIterator trait

Creates a value from an iterator. Read more

Creates a value from an iterator. Read more

Creates a value from an iterator. Read more

Creates a value from an iterator. Read more

Creates a value from an iterator. Read more

Creates a value from an iterator. Read more

Creates a value from an iterator. Read more

Creates a value from an iterator. Read more

Creates an instance of the collection from the parallel iterator par_iter. Read more

Creates an instance of the collection from the parallel iterator par_iter. Read more

Creates an instance of the collection from the parallel iterator par_iter. Read more

Creates an instance of the collection from the parallel iterator par_iter. Read more

Create the tuples need for a groupby operation. * The first value in the tuple is the first index of the group. * The second value in the tuple is are the indexes of the groups including the first value. Read more

Create the tuples need for a groupby operation. * The first value in the tuple is the first index of the group. * The second value in the tuple is are the indexes of the groups including the first value. Read more

Create the tuples need for a groupby operation. * The first value in the tuple is the first index of the group. * The second value in the tuple is are the indexes of the groups including the first value. Read more

Create the tuples need for a groupby operation. * The first value in the tuple is the first index of the group. * The second value in the tuple is are the indexes of the groups including the first value. Read more

Create the tuples need for a groupby operation. * The first value in the tuple is the first index of the group. * The second value in the tuple is are the indexes of the groups including the first value. Read more

Create the tuples need for a groupby operation. * The first value in the tuple is the first index of the group. * The second value in the tuple is are the indexes of the groups including the first value. Read more

The type of the elements being iterated over.

Which kind of iterator are we turning this into?

Creates an iterator from a value. Read more

The type of the elements being iterated over.

Which kind of iterator are we turning this into?

Creates an iterator from a value. Read more

The type of the elements being iterated over.

Which kind of iterator are we turning this into?

Creates an iterator from a value. Read more

The type of the elements being iterated over.

Which kind of iterator are we turning this into?

Creates an iterator from a value. Read more

The type of the elements being iterated over.

Which kind of iterator are we turning this into?

Creates an iterator from a value. Read more

The type of the elements being iterated over.

Which kind of iterator are we turning this into?

Creates an iterator from a value. Read more

Create a type that implements TakeRandom.

Create a type that implements TakeRandom.

Create a type that implements TakeRandom.

Create a type that implements TakeRandom.

Create a type that implements TakeRandom.

Check if elements of this array are in the right Series, or List values of the right Series.

Check if elements of this array are in the right Series, or List values of the right Series.

Check if elements of this array are in the right Series, or List values of the right Series.

Check if elements of this array are in the right Series, or List values of the right Series.

Check if elements of this array are in the right Series, or List values of the right Series.

The resulting type after applying the * operator.

Performs the * operation. Read more

The resulting type after applying the * operator.

Performs the * operation. Read more

The resulting type after applying the * operator.

Performs the * operation. Read more

The resulting type after applying the * operator.

Performs the * operation. Read more

Create a new ChunkedArray from an iterator.

Create a new ChunkedArray from an iterator.

Create a new ChunkedArray from an iterator.

Create a new ChunkedArray from an iterator.

Create a new ChunkedArray from an iterator.

Create a new ChunkedArray from an iterator.

Create a new ChunkedArray from an iterator.

Create a new ChunkedArray from an iterator.

The resulting type after applying the ! operator.

Performs the unary ! operation. Read more

The resulting type after applying the ! operator.

Performs the unary ! operation. Read more

Checked integer division. Computes self / rhs, returning None if rhs == 0 or the division results in overflow.

Checked integer division. Computes self / rhs, returning None if rhs == 0 or the division results in overflow.

Checked integer division. Computes self / rhs, returning None if rhs == 0 or the division results in overflow.

Checked integer division. Computes self / rhs, returning None if rhs == 0 or the division results in overflow.

Checked integer division. Computes self / rhs, returning None if rhs == 0 or the division results in overflow.

Checked integer division. Computes self / rhs, returning None if rhs == 0 or the division results in overflow.

Checked integer division. Computes self / rhs, returning None if rhs == 0 or the division results in overflow.

The resulting type after applying the % operator.

Performs the % operation. Read more

The resulting type after applying the % operator.

Performs the % operation. Read more

The resulting type after applying the % operator.

Performs the % operation. Read more

The resulting type after applying the % operator.

Performs the % operation. Read more

Repeat the values n times, where n is determined by the values in by.

Repeat the values n times, where n is determined by the values in by.

Repeat the values n times, where n is determined by the values in by.

Repeat the values n times, where n is determined by the values in by.

Repeat the values n times, where n is determined by the values in by.

Repeat the values n times, where n is determined by the values in by.

The resulting type after applying the - operator.

Performs the - operation. Read more

The resulting type after applying the - operator.

Performs the - operation. Read more

The resulting type after applying the - operator.

Performs the - operation. Read more

The resulting type after applying the - operator.

Performs the - operation. Read more

Get a nullable value by index. Read more

Get a value by index and ignore the null bit. Read more

Get a nullable value by index. Read more

Get a value by index and ignore the null bit. Read more

Get a nullable value by index. Read more

Get a value by index and ignore the null bit. Read more

Get a nullable value by index. Read more

Get a value by index and ignore the null bit. Read more

Get a nullable value by index. Read more

Get a value by index and ignore the null bit. Read more

Get a nullable value by index. Read more

Get a value by index and ignore the null bit. Read more

Get a nullable value by index. Read more

Get a value by index and ignore the null bit. Read more

Get a nullable value by index. Read more

Get a value by index and ignore the null bit. Read more

Useful for a Utf8 or a List to get underlying value size. During a rechunk this is handy Read more

Useful for a Utf8 or a List to get underlying value size. During a rechunk this is handy Read more

Get the variance of the ChunkedArray as a new Series of length 1.

Get the standard deviation of the ChunkedArray as a new Series of length 1.

Get the variance of the ChunkedArray as a new Series of length 1.

Get the standard deviation of the ChunkedArray as a new Series of length 1.

Get the variance of the ChunkedArray as a new Series of length 1.

Get the standard deviation of the ChunkedArray as a new Series of length 1.

Get the variance of the ChunkedArray as a new Series of length 1.

Get the standard deviation of the ChunkedArray as a new Series of length 1.

Get the variance of the ChunkedArray as a new Series of length 1.

Get the standard deviation of the ChunkedArray as a new Series of length 1.

Get the variance of the ChunkedArray as a new Series of length 1.

Get the standard deviation of the ChunkedArray as a new Series of length 1.

Get the variance of the ChunkedArray as a new Series of length 1.

Get the standard deviation of the ChunkedArray as a new Series of length 1.

Get the variance of the ChunkedArray as a new Series of length 1.

Get the standard deviation of the ChunkedArray as a new Series of length 1.

Compute the hash for all values in the array. Read more

Compute the hash for all values in the array. Read more

Compute the hash for all values in the array. Read more

Compute the hash for all values in the array. Read more

Compute the hash for all values in the array. Read more

Compute the hash for all values in the array. Read more

Compute the hash for all values in the array. Read more

Auto Trait Implementations

Blanket Implementations

Gets the TypeId of self. Read more

Immutably borrows from an owned value. Read more

Mutably borrows from an owned value. Read more

Performs the conversion.

Performs the conversion.

The alignment of pointer.

The type for initializers.

Initializes a with the given initializer. Read more

Dereferences the given pointer. Read more

Mutably dereferences the given pointer. Read more

Drops the object pointed to by the given pointer. Read more

The resulting type after obtaining ownership.

Creates owned data from borrowed data, usually by cloning. Read more

🔬 This is a nightly-only experimental API. (toowned_clone_into)

recently added

Uses borrowed data to replace owned data, usually by cloning. Read more

The type returned in the event of a conversion error.

Performs the conversion.

The type returned in the event of a conversion error.

Performs the conversion.