Skip to main content

IpsReport

firstpass_proxy::ope

Struct IpsReport 

Source 
pub struct IpsReport {
Show 13 fields
    pub n_traces: usize,
    pub n_with_propensity: usize,
    pub candidate_start_rung: u32,
    pub ips_cost: f64,
    pub snips_cost: f64,
    pub ess: f64,
    pub ci_ips_cost: (f64, f64),
    pub ips_served_failure: Option<f64>,
    pub snips_served_failure: Option<f64>,
    pub n_correctness_known: usize,
    pub ci_ips_served_failure: Option<(f64, f64)>,
    pub dr_cost: f64,
    pub ci_dr_cost: (f64, f64),

}
Expand description

IPS, SNIPS, and doubly-robust (DR) estimates for evaluating a fixed candidate start-rung policy.

Valid only for traffic logged under a stochastic policy that recorded propensities via [escalation.exploration]. Traces without a propensity field are excluded and reported in n_with_propensity.

ponytail: per-context greedy identification is not exploited here (uniform-weight IPS suffices for population-level estimates).

Fields§

§n_traces: usize

Total traces in the store for this tenant.

§n_with_propensity: usize

Traces with propensity: Some(p > 0) — the IPS population.

§candidate_start_rung: u32

Candidate start rung being evaluated.

§ips_cost: f64

IPS (Horvitz-Thompson) estimate of mean cost under “always start at rung N”.

§snips_cost: f64

SNIPS (self-normalised IPS) estimate — lower variance, slightly biased.

§ess: f64

Effective sample size ESS = (Σwᵢ)² / Σwᵢ².

§ci_ips_cost: (f64, f64)

Bootstrap 95% CI (2.5/97.5 pct) for the IPS cost estimate.

§ips_served_failure: Option<f64>

IPS estimate of served-failure rate (traces with deferred feedback on logged rung N).

§snips_served_failure: Option<f64>

SNIPS estimate of served-failure rate.

§n_correctness_known: usize

Traces contributing to the failure-rate IPS estimate.

§ci_ips_served_failure: Option<(f64, f64)>

Bootstrap 95% CI for the IPS served-failure estimate.

§dr_cost: f64

Doubly-robust (DR) cost estimate: DM baseline + IPS residual correction.

DRᵢ = DM(xᵢ, N) + wᵢ · (rᵢ − DM(xᵢ, aᵢ)), mean over all propensity traces. Unbiased when either propensities or the reward model is correctly specified.

§ci_dr_cost: (f64, f64)

Bootstrap 95% CI (2.5/97.5 pct) for the DR cost estimate.

Implementations§

Source§

impl IpsReport

Source

pub fn render(&self) -> String

Render the report as human-readable lines.

Trait Implementations§

Source§

impl Clone for IpsReport

Source§

fn clone(&self) -> IpsReport

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for IpsReport

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> FromRef<T> for T
where T: Clone,

Source§

fn from_ref(input: &T) -> T

Converts to this type from a reference to the input type.
Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<Unshared, Shared> IntoShared<Shared> for Unshared
where Shared: FromUnshared<Unshared>,

Source§

fn into_shared(self) -> Shared

Creates a shared type from an unshared type.
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more