Enum Calibration 

pub enum Calibration {
    Classifier,
    LanguageModel,
}

Which family of numbers an adapter’s probabilities come from.

Calibration is not portable: a 0.8 from a purpose-trained classifier and a 0.8 elicited from a general language model are different numbers, and a threshold tuned against one is wrong against the other. A module that thresholds on Answer::confidence states in its own docs which Calibration its threshold was tuned against — swapping the adapter re-tunes every threshold downstream of it.

Variants

Classifier

Numbers from a model trained to classify: the probabilities are the model’s own outputs, tuned on labelled data.

LanguageModel

Numbers elicited from a general language model — asked to rate its own certainty, or read off token log-probs. A different sharpness at the same number than Calibration::Classifier, and it drifts with the model version.

Implementations

impl Calibration

pub fn name(&self) -> &'static str

The name used in errors and logs.

Trait Implementations

impl Clone for Calibration

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Calibration

impl Debug for Calibration

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Calibration

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for Calibration

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for Calibration

impl Hash for Calibration

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for Calibration

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for Calibration

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Calibration