List of all items
Structs
- evaluate::Diff
- evaluate::GoldLine
- evaluate::Metrics
- evaluate::PredictionLine
- evaluate::ReliabilityBin
- evaluate::Report
- evaluate::Sample
- evaluate::VerifyOutcome
- perturb::FlipReport
- perturb::FlipRow
- prompt::BinarySlots
- prompt::ChatMessage
- prompt::ChatTemplate
- prompt::LocalComponents
- prompt::RuntimeClient
- readout::Probe
- readout::ProbeResult
- readout::ReadoutCheck
- render::LocalRenderer
- server::AppState
- server::Bridge
- server::BridgeConfig
- server::DetailedScore
- server::UpstreamStatus
- strategy::Candidate
- strategy::CompletionResponse
- strategy::LlamaCppCompletionRequest
- strategy::OpenAiCompletionRequest
- tokenizer::LocalTokenizer
- wire::FastjevMeta
- wire::OrderedMap
- wire::Question
- wire::QuestionSpec
- wire::ReadoutStatus
- wire::RequestBatch
- wire::Row
- wire::RowOption
- wire::ScoredAnswer
- wire::SystemOneResponse
- wire::Usage
- wire::WireError
Enums
- perturb::Perturbation
- server::Scoring
- strategy::Probe
- strategy::PromptField
- strategy::RequestBody
- wire::Answer
- wire::ConfidenceMethod
- wire::Kind
Functions
- evaluate::evaluate
- evaluate::join
- evaluate::load_gold
- evaluate::load_predictions
- evaluate::render_table
- evaluate::summarize
- evaluate::verify
- perturb::run
- prompt::binary_messages
- prompt::direct_messages
- prompt::direct_messages_reusing
- prompt::evidence_json
- prompt::prompt_sha256
- prompt::softmax
- readout::outcome
- readout::questions
- server::post_json
- server::router
- strategy::build_body
- strategy::build_body_with_candidates
- strategy::candidate_ladder
- strategy::candidates_restricted_to
- strategy::input_tokens
- strategy::parse_batch_candidates
- strategy::parse_candidates
- strategy::parse_logprobs
- strategy::parse_response
- strategy::request_url
- strategy::slot_logprobs_from_candidates
- strategy::truncated
- strategy::validate_probe
- wire::distribution_confidence
- wire::max_probability_confidence
- wire::request_batch
- wire::response_from_results
- wire::to_python_json
Constants
- evaluate::DEFAULT_BINS
- evaluate::NLL_PROBABILITY_FLOOR
- evaluate::REPORT_SCHEMA
- evaluate::UNLABELLED_FAMILY
- prompt::BINARY_PROMPT_VERSION
- prompt::BINARY_SYSTEM
- prompt::BINARY_WORDS
- prompt::DIRECT_SYSTEM
- prompt::LETTERS
- prompt::PROMPT_VERSION
- readout::PROBES
- readout::PROBE_STATE
- strategy::CANDIDATES
- wire::CONFIDENCE_METHOD
- wire::CONFIDENCE_METHOD_MAX_PROBABILITY
- wire::MAX_OPTIONS
- wire::MAX_SCORE_LEVELS
- wire::PROBABILITY_STATUS
- wire::UNVALIDATED_READOUT