Re-exports§
pub use crate::types::responses::EasyInputMessage;pub use crate::types::responses::InputTextContent;pub use crate::types::responses::ReasoningEffort;
Structs§
- Create
Eval Completions RunData Source - Completions run data source.
- Create
Eval Custom Data Source Config - Create
Eval Custom Data Source Config Args - Builder for
CreateEvalCustomDataSourceConfig. - Create
Eval Jsonl RunData Source - JSONL run data source.
- Create
Eval Label Model Grader - Label model grader for creating an eval.
- Create
Eval Label Model Grader Args - Builder for
CreateEvalLabelModelGrader. - Create
Eval Logs Data Source Config - Logs data source config for creating an eval.
- Create
Eval Logs Data Source Config Args - Builder for
CreateEvalLogsDataSourceConfig. - Create
Eval Request - Create
Eval Request Args - Builder for
CreateEvalRequest. - Create
Eval Responses RunData Source - Responses run data source.
- Create
Eval RunRequest - Request to create an eval run.
- Create
Eval RunRequest Args - Builder for
CreateEvalRunRequest. - Delete
Eval Response - Response from deleting an eval.
- Delete
Eval RunResponse - Response from deleting an eval run.
- Eval
- An Eval object with a data source config and testing criteria. An Eval represents a task to be done for your LLM integration. Like:
- Eval
ApiError - An object representing an error response from the Eval API.
- Eval
Custom Data Source Config - Custom data source config.
- Eval
Grader Label Model - Label model grader.
- Eval
Grader Python - Python grader. also in openapi spec: GraderPython
- Eval
Grader Score Model - Score model grader. also in openapi spec: GraderScoreModel
- Eval
Grader String Check - String check grader.
- Eval
Grader Text Similarity - Text similarity grader.
- Eval
Item - Eval
Jsonl Content Item - JSONL content item.
- Eval
Jsonl File Content Source - JSONL file content source.
- Eval
Jsonl File IdSource - JSONL file ID source.
- Eval
List - List of evals.
- Eval
Logs Data Source Config - Logs data source config.
- Eval
Responses Sampling Params - Eval
Responses Source - A EvalResponsesSource object describing a run data source configuration.
- EvalRun
- A schema representing an evaluation run.
- Eval
RunList - List of eval runs.
- Eval
RunModel Usage - Usage statistics for each model during the evaluation run.
- Eval
RunOutput Item - A schema representing an evaluation run output item.
- Eval
RunOutput Item List - List of eval run output items.
- Eval
RunOutput Item Result - A single grader result for an evaluation run output item.
- Eval
RunOutput Item Sample - A sample containing the input and output of the evaluation run.
- Eval
RunOutput Item Usage - Token usage details for the sample.
- Eval
RunResult Counts - Counters summarizing the outcomes of the evaluation run.
- Eval
RunTesting Criteria Result - Results per testing criteria applied during the evaluation run.
- Eval
Sampling Params - Sampling parameters for the model.
- Eval
Stored Completions Data Source Config - Stored completions data source config (deprecated).
- Eval
Stored Completions Source - Stored completions source.
- Input
Image - Item
Reference - Output
Text - Sampling
Params - Simple
Input Message - Simple
Output Message - Template
Input Messages - Update
Eval Request - Request to update an eval.
- Update
Eval Request Args - Builder for
UpdateEvalRequest.
Enums§
- Create
Eval Data Source Config - Create
Eval Item - A chat message that makes up the prompt or context.
- Create
Eval RunData Source - Details about the run’s data source.
- Create
Eval Testing Criterion - Eval
Completions Source - Completions source.
- Eval
Data Source Config - Configuration of data sources used in runs of the evaluation.
- Eval
Input Messages - Input messages for completions.
- Eval
Item Content - Inputs to the model - can contain template strings.
- Eval
Item Role - The role of the message input.
- Eval
Jsonl Source - JSONL source.
- Eval
Responses RunSource - Responses source.
- Eval
RunData Source - Information about the run’s data source.
- Eval
RunStatus - Status of an evaluation run.
- Eval
Testing Criterion - A list of testing criteria.
- Text
Similarity Metric - Text similarity metric.