/
/Plum API
DocsSign in
Sign in
  • APIs
  • Generators
  • Stacks
  • Projects
  • Docs
  • History
  • Schema
Checked 28m ago · Updated 2mo ago
  • getList all seed datasets
  • getRetrieve a specific seed dataset by ID
  • postInsert or overwrite seed data by ID
  • postAdd a single pair to an existing seed dataset
  • postUpload a new seed dataset
  • getList all synthetic datasets
  • getRetrieve synthetic data by ID
  • putInsert or overwrite synthetic data by ID
  • postUpload new synthetic data
  • getRetrieve synthetic data formatted for OpenAI by ID
  • getGet a specific metric definition by ID
  • getGet a specific evaluation result by ID
  • postGenerate evaluation metrics
  • getList all available evaluation metrics
  • getList all available evaluation results
  • postCreate custom metric definitions
  • postEvaluate datasets with specified metrics
  • postAugment seed data to generate synthetic data
  • postCompare multiple prompts against a dataset
  • postGenerate an improved prompt based on comparison results

Evaluate datasets with specified metrics

post/evaluate

Request body

seed_data_idstring required
metrics_idstring required

Response

Evaluation successfully completed

eval_results_idstring

Changes