/
/Plum API
DocsSign in
Sign in
  • APIs
  • Generators
  • Stacks
  • Projects
  • Docs
  • History
  • Schema
Checked 12m ago · Updated 2mo ago
  • getList all seed datasets
  • getRetrieve a specific seed dataset by ID
  • postInsert or overwrite seed data by ID
  • postAdd a single pair to a dataset (creates new dataset if the system_prompt_template that's provided doesn't correspond to an existing dataset)
  • postAdd a single pair to an existing seed dataset by ID
  • postUpload a new seed dataset
  • getList all synthetic datasets
  • getRetrieve synthetic data by ID
  • putInsert or overwrite synthetic data by ID
  • postUpload new synthetic data
  • getRetrieve synthetic data formatted for OpenAI by ID
  • getGet a specific metric definition by ID
  • getGet a specific evaluation result by ID
  • getExport evaluation results as TSV file
  • putUpdate evaluation result with human feedback
  • postGenerate evaluation metrics
  • getList all available evaluation metrics
  • getList all available evaluation results
  • postCreate custom metric definitions
  • postEvaluate datasets with specified metrics
  • postAugment seed data to generate synthetic data
  • getGather high-scoring and positively critiqued pairs from evaluation results
  • getGather high-scoring and positively critiqued pairs formatted for OpenAI fine-tuning
  • postCompare multiple prompts against a dataset
  • postGenerate an improved prompt based on comparison results

Gather high-scoring and positively critiqued pairs formatted for OpenAI fine-tuning

get/gather_openai/{id}

Path parameters

idstring required

ID of the evaluation results to gather pairs from

Response

Successfully gathered pairs in OpenAI JSONL format

Changes