Benchmarks

Get Generated Benchmark

Retrieve complete benchmark data with all samples.

This endpoint returns the full benchmark dataset including all samples, their expected responses, and metadata. Use this to access the complete benchmark content for evaluation or review.

Path Parameters:

  • benchmark_id: Unique benchmark identifier

Returns:

  • benchmark_id: Benchmark identifier
  • document_ids: List of document IDs (single-element array for uploaded benchmarks, multiple elements for generated benchmarks)
  • samples: Full list of benchmark samples with their responses

Identity, status, and timestamps are served by GET /{benchmark_id}.

Raises:

  • 404: If benchmark not found or user doesn't have access

Example Request:

GET /api/v3/benchmarks/benchmark_01k4x9m2p7q3r6a1/data
Headers: {"Authorization": "Bearer <api_key>"}

Example Response:

{
  "benchmark_id": "benchmark_01k4x9m2p7q3r6a1",
  "document_ids": ["document_01k4x9m2p7q3r5se", "document_01k4x9m2p7q3r5sf"],
  "samples": [
    {
      "sample_num": 1,
      "instruction": "What is the main purpose of the product?",
      "response": "To provide real-time collaboration tools for distributed teams."
    },
    {
      "sample_num": 2,
      "instruction": "How does the authentication system work?",
      "response": "Uses OAuth 2.0 with JWT tokens for secure authentication."
    }
  ]
}

Notes:

  • Only returns benchmarks owned by the user
  • Contains complete sample data for evaluation
  • Use this endpoint when you need the full benchmark content (not just metadata)
get/api/v3/benchmarks/{benchmark_id}/data

Request

  • Base URL
    https://api.nugen.in
  • Auth
    HTTP bearer

Path parameters

benchmark_idstring required

ID of the benchmark, returned when it was created

Response

Returns the benchmark's samples. Identity, status, and timestamps are served by GET /{benchmark_id}.

benchmark_idstring required

Benchmark ID

document_idsstring[]

Document IDs used for generation

metadataobject nullable

Additional metadata

errorstring nullable

Error message if data fetch failed

Example response

{
  "benchmark_id": "benchmark_01k4x9m2p7q3r6a1",
  "document_ids": [
    "document_01k4x9m2p7q3r5s8",
    "document_01k4x9m2p7q3r5s9"
  ],
  "samples": [
    {
      "instruction": "Summarise the indemnity cap.",
      "response": "Liability is capped at twelve months of fees paid.",
      "sample_num": 1
    }
  ]
}

Changes

No recorded changes to this operation across all 1 revision of this API.