Sign in
Benchmark
HuggingFaceSync

Returns the HuggingFace sync status of the benchmark.

The repo and outcome fields are null when the benchmark has never been synced; isUpToDate and pendingRunCount are always set.

get/benchmark/{benchmarkId}/huggingface-sync

Path parameters

benchmarkIdstring required

The id of the benchmark whose sync status to return.

Response

OK

status'NeverSynced' | 'Exporting' | 'Uploading' | 'Completed' | 'Failed' required
isUpToDateboolean required

Whether the HuggingFace dataset covers every completed run of the benchmark — a successful sync exists and no completed run is pending export. Always false when the benchmark has never been synced.

pendingRunCountinteger required

Number of completed runs not yet exported to the HuggingFace dataset. Runs carried by an in-progress sync stay pending until that sync succeeds.

outcome'CreatedPrivate' | 'UpdatedPrivate' | 'OpenedPullRequest' | 'Failed' | 'null' nullable

Outcome of the last completed attempt, or null when none has completed.

repoIdstring nullable

The target HuggingFace repo id (e.g. Rapidata/svg-benchmark), or null.

repoUrlstring nullable

URL of the HuggingFace repo, or null when not yet known.

prUrlstring nullable

URL of the review pull request opened by the last attempt, or null.

lastSyncedAtstring date-time nullable

When the benchmark was last successfully synced, or null.

lastErrorstring nullable

The error from the last failed attempt, or null.

Changes