FAfastino-ai
training

Sample from an interactive training job

Changed on

Generate continuations of a tokenized prompt with one of the job's sampler checkpoints, also after the job stopped (Tinker's sample). Read the result at GET /v1/training/jobs/{job_id}/futures/{future_id}.

post/v1/training/jobs/{job_id}/sample

Request

Path parameters

job_idstring required

Headers

Idempotency-Keystring nullable

Client-generated key (a UUID is ideal; it must be URL-safe to look it up) that makes the call safe to send again after a lost response. A repeat with the same key and body from the same caller returns the first call's answer (the same job and future) without running or billing it again, or a 409 while the first call still runs; the same key with another route, job, body or caller is a 422. Look a key up with GET /v1/training/operations/{idempotency_key}.

Request body

checkpointstring required

The sampler checkpoint's name, or its tinker://<job_id>/sampler_weights/<name> path (this job's own).

num_samplesinteger
prompt_logprobsboolean
prompt_tokensinteger[] required
topk_prompt_logprobsinteger
topk_sample_logprobsinteger

Response

Successful Response

future_idstring required
job_idstring required
typestring required

The call: create, load, forward, forward_backward, optim_step, save, sample.

Changes