Elements

Find the element a query describes among the given UI elements.

Answers with one of the request's element ids, or not found; never a point.

post/api/v1/elements:locate

Request

Request body

imagestring nullable

Optional base64 screenshot (PNG or JPEG) the element bounds are in

modelstring nullable

VLM model to use; must be one of the models from GET /models. Omit to use the server's configured default.

querystring required

Natural-language target description

Response

Successful Response

cache_read_tokensinteger

Prompt tokens read from cache

cache_write_tokensinteger

Prompt tokens written to cache

completion_tokensinteger

Completion (output) tokens the model billed for this call

confidencenumber required

Model self-reported confidence

cost_microdollarsinteger required

Provider-reported cost in microdollars

element_idstring nullable

The chosen element's id; null when not found

foundboolean required

Whether the model picked an element

latency_msinteger required

End-to-end VLM call latency

modelstring required

Model identifier returned by the provider

prompt_tokensinteger

Prompt (input) tokens the model billed for this call

Changes