/
WI
windmill
/
Windmill API
Search skmtc…
⌘K
Docs
Sign in
Sign in
APIs
Generators
Stacks
Projects
Docs
History
Schema
Checked 21m ago · Updated 1d ago
Details
Filter operations
agent_workers
5
ai
2
ai_evals
14
get
list eval datasets
post
create an eval dataset
get
get an eval dataset
post
update an eval dataset
post
delete an eval dataset and all its cases
get
list the cases of an eval dataset
get
what the agent under test is right now
get
the run one iteration of an eval run answered, as its scorers read it
get
what a new judge agent and a new script scorer are created from
get
list the scorers already in use in this workspace, most recent first
post
run every case of a dataset as one immutable experiment
post
record what a run produced, so it outlives the jobs that produced it
get
list every experiment, across datasets
get
read an experiment's results, one row per case
amqp_trigger
8
app
41
asset
9
audit
2
azure_trigger
13
capture
7
concurrencyGroups
4
config
10
data_metric
1
dbt
3
documentation
2
draft
5
email_trigger
8
favorite
2
flow
20
flow_conversations
3
folder
11
gcp_trigger
14
Git Sync
10
granular_acl
3
group
19
health
2
helpers
24
http_trigger
9
hubPublish
19
indexSearch
7
input
6
integration
1
job
99
kafka_trigger
10
mcp
1
mcp_oauth
3
metrics
3
mqtt_trigger
8
native_trigger
13
nats_trigger
8
npm_proxy
6
oauth
13
oidc
1
openapi
2
path_autocomplete
1
postgres_trigger
20
raw_app
1
resource
28
schedule
10
script
37
service_logs
2
setting
52
settings
4
sqs_trigger
8
teams
1
token
1
trigger
3
user
57
variable
10
volume
4
websocket_trigger
8
worker
10
workspace
130
workspace_dependencies
5
workspace_integration
8
ai_evals
run every case of a dataset as one immutable experiment
post
/w/{workspace}/ai_evals/experiments/run
Path parameters
workspace
string
required
Request body
object
required
dataset
string
required
subject
EvalSubject
required
What an eval run is executed against.
Response
id of the created experiment
Changes