---
title: "Detect labels and captions in image (Fast = Brainiall object detection module closed-set, Standard = Brainiall Vision Tagger engine multi-task)"
method: POST
path: "/v1/vision/labels/base64"
tags: ["S9 Vision Labels"]
---

# Detect labels and captions in image (Fast = Brainiall object detection module closed-set, Standard = Brainiall Vision Tagger engine multi-task)

`POST /v1/vision/labels/base64`

## Request

- Base URL: `https://api.brainiall.com`
- URL: `https://api.brainiall.com/v1/vision/labels/base64`
- Auth: HTTP bearer

Fast tier: Brainiall object detection module (COCO 80 classes, 236 ms). Standard tier: Brainiall Vision Tagger engine multi-task (caption / detect / OCR / segment / zero-shot text prompts, 1.6 s). Capability AWS Rekognition does not offer: zero-shot prompting + dense captions. permissively licensed.

## Request body

- VisionLabelsRequest
  - `image` string, required: Base64-encoded image
  - `tier` 'fast' | 'standard': fast = Brainiall object detection module closed-set (COCO 80 classes) · standard = Brainiall Vision Tagger engine multi-task (caption / detect / OCR / segment / zero-shot)
  - `task` string, nullable: Brainiall Vision Tagger engine task tag (Standard tier only). E.g. <CAPTION>, <DETAILED_CAPTION>, <OD>, <OCR>, <REFERRING_EXPRESSION_SEGMENTATION>
  - `prompt` string, nullable: Optional zero-shot text prompt (Standard tier with referring expression tasks)

## Response `200`

Labels and/or caption returned

- VisionLabelsResponse
  - `request_id` string
  - `processing_ms` integer
  - `tier` 'fast' | 'standard'
  - `labels` VisionLabel[], nullable: Fast tier closed-set detections
    - `label` string
    - `confidence` number, float
    - `box` integer[], nullable
  - `caption` string, nullable: Brainiall Vision Tagger engine caption (Standard tier)
  - `output` object, nullable: Brainiall Vision Tagger engine raw multi-task output

## Other responses

- `400`: Invalid input
- `401`: Unauthorized
- `429`: Rate limit exceeded

---

[API](https://skmtc.dev/brainiall/apis/brainiall-specialist-ai-apis.md) · [All operations](https://skmtc.dev/brainiall/apis/brainiall-specialist-ai-apis/llms.txt) · [OpenAPI document](https://skmtc.dev/brainiall/apis/brainiall-specialist-ai-apis/revisions/e44fed29a7b5?raw)