Describe

Create a new media description job

Changed on

Get a comprehensive multimodal description of a video

post/describe

Request

  • Base URL
    https://api.cloudglue.dev/v1
  • Auth
    HTTP bearer

Request body

urlstring required

Input media URL. Supports URIs of files uploaded to Cloudglue Files endpoint, public YouTube video URLs, public TikTok video URLs, public Loom share URLs, public HTTP URLs (including direct image URLs such as JPEG/PNG/WebP), and files which have been granted access to Cloudglue via data connectors.

Note that YouTube videos are currently limited to speech level understanding only. Public TikTok video URLs will be scraped and stored automatically — subject to charges. For files via our Data connectors, see our documentation on data connectors for setup information.

enable_summaryboolean

Whether to generate video-level and segment-level (moment-level) summaries and titles

enable_speechboolean

Whether to generate speech transcript

enable_visual_scene_descriptionboolean

Whether to generate visual scene description

enable_scene_textboolean

Whether to generate scene text extraction

enable_audio_descriptionboolean

Whether to generate audio description

include_chaptersboolean

Include narrative chapters in the response when segmentation strategy is 'narrative'. Only affects cached completed results; newly created pending jobs do not include chapters.

include_shotsboolean

Include shot boundaries in the response when segmentation strategy is 'shot-detector'. Only affects cached completed results; newly created pending jobs do not include shots.

use_in_default_indexboolean

When true, the video's search documents will be added to the account's default index, making them searchable via the Response API and Deep Search API with source: 'default'.

promptstring

Optional free-form guidance for the description. Use it to name the terms, product names, acronyms, or people that matter for this media and how they are spelled, or to say what the description should pay attention to — e.g. "Spell product names as Cloudglue and Aviary; call out any pricing discussed". It steers emphasis and vocabulary across the visual, scene-text, speech, and summary passes; it cannot make the description report content that is not in the media, and it does not change the response shape. To constrain transcript speaker labels to a known cast, use participants instead — a prompt is context, not a constraint. Changing it produces a new describe job rather than reusing a cached one.

include_metadataboolean

Include the file's user-defined metadata and source metadata on the returned file object.

segmentation_idstring uuid

Segmentation job id to use. If not provided will use default to uniform 20s segmentation. Cannot be provided together with segmentation_config.

Response

Successful response

job_idstring required
status'pending' | 'processing' | 'completed' | 'failed' | 'not_applicable' required
urlstring

The URL of the processed video

duration_secondsnumber

Duration of the video in seconds

thumbnail_urlstring uri

URL of the file-level thumbnail for the video. Only present when include_thumbnails=true.

created_atinteger

Unix timestamp in milliseconds when the job was created

use_in_default_indexboolean

Whether this describe job's search documents are included in the default index.

errorstring

Error message if status is 'failed'

segmentation_idstring uuid

The ID of the segmentation job if the describe was run with a segmentation

total_chaptersinteger

Total number of chapters (only present when include_chapters=true and segmentation strategy is 'narrative')

total_shotsinteger

Total number of shots (only present when include_shots=true and segmentation strategy is 'shot-detector')

Changes

    • info

      added the non-success response with the status

    • info

      removed the non-success response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the new optional request property /

    • info

      added the optional property / to the response with the status