Animate

Generate animation using text description

Changed on

Creates a pixel art animation based on text description and parameters.

Supported image sizes:

  • 64x64

Supported features:

  • Text-guided animation generation
  • Inpainting
  • Init image
  • Forced palette
  • Multiple frames

Using the Python client:

import pixellab

client = pixellab.Client(secret="YOUR_API_TOKEN")

response = client.animate_with_text(
    description="human mage",
    action="walk",
    view="side",
    direction="south",
    image_size=dict(width=64, height=64),
    reference_image=reference_image,
    n_frames=4
)
images = [image.pil_image() for image in response.images]
post/animate-with-text

Request

Request body

descriptionstring required

Character description

negative_descriptionstring

Negative prompt to guide what not to generate

actionstring required

Action description

text_guidance_scalenumber nullable

How closely to follow the text prompts

image_guidance_scalenumber nullable

How closely to follow the reference image

n_framesinteger nullable

Length of full animation (the model will always generate 4 frames)

start_frame_indexinteger nullable

Starting frame index of the full animation

view'side' | 'low top-down' | 'high top-down'
direction'north' | 'north-east' | 'east' | 'south-east' | 'south' | 'south-west' | 'west' | 'north-west'
init_image_strengthinteger

Strength of the initial image influence

seedinteger nullable

Seed for reproducible results (0 for random)

Example request

{
  "action": "walk",
  "description": "human mage",
  "direction": "south",
  "image_size": {
    "height": 64,
    "width": 64
  },
  "view": "side"
}

Response

Successfully generated animation

Changes

    • breaking

      added the new required request property /

    • breaking

      request property was restricted to a list of enum values

    • breaking

      request property was restricted to a list of enum values

    • breaking

      the request property type changed from no type to string

    • breaking

      the / request property type changed from object to no type

    • breaking

      the request property type changed from no type to object

    • breaking

      the request property type changed from no type to string

    • breaking

      the response property / became optional for the status

    • breaking

      response property usage/usd list-of-types was widened by adding types null to media type application/json of response 200

    • warning

      removed from the request property allOf list

    • warning

      removed from the request property allOf list

    • warning

      removed from the request property allOf list

    • warning

      removed from the request property allOf list

    • warning

      removed the request property //

    • warning

      removed the request property //

    • warning

      added the new generations enum value to the / response property for the response status

    • info

      added the new optional request property /

    • info

      added subschema #2 to the request property anyOf list

    • info

      added subschema #2 to the / request property anyOf list

    • info

      added the new east enum value to the request property

    • info

      added the new high top-down enum value to the request property

    • info

      added the new low top-down enum value to the request property

    • info

      added the new north enum value to the request property

    • info

      added the new north-east enum value to the request property

    • info

      added the new north-west enum value to the request property

    • info

      added the new side enum value to the request property

    • info

      added the new south enum value to the request property

    • info

      added the new south-east enum value to the request property

    • info

      added the new south-west enum value to the request property

    • info

      added the new west enum value to the request property

    • info

      request property list-of-types was widened by adding types null to media type application/json

    • info

      request property list-of-types was widened by adding types null to media type application/json

    • info

      request property list-of-types was widened by adding types null to media type application/json

    • info

      request property list-of-types was widened by adding types null to media type application/json

    • info

      request property list-of-types was widened by adding types null to media type application/json

    • info

      request property list-of-types was widened by adding types null to media type application/json

    • info

      request property list-of-types was widened by adding types null to media type application/json

    • info

      added the optional property / to the response with the status

    • info

      the response property const value base64 was added for the status

    • info

      removed the base64 enum value from the // response property for the response status