You need to enable JavaScript to run this app.
Lake AI Service

Lake AI Service

Copy page
Download PDF
Video Production
Video Storyboard Gen
Copy page
Download PDF
Video Storyboard Gen

Operator for generating product voice-over and storyboard based on reference videos, designed for e-commerce short video creation scenarios. The operator jointly analyzes the reference video, target product images, and optional natural language requirements to generate a standard storyboard package that can be directly handed off to downstream text-to-video workflows.

Operator introduction

Operator ID: las_video_storyboard_gen

Applicable scenarios

Core capabilities

  • Jointly analyzes reference video visuals, voice-over, and target product images to identify the product's core purpose, intended users, and visible selling point evidence.
  • Supports reference storyboard, script, selling points, hooks, or free fusion, and allows specification of creative focus via user_prompt.
  • By default, generates up to N+1 candidate sets, where N is the number of input videos; partial candidates may be accepted, but at least one structurally usable result is returned.
  • Each candidate set includes a complete voice-over, fully readable storyboard, structured shot-by-shot description, as well as generation rationale and creative notes.
  • Output aligns with the standard storyboard bundle protocol and can be further processed by text-to-video or other downstream storyboard workflows.

Supported regions

  • Beijing: cn-beijing
  • Shanghai: cn-shanghai
  • Guangzhou: cn-guangzhou

Operator performance

Sub-items
Performance impact description

Maximum RPM

600

Duration

  • The task includes multimodal video understanding and multi-candidate generation. The more reference videos and the longer their duration, the higher the typical processing time for the Pro tier.

Input and output requirements

Input requirements

Subdivision

Detailed requirements

Supported input data modalities

  • Video
  • Image
  • Text (Prompt)

Input format: Video

  • Format: Supports MP4, MOV, MKV/Matroska, WebM
  • Quantity: 1–5 reference videos.
  • Duration: Maximum duration for a single reference video is 360 seconds; total duration for all reference videos is up to 1800 seconds.

Input format: Image

  • Format: Supports JPEG, PNG, WebP
  • Quantity: 1–9 target product images.

Input path requirements

Provide input data to the operator via request parameters video_urls and product_image_urls. Currently, two methods are supported: public URL and TOS path.

  • Public URL: A publicly accessible URL, format is http/https.
    • Public URLs do not support addresses requiring login status or additional header authentication; temporary URLs must remain valid during task execution.
  • TOS path: After uploading the data to be processed to a TOS Bucket under the same primary account and region as the current LAS service, you can provide the TOS path in the format tos://bucket_name/demo.
    • The TOS object must exist and have read permissions.

Output requirements

Subdivision

Detailed requirements

Output data modalities

  • Text (Storyboard package)

Output path: TOS

Specify the storage path for the operator's output results via the request parameter output_tos_path. Currently, only TOS paths are supported.

  • TOS path: A writable TOS Bucket directory under the same primary account and region as the LAS service, format: tos://bucket/output/.

Billing information
  • Billing standards

    Sub-items
    Billing standards description

    Billing item

    Includes two billing items: Basic invocation fee and Video Storyboard Gen - video understanding. The actual charge is the sum of the fees for both billing items.

    • Base invocation fee: The operator invocation fee incurred each time the operator is called.
    • Video Storyboard Gen - video understanding:
      • The fee incurred when the operator generates a Video Storyboard Gen.
      • This portion of the fee is calculated based on the duration of the input video, and during billing, the billing duration is converted according to a certain coefficient based on the operator model tier (request parameter model_tier) used.

    Billing type

    Usage-based billing, with charges posted hourly based on actual usage. Billing precision: millisecond-level precision, rounded to the nearest millisecond

    Unit price

    The unit prices for Basic invocation fee and Video Storyboard Gen - video understanding are different. For details, see the table below.

  • Billing details
    Billing formula: Total cost = Base invocation fee + Video Storyboard Gen fee = 1 CNY + Video Storyboard Gen-coefficient base fee unit price * total input video duration * billing duration conversion coefficient

    Billing item

    Unit price

    Operator model tier

    Billing duration conversion coefficient

    Base invocation fee

    1 CNY/call

    Not applicable

    Not applicable

    Video Storyboard Gen - video understanding

    1.5 CNY/minute

    Standard version

    • Request parameter model_tier set to standard

    1

    Enhanced version

    • Request parameter model_tier set to pro

    2

  • Billing example
    When 3 reference videos, each 1 minute long, are input and the operator's model tier is set to pro (enhanced version):

    • The duration conversion coefficient is: 2.
    • The actual cost is:
      Cost = 1 CNY + 1.5 CNY/minute * 1 minute * 3 * 2 = 10 CNY

Caution and prerequisites

Details

Caution and prerequisites

Costs

Before calling an operator, you need to understand the model invocation costs associated with using the operator. For details, see Large model invocation billing.

Authentication (API Key)

Before calling an operator, you need to generate an API Key for operator invocation. It is recommended to configure the API Key as an environment variable to ensure safer operator calls. For details, see Obtain and configure API Key.

BaseURL

Before calling an operator, you need to determine the BaseURL for operator invocation based on the region where your current LAS service is deployed. This is used to configure the path parameter values for operator calls.
For details, see Obtain the Base URL. The Examples below are for reference only; when making actual calls, replace the path values with those corresponding to your region.

Rest API invocation

API invocation instructions

  • The operator's API is an asynchronous task interface. You need to submit a task via the submit interface, then use the Poll interface to check the task status and obtain the operator's processing results. Additionally, the operator supports asynchronous callback capability (Callback). You can set the callback parameter callback.url when initiating the operator task. LAS will send an HTTP POST notification to this URL. For guidance on using asynchronous callbacks, refer to Asynchronous callback API.
  • Caution: After a task is submitted, the task_id is valid for 3 days. After 3 days, the task_id cannot be used to retrieve the operator's processing result.

Submit

Interface instructions

Submit an asynchronous task to generate product voice-over and storyboard based on reference videos. The operator analyzes the reference video and target product images to generate multiple sets of standard voice-over scripts.

Request parameters

Parameter
Type
Required
Example value
Description
operator_id
string
Yes
las_video_storyboard_gen
Operator ID
operator_version
string
Yes
v1
Operator version
data
VideoStoryboardGenReqParams
Yes
Request parameters for generating a storyboard based on reference videos
callback
Callback
Optional
Task status callback; if not configured, you can query status using Poll.

Response parameters

Parameter
Type
Sample value
Description
metadata
metadata
Request metadata

Example

Request example

export OUTPUT_TOS_PATH="tos://path/to/video_storyboard_gen_results"

curl --location "https://operator.las.cn-beijing.volces.com/api/v1/submit" \
--header "Content-Type: application/json" \
--header "Authorization: Bearer $LAS_API_KEY" \
--data '{
  "operator_id": "las_video_storyboard_gen",
  "operator_version": "v1",
  "data": {
    "video_urls": [
      "https://${LAS_TOS_BUCKET}.${TOS_ENDPOINT}/operator_cards_serving/public/${LAS_ENVIRONMENT}/las_video_storyboard_gen/v1/input_video_01.mp4",
      "https://${LAS_TOS_BUCKET}.${TOS_ENDPOINT}/operator_cards_serving/public/${LAS_ENVIRONMENT}/las_video_storyboard_gen/v1/input_video_02.mp4"
    ],
    "product_image_urls": [
      "https://${LAS_TOS_BUCKET}.${TOS_ENDPOINT}/operator_cards_serving/public/${LAS_ENVIRONMENT}/las_video_storyboard_gen/v1/input_image_01.png"
    ],
    "user_prompt": "请展示割草机好用耐造,适用各种场景。",
    "output_tos_path": "$OUTPUT_TOS_PATH"
  }
}'

Response example

{
  "metadata": {
    "task_id": "task-20260812150000-abc123",
    "task_status": "PENDING",
    "business_code": "0",
    "error_msg": ""
  }
}

Error codes

HttpStatusCode

Error code

Error message

Description

400

Parameter.Invalid

invalid parameter

The input quantity, URL, media format, video duration, target duration, number of shots, or speech rate parameters are invalid.

400

Video.VLMFailed

VLM call failed

Video/product understanding, prompt review, or candidate generation failed.

400

Tos.AccessFailed

Failed to access TOS path with provided credentials

Input media download, internal temporary storage, or result upload failed.

401

Authorization.Missing

Missing Authorization

Authorization is missing.

401

ApiKey.InValid

The api key is invalid

The API key is invalid.

500

Internal.ServerError

Internal server error

Internal server error.

Poll

Interface instructions

Query the status and results of tasks for generating product voiceovers and storyboards from reference videos.

Request parameters

Name

Type

Required

Sample value

Description

operator_id

string

Required

las_video_storyboard_gen

Operator ID

operator_version

string

Required

v1

Operator version

task_id

string

Required

task-xxx

Asynchronous task ID

Response parameters

Parameter
Type
Sample value
Description
metadata
metadata
Request metadata
data
VideoStoryboardGenResponse
Data returned upon successful completion of the task.

Examples

Request example

curl --location "https://operator.las.cn-beijing.volces.com/api/v1/poll" \
--header "Content-Type: application/json" \
--header "Authorization: Bearer $LAS_API_KEY" \
--data '{
  "operator_id": "las_video_storyboard_gen",
  "operator_version": "v1",
  "task_id": "task-20260812150000-abc123"
}'

Response example

{
  "metadata": {
    "task_id": "task-20260812150000-abc123",
    "task_status": "COMPLETED",
    "submit_time": "2026-08-12T15:00:00+08:00",
    "end_time": "2026-08-12T15:06:00+08:00",
    "business_code": "0",
    "error_msg": ""
  },
  "data": {
    "result_urls": [
      "tos://bucket/output/runs/run_x/variants/variant_001/storyboard_bundle_manifest.json"
    ]
  }
}

Error codes

HttpStatusCode

Error code

Error message

Description

400

Parameter.Invalid

invalid parameter

The parameters or generated results do not meet the constraints.

400

Video.VLMFailed

VLM call failed

Model understanding or generation failed.

400

Tos.AccessFailed

Failed to access TOS path with provided credentials

Failed to access TOS or upload results.

400

TaskId.Invalid

The task id is invalid

The task ID is invalid or the task does not exist.

401

Authorization.Missing

Missing Authorization

Authorization is missing.

401

ApiKey.InValid

The api key is invalid

The API Key is invalid.

500

Internal.ServerError

Internal server error

Internal service error.

Last updated: 2026.08.18 15:05:13