Database Transmission Service
Database Transmission Service
Database Transmission Service
Document
What's new
Overview
Constraints and limits
Billing
Pre-check items
Permission management
Getting started
Quick start guide for data migration
Quick start guide for data subscription
Quick start guide for data synchronization
Data migration
Creating a data migration task for MySQL
Volcano Engine RDS for MySQL as the source
Volcano Engine veDB for MySQL as the source
MySQL connected over public network as the source
MySQL connected over express network as the source
Creating a data migration task for PostgreSQL
Volcano Engine RDS for PostgreSQL as the source
PostgreSQL connected over public network as the source
PostgreSQL connected over express network as the source
Creating a data migration task for SQL Server
Volcano Engine SQL Server as the source
SQL Server connected over public network as the source
SQL Server connected over express network as the source
Creating a data migration task for Redis
Volcano Engine Cache for Redis as the source
Redis connected over public network as the source
Redis connected over express network as the source
Creating a data migration task for MongDB
Volcano Engine Document Database for MongoDB as the source
MongoDB connected over public network as the source
MongoDB connected over express network as the source
Creating a data migration task for Supabase
Supabase connected over public network as the source
Supabase connected over express network as the source
Data subscription
Creating a data subscription task for MySQL
Creating a data subscription task for PostgreSQL
Consuming subscription data
Data synchronization
Creating a data synchronization task for MySQL
Volcano Engine RDS for MySQL as the source
Volcano Engine veDB for MySQL as the source
MySQL connected over public network as the source
MySQL connected over express network as the source
Creating a data synchronization task for Redis
Volcano Engine Cache for Redis as the source
Redis connected over public network as the source
Redis connected over express network as the source
Creating a data synchronization task for PostgreSQL
Volcano Engine RDS for PostgreSQL as the source
PostgreSQL connected over public network as the source
PostgreSQL connected over express network as the source
Creating a data synchronization task for MongoDB
Volcano Engine Database for MongoDB as the source
MongoDB connected over public network as the source
MongoDB connected over express network as the source
Creating a data synchronization task for Milvus
ETL task management
(Beta) Data verification
(Beta) Migration evaluation
Monitoring and alerts
Best practices
Data migration
Data subscription
API reference
Billing
Data transmission
Data subscription (consumer group management)
Data verification
Migration evaluation
Pre-check
Appendix
SDK reference
FAQs
Common general questions
Pre-check
Troubleshooting
- Documentation
Database Transmission ServiceETL task managementDebugging ETL rules through ETL Playground tool
Copy page
Download PDFETL task management
Debugging ETL rules through ETL Playground tool
Copy pageDownload PDFDebugging ETL rules through ETL Playground tool
ETL Playground is a tool for verification of the accuracy of ETL rules. You can use this tool to verify the accuracy of data extraction, conversion, processing, and loading before changing the data, thereby reducing the impact and risks on the production environment. This topic describes how to verify the accuracy of the ETL rules you configured in the ETL Playground tool.
Advantages
- Reduced risk: In ETL Playground, you can safely experiment with and debug the ETL process, identify and fix potential errors and issues in a timely manner, thereby reducing the impact of these errors on actual production data and reducing risks.
- Data Verification: In ETL Playground, you can perform data Verification in ETL processes with complex data operations and numerical calculations to ensure the accuracy of the ETL process.
- Performance optimization: In ETL Playground, you can test different rules, view their impact on the ETL process, and find the optimal rule for them to improve the performance of the ETL process.
Precautions
- You can test data on one table at most in a single time.
- You can verify up to 10 columns of data at a time, and add up to 10 rows of data for each column.
Procedure
- Log in to the ETL Playground tool.
- In the ETL rules area on the ETL Playground page, refer to the DSL syntax to configure ETL rules. Refer to DSL syntax for details about DSL syntax.
- Click Verification syntax to test the accuracy of the ETL rules.
- In the Test data area, set the table structure and data.
- Table structure
- On the table structure tab, set the Database name and Table name.
- ETL rules can only be verified on one table at a time.
- Click Add column to set the Column name and Data type.
- Column names cannot be duplicated.
- You can verify up to 10 columns of data at a time, and add up to 10 rows of data for each column.
- String, binary, integer, float, decimal, bool, datetime, json, and unsigned integer are supported for data type selection.
- Data: On the Data tab, click Add row to set the row data information.
- Click debug to confirm the debug result.
Last updated: 2026.01.21 17:35:51
All rights reserved © Beijing Volcano Engine Technology Co., Ltd2024
