Database Transmission Service
Type | Description |
Source database limits |
tip
|
Target database limits |
tip Only MySQL 8.0 supports setting SET_USER_ID permission. |
DDL limitations |
tip When using online DDL tools such as gh-ost or pt-online-schema-change, temporary tables are created during schema changes. Data written to the target database during operations like RENAME or DROP on these temporary tables may be lost.
|
Bidirectional synchronization limits | When creating a bidirectional synchronization task, you need to pay attention to the following information:
|
Other limits |
|
Operation type | SQL statement |
DML | INSERT, UPDATE, DELETE |
DDL |
|
Database | Schema initialization | Full initialization | Incremental synchronization |
Source database | SELECT permission | SELECT permission | REPLICATION SLAVE, REPLICATION CLIENT, and SELECT permissions. |
Target database | Read/Write permissions | Read/Write permissions | Read/Write permissions |
Type | Name | Description |
Basic information | Task name | Optional. Customize the task name. The length must be within 256 characters. tip If not set, the system generates a task name by default according to the naming rule, starting with dts-. |
| Link specification | Select the link specifications for the synchronization task as needed. Compact, Medium, and Standard are supported. tip The link specification can not be modified after the task is successfully created. For details on the link specifications, refer to Product specifications. |
| Synchronization topology | Select a synchronization topology based on your business needs. Unidirectional synchronization and Bidirectional synchronization are currently supported. tip Bidirectional synchronization currently only supports RDS for MySQL 5.6 and above. For more information about the synchronization topology, refer to Data synchronization topology. |
Source database configuration | Select an existing data source | You can choose whether to use an existing instance as needed:
|
| Instance type | Select MySQL. |
| Access method | Select Volcano Engine veDB for MySQL. |
| Region | Select the region where the target instance is located. |
| Cross-Volcano Engine account? | Select whether to transmit data cross-account as needed, with the following options:
tip
|
| Cross-account ID | Enter the Volcano Engine account ID to which the source database belongs. |
| Cross-account roles | Enter the IAM role authorized for DTS to access cross-account resources. |
| MySQL instance | Select the target instance of Volcano Engine veDB for MySQL from the drop-down list. tip You can also search for the target instance by instance ID or name. |
| Node type | Select node types as needed, currently supporting Primary node and Read-only node. tip Select read-only nodes when read-only nodes are created within the instance. For specific steps on creating a read-only node, refer to Read-only node overview. |
| MySQL read-only node | Select the target read-only node from the drop-down list. tip When a read-only node is created in the instance and Node type selects Read-only node, this parameter can be configured. |
| Database account | Enter the database account of the target instance. |
| Database password | Enter the password corresponding to the database account of the target instance. |
| Test connection | Click Test connection to verify the connection to the instance. If the test connection fails, modify the configuration based on the failure prompt, and then click Test connection again to verify the connection. The specific prompts are as follows:
|
Target database configuration | Select an existing data source | You can choose whether to use an existing instance as needed:
|
| Instance type | Select MySQL. |
| Access method | Select Volcano Engine RDS for MySQL. |
| Region | Select the region where the target instance is located. |
| MySQL instance | Select the target instance of RDS for MySQL from the drop-down list. tip You can also search for the target instance by instance ID or name. |
| Database account | Enter the database account of the target instance. |
| Database password | Enter the password corresponding to the database account of the target instance. |
| Test connection | Click Test connection to verify the connection to the instance. If the test connection fails, modify the configuration based on the failure prompt, and then click Test connection again to verify the connection. The specific prompts are as follows:
|
Project and billing | Project | Optional. Select the affiliated project for the task from the drop-down list. By default, it is under default (default project). You can also click Create new project to create a new project. For more information, refer to Creating a new project. tip
|
| Tag | (Optional) Click Add tag to add a tag to the instance. Tags can help you categorize cloud resources, control access to them, and allocate bills and costs. A tag is a key-value pair that identifies a cloud resource. You can use tags to categorize resources with the same characteristics from different dimensions, such as purpose or owner, making it easier to filter, aggregate, and manage your cloud resources. For more details about tags, refer to Tag overview. The rules for tag key-value pairs are as follows:
tip
|
| Billing method | Select a billing method: Pay-as-you-go or Subscription. tip |
| Subscription duration | Select the duration of the subscription as needed. tip When selecting Subscription in Billing method, you can set the purchase time and also check Automatic renewal. The system automatically renews before task expiration. |
Name | | Description |
Synchronization type | | Select the synchronization type as needed. Currently, User initialization, Schema initialization, Full initialization, and Incremental synchronization are supported. tip
|
Migration user | | Select the target accounts as needed, and set a new password in the New password (Optional) column. When migrating multiple users, click Batch change password to change all their passwords at once. Otherwise, the target account passwords will be the same as the source passwords.Batch change password tip
|
Conflict resolution strategy | | During incremental synchronization, the processing method to be used when the target database encounters duplicate primary key values or unique values is as follows:
warning
|
Synchronization starting point | | Set to pull Binlog logs from a specified position or timestamp. The values are as follows:
tip
|
Sync type selection | | Select the operation types to synchronize. Currently, DML and DDL operation statements are supported for synchronization. The details are as follows:
tip For DDL operation statements supported by DTS during data synchronization, refer to Supported synchronized SQL. |
Whether to enable foreign key check? | | Select whether to enable foreign key check as needed. When enabled, the tool supports synchronizing cascading updates and deletes of foreign keys from the source, ensuring data integrity and consistency throughout the synchronization. |
Synchronization object | | Select the synchronization objects, such as tables, views, functions, or stored procedures, supporting queries of target objects via Normal search and Global search. At the same time, you can perform the following operations in the Selected object area:
tip Regular expression search for target objects is supported in the Synchronization object or Selected object areas. |
Advanced configuration | Selected databases and tables | Only support resetting the synchronization type, conflict strategy, and data filtering of synchronized tables separately as follows:
tip
|
| Whether to pre-synchronize trigger | Select whether to pre-synchronize triggers as needed, supporting the following options:
tip
|
| Trigger synchronization method | Select the pre-synchronize trigger synchronization method as needed, supporting the following options:
tip This parameter can only be configured if whether to pre-synchronize triggers is set to yes. |
| Enable transaction merging? | Enabling transaction merging optimizes synchronization tasks by combining multiple individual transactions, improving overall efficiency and performance while ensuring data consistency. When data synchronization occurs frequently with large volumes, enabling transaction merging enhances synchronization efficiency. |
| Synchronization preferences | Select a synchronization preference policy as needed. The following options are supported:
|
| Post-schema synchronization | Select whether to synchronize triggers or events after incremental synchronization based on demand. The following options are supported:
tip
|
| Enable ETL configuration | Choose whether to enable the ETL function. For more information about ETL, refer to Introduction to ETL.
|
| Error retry time | If a synchronization task fails due to a disconnection between the source and target databases, the system immediately retries connecting to them multiple times within the specified time. Value range: 600–86400, in seconds (s). The default value is 600 seconds. |
| Enable millisecond-level delay monitoring | Enable or disable millisecond-level latency monitoring as needed. When enabled, it provides high-precision, full-link, proactive end-to-end latency measurement, effectively improving monitoring stability and sensitivity to abnormal conditions such as network interruptions and idle disconnections. When enabled, DTS writes heartbeat signals to the source database. The source end account must have SELECT, INSERT, and UPDATE permissions. You can also manually create a heartbeat table on the source database to enable millisecond-level latency monitoring. For detailed steps, see Manually create a heartbeat table. |
| Full synchronization rate | Set the full synchronization rate as needed. To prevent high synchronization rates from affecting the source database's performance, adjust the following parameters based on the read and write pressure of the source and target databases accordingly:
tip
|