Parameter | Type | Sample | Description |
DataSourceList | [ { "Category": "MySQL", "CreateTime": 1713382724876, "DataSourceId": "178067480074262****", "EndpointType": "Volc_MySQL", "Name": "src", "VolcMySQLSettings": { "DBInstanceId": "mysql-7734b621****", "DBInstanceName": "", "Password": "Admin@****", "RegionSettings": { "Region": "cn-beijing" }, "Username": "test***" } } ] | Data source list. | |
Count | Long | 1 | The total number of data sources. |
Parameter | Type | Sample | Description |
Category | String | MySQL | The type of instance. The values are as follows:
|
CreateTime | Long | 1734070854504 | Creation time of the data source. Millisecond timestamp. |
DataSourceId | String | 1867454442941460510 | Source or target instance ID. |
ModifyTime | Long | 1734070873088 | The most recent time the data source was updated. Millisecond timestamp. |
EndpointType | String | Volc_MySQL | The access method of the instance. the values are as follows:
|
VolcMySQLSettings | { "DBInstanceId": "mysql-0b5d385f*****", "DBInstanceName": "", "Password": "******", "RegionSettings": { "Region": "cn-shanghai" }, "Username": "huahua" } | Indicates the information of the source or target database where the access method is Volcengine RDS for MySQL. This parameter is required when EndpointType is set to Volc_MySQL. | |
VolcveDBMySQLSettings | { "DBInstanceId": "vedbm-arjlc5di****", "DBInstanceName": "", "Password": "******", "RegionSettings": { "Region": "cn-beijing" }, "Username": "root" } | Indicates the information of the source or target database where the access method is Volcano Engine veDB for MySQL. This parameter is required when EndpointType is set to Volc_veDB_MySQL. | |
VolcPostgreSQLSettings | { "DBInstanceId": "postgres-5d17bd5c****", "DBInstanceName": "", "DBName": "huahua", "Password": "******", "RegionSettings": { "Region": "cn-guangzhou" }, "Username": "huahua" } | Indicates the information of the source or target database where the access method is Volcengine RDS for PostgreSQL. This parameter is required when EndpointType is set to Volc_PostgreSQL. | |
VolcMongoSettings | { "DBInstanceId": "mongo-replica-8ea79132****", "DBInstanceName": "", "DeployType": "ReplicaSet", "MongoAuthSourceDB": "", "Password": "******", "RegionSettings": { "Region": "cn-guangzhou" }, "Username": "root" } | Indicates the information of the source or target database where the access method is Volcengine Database for MongoDB. This parameter is required when EndpointType is set to Volc_Mongo. | |
VolcElasticSearchSettings | { "DBInstanceId": "o-00g0sqi*****", "DBInstanceName": "", "Password": "******", "RegionSettings": { "Region": "cn-shanghai" }, "Username": "admin" } | Indicates the information of the target database where the access method is Volcengine Cloud Search Service. This parameter is required when EndpointType is set to Volc_ElasticSearch. | |
VolcKafkaSettings | { "AuthType": "PLAIN", "InstanceId": "kafka-cnnge0tckudy****", "InstanceName": "", "Password": "******", "RegionSettings": { "Region": "cn-beijing" }, "Topic": "huahua", "Username": "huahua" } | Indicates the information of the target database when the access method is Volcengine Kafka. This parameter is required when EndpointType is set to Volc_Kafka. | |
VolcRocketMQSettings | { "AuthType": "PLAIN", "InstanceId": "rocketmq-cnou964d1e******", "InstanceName": "", "Password": "******", "RegionSettings": { "Region": "cn-guangzhou" }, "Topic": "zaizai", "Username": "uSmQgOHNTy5Uh98nqBGPvCzK" } | Indicates the information of the target database where the access method is Volcengine RocketMQ. This parameter is required when EndpointType is set to Volc_RocketMQ. | |
VolcRedisSettings | { "DBInstanceId": "redis-cnlf1xx7vjjw9****", "DBInstanceName": "", "Password": "******", "RegionSettings": { "Region": "cn-beijing" }, "Username": "default" } | Indicates the information of the target database where the access method is Volcengine Cache for Redis. This parameter is required when EndpointType is set to Volc_Redis. | |
PublicMySQLSettings | { "Host": "rm-2zey7i58n36x0****.mysql.rds.aliyuncs.com", "Password": "******", "Port": 3306, "RegionSettings": { "Region": "cn-beijing" }, "Username": "rootgg" } | Indicates the source database or target database information with the access method as public network MySQL. This parameter is required when EndpointType is set to Public_MySQL. | |
PublicPostgreSQLSettings | { "DBName": "postgres", "Host": "aurora-pg-17-replica-instance-1.czenkuaf0oxm.ap-southeast-2.rds.amazonaws.com", "Password": "******", "Port": 5432, "RegionSettings": { "Region": "cn-beijing" }, "Username": "dts" } | Information indicating the access method is public network PostgreSQL for source database or target database. This parameter is required when EndpointType is set to Public_PostgreSQL. | |
PublicMongoSettings | { "DeployType": "Standalone", "Endpoints": [ "123" ], "MongoAuthSourceDB": "123", "Password": "123", "RegionSettings": { "Region": "cn-chongqing-sdv" }, "Username": "123" } | Indicates the information of the source or target database where the access method is MongoDB connected over public network. This parameter is required when EndpointType is set to Public_Mongo. | |
PublicElasticSearchSettings | { "Endpoints": [ "********" ], "Password": "dddd", "RegionSettings": { "Region": "cn-beijing" }, "Username": "ddd" } | Indicates information of source database or target database ElasticSearch connected over public network. This Parameter is required when EndpointType is set to Public_ElasticSearch. | |
PublicRedisSettings | { "Host": "redis-sy013ku146******.redis.inner.ivolces.com", "Password": "******", "Port": 6379, "RegionSettings": { "Region": "cn-beijing" }, "Username": "default" } | Information about the source database or target database with access method as Redis connected over public network. This parameter is Required when EndpointType is set to Public_Redis. | |
BuiltinKafkaSettings | { "Brokers": [ "192.168.2.5:9092", "192.168.2.5:9192", "192.168.2.5:9292", "192.168.2.5:9392", "192.168.2.5:9492", "192.168.2.5:9592" ], "Topic": "123e8d8a3cc54477b45db3e3c708****" } | Indicates the parameter information for subscribing to the built-in middleware in the data subscription task. This parameter is required when EndpointType is set to Builtin_Kafka. | |
ExpressMongoSettings | { "DeployType": "ReplicaSet", "Endpoints": [ "eee" ], "MongoAuthSourceDB": "eee", "Password": "e", "PrivateNetworkSettings": { "SubnetId": "subnet-3jh1vsccsmjuo3pncmesj****", "VPCId": "vpc-30ukbt5glgyyo7r2qr2e6****" }, "RegionSettings": { "Region": "cn-chongqing-sdv" }, "Username": "e" } | Indicates the information of the source or target database where the access method is MongoDB connected over express network. This parameter is required when EndpointType is Express_Mongo. | |
ExpressMySQLSettings | { "Host": "192.168.0.65", "Password": "******", "Port": 3306, "PrivateNetworkSettings": { "SubnetId": "subnet-2d74b6pbyewao58ozferi****", "VPCId": "vpc-3rebt5uf5fr405zsk2if9*****" }, "RegionSettings": { "Region": "cn-beijing" }, "Username": "rootgg" } | Indicates the information of the source or target database where the access method is MySQL connected over express network. Required when EndpointType is Express_MySQL. | |
ExpressPostgreSQLSettings | { "DBName": "src", "Host": "192.168.0.65", "Password": "Bd2021_bd", "Port": 5432, "PrivateNetworkSettings": { "SubnetId": "subnet-2bznv8i16voqo2dx0efg0****", "VPCId": "vpc-3rebt5uf5fr405zsk2if****" }, "RegionSettings": { "Region": "cn-beijing" }, "Username": "suser" } | Indicates the information of the source or target database where the access method is PostgreSQL connected over express network. This parameter is required when EndpointType equals Express_PostgreSQL. | |
ExpressRedisSettings | { "ArchType": "Standalone", "Host": "192.168.32.28", "Password": "pwd", "Port": 6399, "PrivateNetworkSettings": { "SubnetId": "subnet-3re9nvjumjthc5zsk2i5z****", "VPCId": "vpc-2bzf04ctm2pz42dx0eebh****" }, "RegionSettings": { "Region": "cn-beijing" }, "Username": "default" } | This represents the information of the source database or target database with access method of Redis connected over express network. When EndpointType is Express_Redis, this parameter is required. | |
ExpressElasticSearchSettings | { "Endpoints": [ "http://192.****.0.****:9200" ], "Password": "123456", "PrivateNetworkSettings": { "SubnetId": "subnet-2d6asbw971nnk58ozfeei****", "VPCId": "vpc-3rebt5uf5fr405zsk2if9****" }, "RegionSettings": { "Region": "cn-beijing" }, "Username": "elastic" } | Indicates the information of the source or target database where the access method is ElasticSearch connected over express network. This parameter is required when EndpointType is set to Express_ElasticSearch. | |
ExpressKafkaSettings | { "AuthType": "PLAIN", "BrokerEndpoints": [ "192.168.0.65:9092" ], "Password": "admin-secret", "PrivateNetworkSettings": { "SubnetId": "subnet-2bz5swar08oao2dx0ee******", "VPCId": "vpc-3rebt5uf5fr405zsk2if9******" }, "RegionSettings": { "Region": "cn-beijing" }, "Topic": "dial_test", "Username": "admin" } | Indicates the information of the source or target database where the access method is Kafka connected over express network. This parameter is required when EndpointType is set to Express_Kafka. | |
Name | String | test | Task name of the data source. This parameter is required when you call the CreateDataSource API to create a data source. |
Parameter | Type | Sample | Description |
DBInstanceId | String | mysql-3d224def**** | Instance ID. tip
|
DBInstanceName | String | testDB | Instance name. |
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. | |
CrossAccountSettings | { "SourceAccount":"2100******", "Role":"test" } | The configuration information for cross-account data transmission. |
Parameter | Type | Sample | Description |
SourceAccount | String | 2100****** | Source account ID. |
Role | String | test | The role name created by source accounts for the transmission of data. |
Parameter | Type | Sample | Description |
DBInstanceId | String | vedbm-r3xq0zdl**** | Instance ID. tip
|
DBInstanceName | String | TestveDB | Instance name. |
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. | |
CrossAccountSettings | { "SourceAccount":"2100******", "Role":"test" } | The configuration information for cross-account data transmission. |
Parameter | Type | Sample | Description |
DBInstanceId | String | postgres-h441603c68aaa**** | Instance ID. tip This parameter is required when EndpointType is set to Volc_PostgreSQL in EndpointType. |
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
DBName | String | test**** | Database name. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. | |
CrossAccountSettings | { "SourceAccount":"2100******", "Role":"test" } | The configuration information for cross-account data transmission. | |
ExtraParams | | |
Parameter | Type | Example | Description |
DBInstanceId | String | mongo-replica-e405f8e2**** | Instance ID. tip
|
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
MongoAuthSourceDB | String | ReplicaSet | Account verification database. When EndpointType is set to Volc_Mongo, the default value of this parameter is root. |
DeployType | String | ShardedCluster | The instance type of MongoDB. The values are as follows:
|
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. | |
CrossAccountSettings | { "SourceAccount":"2100******", "Role":"test" } | The configuration information for cross-account data transmission. | |
PullMethod | String | ChangeStream | Incremental acquisition method at the source end. The values are as follows:
tip This parameter is required when the DeployType parameter value is ShardedCluster. |
Parameter | Type | Sample | Description |
DBInstanceId | String | ztuc43y38z4w**** | Instance ID. tip
|
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. |
Parameter | Type | Sample | Description |
InstanceId | String | kafka-**** | Instance ID. tip
|
AuthType | String | plain | Authentication method. The default value is plain. |
Username | String | test**** | The username for the Kafka instance using the PLAIN mode. |
Password | String | test**** | The password for the Kafka instance using the PLAIN mode. |
Topic | String | my_topic | Kafka's Topic name. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. |
Parameter | Type | Sample | Description |
InstanceId | String | MQ_INST_***** | Instance ID. tip
|
AuthType | String | plain | Authentication method. The default value is plain. |
Username | String | test**** | The username of the RocketMQ instance. |
Password | String | test**** | User password for RocketMQ instance. |
Topic | String | my_topic | Topic name of RocketMQ. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. |
Parameter | Type | Sample | Description |
DBInstanceId | String | redis-cn0212gzmh2xs**** | Instance ID. tip
|
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. | |
CrossAccountSettings | { "SourceAccount":"2100******", "Role":"test" } | The configuration information for cross-account data transmission. |
Parameter | Type | Sample | Description |
Host | String | 192.168.***.*** | The host address of the self-managed instance. |
Port | Integer | 4 | The port number of the self-managed instance. |
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
SSLSettings | { "EnableSSL": true, "Cert":"-----BEGIN CERTIFICATE----- ...... -----END CERTIFICATE-----" } | Instance encryption information. | |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. |
Parameter | Type | Sample | Description |
Host | String | 192.168.***.*** | The host address of the self-managed instance. |
Port | Integer | 4 | The port number of the self-managed instance. |
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
DBName | String | test**** | Database name. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. | |
ExtraParams | | |
Parameter | Type | Sample | Description |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. | |
DeployType | String | Standalone | The type of MongoDB instance. The values are as follows:
|
PullMethod | String | ChangeStream | Incremental acquisition method at the source end. The values are as follows:
tip This parameter is required when the DeployType is set to ShardedCluster. |
Endpoints | Array of String | 192.168.***.***:4 | Mongo address in the format of host:port. If multiple addresses exist, separate them with commas (,). Up to 5 addresses are supported. |
Username | String | test**** | mongos database account. |
Password | String | test**** | Database password of mongos. |
MongoAuthSourceDB | String | admin | Authentication database name for mongos. |
Shards | { "Address": "192.168.0.1:27019,192.168.0.1:27020", "Username": "test****", "Password": "test****", "AuthDb": "admin" } | Shard address information. tip If used as a return parameter, the relevant information about the parameter is not returned. | |
UseNewShardingDatasource | Boolean | true | Whether to select the new version of shard access method, with the following optional values:
|
Parameter | Type | Sample | Description |
Endpoints | Array of String | 192.168.***.*** | The host address of the self-managed instance. |
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. |
Parameter | Type | Sample | Description |
Host | String | 192.168.***.*** | The host address of the self-managed instance. |
Port | Integer | 4 | The port number of the self-managed instance. |
Username | String | test**** | Database account. |
Password | String | test**** | Database account password. |
DBName | String | test**** | Database name. |
RegionSettings | { "Region": "cn-shanghai" } | The region of the instance. |
Name | Type | Sample | Description |
RegionSettings | { "Region": "cn-shanghai" } | Region ID. | |
DeployType | String | ShardedCluster | The instance type of the instance. The values are as follows:
|
PullMethod | String | ChangeStream | Incremental acquisition method at the source end. The values are as follows:
tip This parameter is required when the DeployType is set to ShardedCluster. |
PrivateNetworkSettings | { "VpcId": "vpc-bp1opxu1zkhn00gz****", "SubnetId": "subnet-bpkdt37pq72zv****" } | Configuration of the virtual private cloud. | |
Endpoints | Array of String | 192.168.***.***:4 | Mongo address in the format of host:port. If multiple addresses exist, separate them with commas (,). Up to 5 addresses are supported. |
Username | String | test**** | mongos database account. |
Password | String | test**** | Database password of mongos. |
MongoAuthSourceDB | String | admin | Authentication database name for mongos. |
Shards | { "Address": "192.168.0.1:27019,192.168.0.1:27020", "Username": "test****", "Password": "test****", "AuthDb": "admin" } | Shard address information. tip If used as a return parameter, the relevant information about the parameter is not returned. | |
UseNewShardingDatasource | Boolean | true | Whether to select the new version of shard access method, with the following optional values:
|
Parameter | Type | Sample | Description |
Host | String | 192.168.***.*** | The host address of the MySQL instance connected over express network. |
Port | Integer | 4 | The port of the MySQL instance connected over express network. |
Username | String | test*** | Database account of MySQL instance connected over express network. |
Password | String | Admin@*** | Database account password of MySQL instance connected over express network. |
PrivateNetworkSettings | { "VpcId": "vpc-bp1opxu1zkhn00gz****", "SubnetId": "subnet-bpkdt37pq72zv****" } | Configuration of the virtual private cloud. | |
RegionSettings | { "Region": "cn-shanghai" } | Region ID. |
Parameter | Type | Sample | Description |
Host | String | 192.168.***.*** | The host address of the PostgreSQL instance connected over express network. |
Port | Integer | 4 | The port of the Express_Kafka instance connected over express network. |
Username | String | test*** | Database account of PostgreSQL instance connected over express network. |
Password | String | Admin@*** | Database account password of PostgreSQL instance connected over express network. |
DBName | String | test**** | Database name. |
PrivateNetworkSettings | { "VpcId": "vpc-bp1opxu1zkhn00gz****", "SubnetId": "subnet-bpkdt37pq72zv****" } | Configuration of the virtual private cloud. | |
RegionSettings | { "Region": "cn-shanghai" } | Region ID. | |
ExtraParams | | |
Parameter | Type | Sample | Description |
ArchType | String | Standalone | Architecture type. The values are as follows:
tip If the cluster of the Redis connected over express network instance has a proxy service, the ArchType must be set to Standalone. |
Host | String | 192.168.***.*** | The host address of the Redis instance connected over express network. tip This parameter is required when the parameter ArchType is set to Standalone. |
Port | Integer | 4 | The port of the Redis instance connected over express network. tip This parameter is required when the parameter ArchType is set to Standalone. |
Endpoints | Array of String | 10.10.10.10:3717 | Enter the IP: port of the primary nodes for each shard of the Cache for Redis cluster in the private network connected via the dedicated line, separated by commas. For example: ip1:port1,ip2:port2,ip3:port3. tip This parameter is required when the parameter ArchType is set to Cluster. |
PrivateNetworkSettings | { "VpcId": "vpc-bp1opxu1zkhn00gz****", "SubnetId": "subnet-bpkdt37pq72zv****" } | Configuration of the virtual private cloud. | |
RegionSettings | { "Region": "cn-shanghai" } | Region ID. | |
Username | String | test*** | Database account of the Redis instance connected over express network. |
Password | String | Admin@*** | Database account password of the Redis instance connected over express network. tip When the parameter ArchType is set to Cluster, passwords for multiple shards must be consistent; otherwise, connection can not be established. |
Parameter | Type | Sample | Description |
Endpoints | Array of String | [192.168.***.***] | The host address of ElasticSearch connected over express network. |
Username | String | test*** | Database account of the Elasticsearch instance connected over express network. |
Password | String | Admin@*** | Database account password of ElasticSearch instance connected over express network. |
PrivateNetworkSettings | { "VpcId": "vpc-bp1opxu1zkhn00gz****", "SubnetId": "subnet-bpkdt37pq72zv****" } | Configuration of the virtual private cloud. | |
RegionSettings | { "Region": "cn-shanghai" } | Region ID. |
Parameter | Type | Sample | Description |
BrokerEndpoints | Array of String | [10.1.***.***:9093] | The IP address and port number of the Kafka connected over express network instance Broker, in the format of host1:port1. If there are multiple Brokers, separate them with commas (,). |
AuthType | String | plain | Authentication method. The default value is plain. |
Username | String | test*** | Database account of the Kafka instance connected over express network. |
Password | String | Admin@*** | Database account password of the Kafka instance connected over express network. |
Topic | String | dts_sydtest | Topic information of the Kafka instance connected over express network. |
PrivateNetworkSettings | { "VpcId": "vpc-bp1opxu1zkhn00gz****", "SubnetId": "subnet-bpkdt37pq72zv****" } | Configuration of the virtual private cloud. | |
RegionSettings | { "Region": "cn-shanghai" } | Region ID. |