Intelligent Data Insight
Intelligent Data Insight
- Documentation
Intelligent Data InsightDataWind User GuideData PreparationData ConnectionData Connections Overview
Copy page
Download PDFCopy pageDownload PDFData connection, also referred to as data source integration, is the first step in connecting to a database. After completing this step, you can create datasets to serve as inputs for data visualization query analysis, or use them as inputs for data visualization modeling.
DataWind supports integration with multiple types of data sources. It supports not only local file uploads, but also two main categories of online/system data sources, including: FTP connections, online spreadsheets, streaming databases, OLAP databases, relational databases, other data warehouses, BytePlus Matrix data sources, system metadata, Douyin ecosystem data, API connections, content management platforms, WeChat Official Accounts, astrology data, calendar data, and more.
For detailed information about data source integration, refer to the following guidelines:
- For the list of supported data sources, corresponding database version requirements, and environment differences between private deployment and SaaS versions, see List of supported databases.
- For quick integration methods for database-type data sources, see Quickly connect to BytePlus databases and data warehouse-type data sources.
Connection methods
DataWind supports connecting to data sources via offline extraction, real-time extraction, and direct connection:
Connection methods | Offline extraction | Real-time extraction | Direct connection |
|---|---|---|---|
Definition | Extract data offline into DataWind's built-in high-performance storage and computing engine. Most supported databases currently support offline extraction by default. | Extract data in real time into the engine for storage. Only data sources such as Kafka and Pulsar are supported. | Directly connect to the database to leverage the database's performance. |
Application scenarios |
| Stream data processing: Meets the continuous data ingestion and analysis needs of stream data sources such as Kafka and Pulsar. | Supports real-time data functionality. You can directly connect to the user's database without the need for data updates, meeting the user's requirements for real-time data. |
Usage limitations | Lack of real-time data: You need to set a synchronization cycle, and data will be synchronized at the synchronization points selected by the user. | Only data sources such as Kafka and Pulsar are supported. |
|
- The DataWind product supports private deployment or direct use of the BytePlus SaaS version. For the SaaS version, before connecting to data sources, you need to add the relevant server IP addresses to the allowlist, as follows:
- Beijing:
180.184.64.81,180.184.87.232,180.184.102.141 - Shanghai:
14.103.128.84 - Johor:
101.47.44.45
After successfully adding the above IP addresses, you can access data in the SaaS environment.
- Beijing:
- Before configuring the data source connection, ensure that the account you use has obtained read, write, and authentication permissions for the data source.
The table below lists the database-centric data sources and their corresponding connection documentation for your quick reference:
Data source name | Supported connection methods | Supported database versions | Supported environments | Supported environment versions | Support for creation | Access method |
|---|---|---|---|---|---|---|
Excel/CSV file | Offline extraction, direct connection | -- | SaaS, on-premises deployment | -- | Not supported | |
Access | Offline extraction | -- | On-premises deployment | -- | Not supported | |
Kafka | Real-time extraction | Version 0.8.x and above | On-premises deployment | -- | Not supported | |
Pulsar | Real-time extraction | 2.8.3 | On-premises deployment | -- | Not supported | |
GreenPlum | Offline extraction | 6.8.0 | SaaS, on-premises deployment | -- | Supported | |
SAP HANA | Offline extraction | 2.x | SaaS, on-premises deployment | -- | Supported | |
Impala | Offline extraction, direct connection | 2.12.0-cdh5.15.1 | SaaS, on-premises deployment | -- | Supported | |
ClickHouse Community Edition | Offline extraction, direct connection | 19 | SaaS, on-premises deployment | -- | Supported | |
HBase Phoenix | Offline extraction | Phoenix 4.14 / Hbase 1.3 | SaaS, on-premises deployment | -- | Supported | |
Gauss DWS | Offline extraction, direct connection | -- | SaaS, on-premises deployment | V2.68.0 | Supported | |
HBase | Offline extraction | 1.x | SaaS, on-premises deployment | -- | Not supported | |
Vertica | Offline extraction | 7.1.1-0 | SaaS, on-premises deployment | -- | Not supported | |
Amazon Athena | Offline extraction | -- | SaaS, on-premises deployment | V2.44.0 | Supported | |
Amazon Redshift | Offline extraction | 8.0.2 | SaaS, on-premises deployment | -- | Supported | |
ByteHouse CDW | Offline extraction, direct connection | -- | SaaS, on-premises deployment | V2.44.0 | Supported | |
ByteHouse CE | Offline extraction, direct connection | 2.1 | SaaS, on-premises deployment | -- | Supported | |
Presto | Offline extraction, direct connection (supported from version V2.50.0 and later) | -- | SaaS, on-premises deployment | -- | Supported | |
Trino | Offline extraction, direct connection | -- | SaaS, on-premises deployment | V2.64.0 | Supported | |
Databricks | Offline extraction, direct connection | 2.48 | SaaS, on-premises deployment | -- | Supported | |
AnalyticDB for MySQL 2.0 | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
AnalyticDB for MySQL 3.0 | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
Hologres | Offline extraction, direct connection | -- | SaaS, on-premises deployment | -- | Supported | |
MySQL | Offline extraction, direct connection | 5.5 | SaaS, on-premises deployment | -- | Supported | |
IBM DB2 | Offline extraction | 11.5.4.0 | SaaS, on-premises deployment | -- | Supported | |
Oracle | Offline extraction, direct connection | 11g Enterprise Edition Release | SaaS, on-premises deployment | -- | Supported | |
PostgreSQL | Offline extraction, direct connection | 8 | SaaS, on-premises deployment | -- | Supported | |
OpenGauss | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
SQL Server | Offline extraction | 2012 | SaaS, on-premises deployment | -- | Supported | |
Teradata | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
Doris | Offline extraction, direct connection | -- | SaaS, on-premises deployment | -- | Supported | |
Damon | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
TiDB | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
GoldenDB | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
OceanBase MySQL | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
OceanBase Oracle | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
Hive | Offline extraction | 1.x | SaaS, on-premises deployment | -- | Supported | |
MaxCompute | Offline extraction | 1.0 | SaaS, on-premises deployment | -- | Supported | |
Transwarp Inceptor | Offline extraction, direct connection | -- | SaaS, on-premises deployment | -- | -- | |
StarRocks | Offline extraction, direct connection | -- | SaaS, on-premises deployment | -- | Supported | |
Huawei FusionInsight | Offline extraction | -- | SaaS, on-premises deployment | V2.56.1 | Supported | |
Tencent Cloud DLC | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
DataFinder | Direct connection | -- | SaaS, on-premises deployment | On-premises deployment: | Not supported | |
LAS (public cloud version) | Offline extraction | -- | SaaS, on-premises deployment | -- | Supported | |
Intelligent Outbound Calling | Offline extraction | Intelligent Outbound Calling requires version December 2022 or later | SaaS, on-premises deployment | Intelligent Outbound Calling: version after 2022.12; | -- | |
Metadata connection and application | -- | -- | On-premises deployment | -- | -- | |
Ocean Engine/Qianchuan | Offline extraction | -- | SaaS, on-premises deployment | -- | Not supported | |
REST API | Offline extraction | -- | SaaS, on-premises deployment | -- | Not supported | |
Content platform | Offline extraction | -- | SaaS, on-premises deployment | V2.44.0 | Not supported | |
MongoDB | Offline extraction | 4.4.4 | SaaS, on-premises deployment | -- | Supported | |
WeChat Official Account | Offline extraction | -- | SaaS, on-premises deployment | SaaS cloud hosting: after 2024.4.11 | Not supported | |
Constellation data | Direct connection | -- | SaaS, on-premises deployment | SaaS cloud hosting: after 2024.4.11 | Not supported | |
Calendar data | Direct connection | -- | SaaS, on-premises deployment | SaaS cloud hosting: after 2024.4.11 | Not supported | |
Lark Spreadsheet | Offline extraction | -- | SaaS, on-premises deployment | -- | Not supported | |
Lark Bitable | Offline extraction | -- | SaaS, on-premises deployment | -- | Not supported | |
Lark Project (Meego) data | Offline extraction | -- | SaaS, on-premises deployment | V2.72.0 | Not supported | Feishu Project (Meego) data |
Alibaba Cloud OSS | Offline extraction | -- | SaaS, on-premises deployment | V2.74.0 | Not supported | |
Tencent Cloud COS | Offline extraction | -- | SaaS, on-premises deployment | V2.74.0 | Not supported | |
Volcano Engine TOS | Offline extraction | -- | SaaS, on-premises deployment | V2.74.0 | Not supported | |
Transwarp ArgoDB | Offline extraction, direct connection | 5.2 | SaaS, on-premises deployment | V2.78.0 | Not supported | |
VastBase | Offline extraction | G100 2.2.10 | SaaS, on-premises deployment | V2.78.0 | Not supported | |
Hetu | Offline extraction, direct connection | 3.3 | SaaS, on-premises deployment | V2.78.0 | Not supported | |
Gbase 8a jdbc | Offline extraction | -- | SaaS, on-premises deployment | V2.83.0 | Supported | |
KingbaseES | Offline extraction, direct connection | v9 All Market Edition - MySQL compatibility mode | SaaS, on-premises deployment | V2.91.0 | Supported |
This section describes the general configuration for quickly connecting to BytePlus database and data warehouse data sources. For connection configuration guides for database data sources and other data sources, see List of supported databases.
Operation steps:
Go to the BytePlus DataWind product, enter a specific project, click Data Preparation, find Data Connection in the drop-down list, and click Data Connection.
Select the type of data source to connect to.
Configure the corresponding parameters. You can refer to the following demo database information for MySQL.
The relevant parameter configuration instructions are as follows:Name
Description
Example value
Data connection name
The display name in the data source configuration list.
Demo data source
Server
Enter the IP address.
10.225.34.22
Port
Enter the correct port number.
3306
Username
The username for the database.
DataWind_admin
Password
The password for the database.
DataWind_password123
Permission mode
Both read and write modes are supported.
Read
tip
The example values provided are for reference only and are not valid connections that can be used directly.
Click Connection Test to test the connectivity of the data source. After the test is successful, confirm and save.
Find the data connections you have created.
In the Data Connection directory (left panel), you can filter and search based on your permissions.warning
This feature is supported in v2.54.0 and later versions.
