You can create datasets by connecting to Amazon Athena starting from version V2.44.0.

The following describes two methods for creating a data connection.

2.1 Create a dataset from a data connection #

(1) Enter BytePlus, click to enter a specific project, click Data Preparation, find Data Connection in the drop-down list, and click Data Connection.

(2) On the page, select Amazon Athena.

(3) Fill in the required basic information, test the connection, and click Save after the connection is successful.

(4) After confirming that the basic information of the data connection is correct, the data connection is completed.
(5) This connection can be used as a data source to create a dataset: click Data Preparation --> Dataset, and click the "New" button in the upper left corner to create a new dataset.

(6) Search or scroll through existing connections, and select the previously created data source.

2.2 Create a dataset from scratch #

(1) Enter BytePlus, click Data Preparation --> Dataset, and click the "New" button in the upper left corner to create a new dataset.

(2) When selecting a data connection, click "New Configuration".

The subsequent steps are the same as steps (2) and (3) in 2.1. Once the upload is complete, you will remain in the pop-up window to select a data connection for the dataset and can proceed directly to the next step of dataset creation.

3.1 AK and SK #

The Access Key ID and Secret Access Key in the basic information of the data connection correspond to Amazon's AK and SK:

• You can log in to Amazon, then click "My Security Credentials" under the profile icon
• Click Amazon IAM credentials, find [Access Key ID] (choose any one), and the SK generated with this ID (the information saved by yourself when generating the AK)
• Enter [Access Key ID] in the Access Key ID field, and enter [the SK corresponding to this ID] in the Secret Access Key field.

3.2 Region #

Use the above account to access S3 to be connected. The Region information of the data source can be obtained from the URL, for example, https://console.amazonaws.cn/s3/buckets?region=cn-north-1, where the Region is cn-north-1
This Region information can be entered in the data connection information

3.3 S3 temporary directory (S3OutputLocation) #

• Since Athena is a SQL engine, intermediate calculation results need to be stored, so this directory is required.
• The user can specify a location on their own S3. Caution: It is sufficient that the account currently in use has read and write permissions for the directory.