This article describes how to upload local Excel/CSV files to create datasets.
Precautions
- Requirements for the size of uploaded Excel/CSV files:
- File size limit for uploading via data connection: 500 M
- File size limit for appending files: 500 M
- File size limit for replacing files: 500 M
- Requirements for column names in uploaded Excel/CSV files:
- The column name of the first column cannot be empty (the system only reads columns with consecutive non-empty column names)
- Column names must be plain text and cannot start with a digit, consist entirely of digits, be images, hyperlinks, formulas, or be composed of double underscores (__).
- Reserved words cannot be used as column names (case-insensitive):
index, constraint - Column names must not be duplicated
- Column names should not be excessively long (recommended not to exceed 10 characters)
- Field value requirements: If the field value is in Chinese, it is recommended not to exceed 30 Chinese characters
- File encoding requirement: UTF-8
- CSV connector support scope: Supports text files & supports specifying delimiters
Create from data connection
- Log in to BytePlus, navigate to a specific project, click Data Preparation, find Data Connection in the dropdown list, and click Data Connection.

- Select the Excel/CSV connection method on the page.

- Select the Excel/CSV file to upload.

Create from dataset
- Log in to BytePlus, click "Data Preparation" - "Dataset", select the "Create" button in the upper left corner to create a new dataset.

- When selecting a data connection, click Excel/CSV.

- Select the Excel/CSV file to upload.

Next steps: Create a dataset
- Create a dataset using the previously created data connection. Click "Data Preparation" - "Dataset", select the "Create" button in the upper left corner to create a new dataset.

- Search for or select the previously created data connection from the dropdown list. For more information, please refer to Overview of Dataset Creation.

Other features
Hover the mouse over the corresponding data connection to view detailed information, including the name, creator, and creation time.

Append files
Local files (Excel/CSV) do not support updates, but file appending is supported. Users can manually add new data to the dataset by appending a file (equivalent to incremental updates).
warning
The file append feature does not affect the synchronization of data within the file prior to the append operation.
For example:
When the user performs the following operations:
April 12: The user creates a dataset using file A (containing 100 rows of data) and completes the initial synchronization.
April 13: The user uploads file B (containing 10 rows of data) using the file append feature, saves it, and resynchronizes the data.
The data in each partition in the system is as follows:
P_date=0412: 100 rows of data (from file A)
P_date=0413: 110 rows of data (from file A + file B)
The user can update the appended data to the system by resynchronizing historical data.
After resynchronizing the data for 0412, P_date=0412 should contain 110 rows of data (from file A + file B).
Operation steps:
- Go to the "Data Preparation" - "Data Connection" page, and click "Edit".

- Click the Append data button.

- Click "Upload" and select a local Excel/CSV file to upload.

- For successfully uploaded appended data, the system will automatically match the appended fields to the original table field names. Users can click "Preview" to verify whether the matching is accurate. If there are errors, select "Re-parse", or manually adjust the correspondence between "Append data" and "Original Table Fields". If there are no errors, click "OK".

- After saving, datasets created using this data connection in extraction mode require manual synchronization to sync the new data to the underlying table. Direct connection tables do not require manual synchronization.
warning
After appending, downstream data extraction and visual modeling will only obtain the latest data during the next update.
Replace file
Local files (Excel/CSV) do not support updates, but file replacement is supported. Users can update all data by replacing the file (equivalent to a full update).
warning
After a file is replaced, the data within the replaced file will stop synchronizing.
For example:
When the user performs the following operations:
April 12: The user creates a dataset using file A (containing 100 rows of data) and completes the initial synchronization.
April 13: The user uploads file B (containing 10 rows of data) using the file replace feature, saves it, and resynchronizes the data.
The data in each partition in the system is as follows:
P_date=0412: 100 rows of data (from file A)
P_date=0413: 10 rows of data (from file B)
The user can update the replaced data to the system by resynchronizing historical data.
After resynchronizing the data for 0412, P_date=0412 should contain 10 rows of data (from file B).
Operation steps:
- Go to the "Data Preparation" - "Data Connection" page, and click "Edit".


- Click "Upload" and select a local Excel/CSV file to upload.

- For successfully uploaded replacement data, the system will automatically match the replacement fields to the original table field names. Users can click "Preview" to verify whether the matching is accurate. If there are errors, select "Re-parse", or manually adjust the correspondence between "Replacement Fields" and "Original Table Fields". For new fields in the replacement data that are not needed, you can also select "Clear New Fields". If there are no errors, click "OK".

- After saving, datasets created using this data connection in extraction mode require manual synchronization to sync the new data to the underlying table. Direct connection tables do not require manual synchronization.
warning
After replacement, downstream data extraction and visual modeling will only obtain the latest data during the next update.
Authorize data connection
Click the "Permission Assignment" button in the upper right corner of the data connection to grant other users access to this data connection.
The available permissions include: view, edit, and manage. For more information, see 用户权限详解.

Delete data connection
Click the delete button on the right side of the data connection to delete this data connection.

warning
If the prompt displays "This data connection is associated with x downstream datasets that will become unavailable", proceed with caution.
