This article introduces how to upload local Excel/CSV files to create a dataset.

• Requirements for the size of uploaded Excel/CSV files:
  • File size limit for data connection uploads: 500 MB
  • File size limit for appending files: 500 MB
  • File size limit for replacing files: 500 MB
• Requirements for column names in uploaded Excel/CSV files:
  • The first column name cannot be empty (the system only reads columns with consecutive non-empty column names)
  • Column names must be plain text and cannot start with a number, be entirely numeric, be an image, be a hyperlink, contain formulas, or consist of double underscores (__)
  • Reserved words cannot be used as column names (case-insensitive): index, constraint
  • Column names must not be duplicated
  • Column names should not be too long (recommended not to exceed 10 characters)
• Field value requirements: If the field value is in Chinese, it is recommended not to exceed 30 Chinese characters
• File encoding requirement: UTF-8
• CSV connector support scope: supports text files and supports specifying delimiters

1. Go to Byteplus, enter a specific project, click Data Preparation, find Data Connection in the drop-down list, and click Data Connection.

   

2. Select the Excel/CSV connection method on the page.
   

3. Select the Excel/CSV file to upload.

1. Go to Byteplus, click "Data Preparation" - "Dataset", and click the "Create" button in the upper left corner to create a new dataset.
   
2. When selecting a data connection, click Excel/CSV.
   
3. Select the Excel/CSV file to upload.

1. Use the previously created data connection to create a dataset. Click "Data Preparation" - "Dataset", and click the "Create" button in the upper left corner to create a new dataset.
   
2. Search for or select the previously created data connection from the drop-down list. For more information, see Dataset Creation Overview.

View basic information #

Hover the mouse over the corresponding data connection to view detailed information about the data connection, including the name, creator, and creation time.

Append files #

Local files (Excel/CSV) do not support updates, but file appending is supported. Users can manually add new data to the dataset by appending files (which is equivalent to incremental updates).

Operation steps:

1. Go to the "Data Preparation" - "Data Connection" page, and click "Edit" - "Append File".

2. Click "Upload" or "Upload File", and select a local Excel/CSV file to upload.
   
3. For successfully uploaded appended files, the system will automatically match the appended fields with the original table field names. Users can click "Preview" to verify that the matching is accurate. If there are errors, select "Re-parse" or manually adjust the correspondence between "Appended Fields" and "Original Table Fields". Once confirmed to be accurate, click "OK".
4. After saving, for datasets created using this data connection in extraction mode, manual synchronization is required to synchronize the new data with the base table. For direct connection tables, manual synchronization is not required.

Replace file #

Local files (Excel/CSV) do not support updates, but file replacement is supported. Users can update all files at once by replacing files (which is equivalent to a full update).

Operation steps:

1. Go to the "Data Preparation" - "Data Connection" page, and click "Edit" - "Replace File".
   
2. Click "Upload" or "Upload File", and select a local Excel/CSV file to upload.
   
3. For successfully uploaded replacement files, the system will automatically match the replacement fields with the original table field names. Users can click "Preview" to verify that the matching is accurate. If there are errors, select "Re-parse" or manually adjust the correspondence between "Replacement Fields" and "Original Table Fields". For new fields in the replacement file that are not needed, users can also choose "Clear New Fields". Once confirmed to be accurate, click "OK".

4. After saving, for datasets created using this data connection in extraction mode, manual synchronization is required to synchronize the new data with the base table. For direct connection tables, manual synchronization is not required.

   warning

   After replacement, downstream extracted datasets and visual models can only obtain the latest data during the next update.

Authorize data connection #

Click the "Assign permissions" button in the upper right corner of the data connection to authorize other users to use this data connection.
The available permissions include: view, edit, and manage. For more information, see Detailed Explanation of Permission Features.

Delete a data connection #

Click the delete button on the right side of the data connection to delete this data connection.