Docs

Torch Object Storage

Upload object

Append upload (Python SDK)

The object type created by append upload is Appendable Object, which can append and write data to the end of the object. The object types created by ordinary uploads and sharded uploads are of normal type (Normal Object), and data cannot be appended and written.

Precautions

You must have the tos: PutObjectpermission before appending an object, see Overview.

When uploading an object, the object name must meet certain specifications. For details, see Common Concepts.

TOS is a distributed object storage product designed for mass storage. The internal partition stores object index data. In order to scale out the maximum throughput when uploading and downloading objects, and reduce the probability of hotspot partitions, please avoid using lexicographically increasing object naming.

If an object with the same name already exists in the bucket, the new object will overwrite the existing object. In the case of multiple versions of the bucket, the original object will be retained and a new version number will be generated to identify the newly uploaded object.

The additional upload object does not support the Chunk-Encoded request method. When you add the upload network stream, please iterate to obtain the data and then add the upload.

Restriction statement

When using append uploads, the restrictions are as follows:

The append object size cannot be greater than 5GiB.

An object created by append upload. When a normal upload is performed, the object is overwritten and the object type is changed from append type to normal type. On the contrary, objects uploaded through normal do not support additional write operations.

The object created by append upload does not support copying.

If your bucket is in a state where multi-version functionality is on or on, or if the bucket type is low-frequency storage, you cannot append write objects.

Sample code

Append upload character stream

The following code is used to append the character stream to the object-test object in the target bucket-testobject-test object in the target bucket-test.

Append upload Bytes stream

The following code appends the Bytes stream to the object-test object in the target bucket-testobject-test object in the target bucket-test.

Append upload network stream

The following code appends the network stream to the object-test object in the target bucket -test .object-test object in the target bucket -test.

Progress bar processing

tip

For data in the form of strings, bytes, and local files, progress bar functionality is supported. Data of types such as network streams cannot obtain the size of the uploaded content, so the callback does not return the overall size of the object.

The following code is used to add a progress bar feature to the append upload process.

Client side speed limit

The following code is used to append the client side speed limit during upload.