Torch Object Storage
Torch Object Storage
Torch Object Storage
Document
What's New
Announcements
Billing
Billable items
Billing method
Getting Started
User Guide
Working with buckets
Basic configurations
Managing lifecycle
Back-to-origin rules
Event notification
Intelligent Tiering
Permissions
Domain management
Fault tolerance and disaster recovery
Cross-region replication
Same-region replication
Data redundancy
Image processing
ObjectSet
Working with objects
Managing folders
Monitoring and alerting
Metric monitoring
Access control
Bucket policies
Common configuration scenarios
Authorizing IAM users of the current account
Authorizing other accounts
Managing access via tools and SDKs
Managing public read access
Data security
Access points
Multi-region access points (MRAP)
Single-region access points (SRAP)
Converged access points (CAP)
DevMind
TOS accelerator
SenseFlow
TOS Agent
Data processing
Basic concepts
Image processing
Media processing
Document preview
Task processing
Data subscription
Flow control management
Quality of Service (QoS) policies
Hierarchical namespace (HNS)
User guide
Tool reference
Best practices
TOS Vectors
User guide
API reference
Vector bucket
Vector index
SDK reference
Python-Vectors
Vector bucket
Vector index
Java-Vectors
Vector bucket
Vector index
Node.js-Vectors
Vector bucket
Vector index
Tool Guide
tosutil
Common commands
Upload, download, and copy objects
Share objects
Auxiliary commands
Common examples
TOS Browser
FSX
FSX best practices
TOS PyTorch Connector
tosfsspec
API Reference
Signature Mechanism
The header contains a signature
Bucket
Basic Bucket Operations
Bucket Lifecycle
Access Monitor
Bucket ACL
Bucket CORS
Bucket Policy
Back-to-origin Rules
Bucket Replication
Versioning
Static Website
Event Notification
Custom Domain
Server-side encryption
Transfer Acceleration
Data Processing
Image processing
Media processing
Video transcoding
Audio transcoding
video to GIF
Document preview
File decompression
Log Storage
Retention Policy
Requester pays
TLS version
Object
Basic Object Operations
Object ACL
Fetch Object
Symbolic Link
WORM object
Multipart Upload
SDK Reference
Java
Pre-signing Mechanism
Bucket Interface
Basic Bucket Interface
Manage Bucket Configuration
Object Interface
Upload Object
Download Object
Upload and Download Speed Limit
Copy Object
List Object
Data Processing
Image Processing
Video Processing
Audio Processing
Log Configuration
Hierarchical Namespace
Bucket base interface
Introduction to Typical Scenes
Python
Data processing
Pre-signature mechanism
Bucket interface
Basic bucket interface
Manage bucket configuration
Object interface
Upload object
Download object
Copy object
List objects
Introduction to typical scenes
C
Object Interface
Upload object
C++
Pre-signature Mechanism
Bucket Interface
Basic Bucket Interface
Manage Bucket Configuration
Object Interface
Upload Object
Download Object
Copy Object
List Objects
Data Processing
Go
Object Interface
Upload Object
Download Object
Copy Object
List Objects
Manage Objects
Bucket Interface
Manage Bucket Configuration
Data Processing
Log Configuration
Introduction to Typical Scenes
Pre-signature Mechanism
Node.js
Pre-signature Mechanism
Bucket Interface
Basic Bucket Interface
Manage Bucket Configuration
Object Interface
Upload object
Download object
Copy object
List objects
Data Processing
Image Processing
Introduction to Typical Scenes
Browser.js
Pre-signature Mechanism
Upload Object
Download Object
Copy Object
List Objects
Manage Objects
Data Processing
.NET
Bucket Interface
Object Interface
Upload Object
Download Object
List Objects
Introduction to Typical Scenes
PHP
Bucket Interface
Object Interface
Download Object
Data Processing
Exception Handling
Android
Bucket Interface
Object Interface
Upload Object
Download Object
Exception Handling
iOS
Bucket Interface
Object Interface
Upload Object
Download Object
Harmony
Pre-signature Mechanism
Bucket Interface
Object Interface
Upload Object
Download Object
List Objects v2
Introduction to Typical Scenarios
Rust
Pre-signing mechanism
Bucket interface
Basic bucket operations
Lifecycle rules
Bucket ACLs
Cross-origin resource sharing
Bucket inventory
Back-to-origin rules
Bucket replication
Static website hosting
Event notification
Custom domain
Server-side encryption
Object interface
Basic operation
Access control
Error Codes
01-SERVICE_ERROR
02-AUTH
03-ACCESS_CONTROL
04-QOS
05-REQUEST
06-BUCKET
07-LIFECYCLE
08-ACL
09-CORS
10-POLICY
11-MIRROR
12-REPLICATION
13-WEBSITE
14-NOTIFICATION
15-ENCRYPT
16-CUSTOMDOMAIN
17-OBJECT
18-TAG
19-MULTIPART
20-STORAGE_CLASS
21-CALLBACK
22-DATA_PROCESS
23-BATCH
24-STORAGE_LENS
25-INVENTORY
26-DIRECTORY_BUCKET
FAQ
Best Practices
AIGC-Doubao LLMs
Accessing TOS with third-party tools
Granting temporary access
Data migration
Data processing
Checking data integrity
Performance optimization
- Documentation
Torch Object StorageBest PracticesGranting temporary accessUsing pre-signed URLs for secure data downloads
Copy page
Download PDFGranting temporary access
Using pre-signed URLs for secure data downloads
Copy pageDownload PDFUsing pre-signed URLs for secure data downloads
You can securely upload and download data to and from TOS using pre-signed URLs. This topic provides essential information and instructions for using pre-signed URLs to access TOS.
Use cases
Applications such as video surveillance, mobile apps, and web platforms often require uploading or downloading files, such as images, documents, and videos, to or from the server. In these scenarios, you can use TOS's HTTP capabilities for cost-effective and efficient transfer data. Meanwhile, the serverless nature of TOS allows it to adapt seamlessly to business growth or contraction, providing flexible scalability to meet changing demands.
Solution approach
Roles involved
- Client: Controlled by the backend server. It facilitates interaction between humans or machines within the final environment and performs data uploads or downloads according to different workflows.
- Application server: The brain of the entire business system, responsible for client management and access control. In this scenario, its primary function is to generate pre-signed URLs.
- TOS: A key-value storage system that provides HTTP interfaces.
- IAM: Provides access control for accounts and users in public cloud services.
How it works
- First, an application server creates an IAM user and grants this user permission to access the TOS bucket and its objects. Then, it obtains the user's access key ID and secret access key.
- When a client requests a temporary URL from the application server, the server generates a pre-signed URL valid for a period determined by the upload or download. Then, the application server logs the uploaded or downloaded objects in the database for future reference.
- After obtaining the pre-signed URL, the client uses it to interact with TOS and perform upload or download operations.
- When a request to upload or download is received, the TOS server interacts with IAM to obtain the corresponding keys. The server then uses these keys to calculate the signature and compares it with the client’s request to verify its legitimacy. If the request is valid, the server proceeds with it.
- The client receives the results, marking the conclusion of the process.
Advantages and disadvantages
The advantages and disadvantages of using pre-signed URLs for uploads and downloads are as follows:
Category | Description |
Category | Description |
Advantages |
|
Disadvantages |
|
Instructions
Prerequisites
- You have created an IAM user, granted it the necessary permissions, and obtained its access key ID and secret access key. Refer to the following documentation for instructions:
- Create a TOS bucket and organize your data by creating folders as needed. Refer to the following documentation for instructions:
Steps
Step 1: Use the appropriate SDK to generate a pre-signed URL
- Choose an SDK that aligns with your programming language and meets your business needs.
- To accelerate development, choose a TOS SDK in a language that matches your application server architecture design.
- For a list of SDK languages supported by TOS, see SDK overview.
- Develop and integrate the business code.
- This section uses Go as an example to show how to generate a pre-signed URL for downloading objects.
tip
package main
import (
"context""fmt""github.com/volcengine/ve-tos-golang-sdk/v2/tos"
)
func checkErr(err error) {
if err != nil {
if ServerErr, ok := err.(*tos.TosServerError); ok {
fmt.Println("Error:", ServerErr.Error())
fmt.Println("Request ID:", ServerErr.RequestID)
fmt.Println("Response Status Code:", ServerErr.StatusCode)
fmt.Println("Response Header:", ServerErr.Header)
fmt.Println("Response Err Code:", ServerErr.Code)
fmt.Println("Response Err Msg:", ServerErr.Message)
} else if clientErr, ok := err.(*tos.TosClientError); ok {
fmt.Println("Error:", clientErr.Error())
fmt.Println("Client Cause Err:", clientErr.Cause.Error())
} else {
fmt.Println("Error:", err)
}
panic(err)
}
}
func main() {
var (
accessKey = "*** Provide your access key ***"
secretKey = "*** Provide your secret key ***"// Provide the endpoint of your bucket, e.g., https://tos-cn-beijing.volces.com (for China (Beijing))
endpoint = "https://tos-cn-beijing.volces.com"
region = "cn-beijing"// Enter your RegionID
bucketName = "*** Provide your bucket name ***"
objectKey = "example_dir/example.txt"
ctx = context.Background()
// Full path of the local file, e.g., usr/local/testfile.txt
fileName = "/usr/local/testfile.txt"
)
// Initialize client
client, err := tos.NewClientV2(endpoint, tos.WithRegion(region), tos.WithCredentials(tos.NewStaticCredentials(accessKey, secretKey)))
checkErr(err)
// Set request method, bucket object name, expiry time
respTempUrl,errURL:=client.PreSignedURL(&tos.PreSignedURLInput{
HTTPMethod: enum.HttpMethodGet,
Bucket: bucketName,
Key: objectKey,
Expires: 3600, // 3,600 seconds
})
checkErr(errURL)
fmt.Println(respTempUrl.SignedUrl)
}
Step 2: Use the pre-signed URL to send a GET request
This section uses Browser.js code to show how to send requests from the client.
warning
When developing on a web platform, create a cross-origin resource sharing (CORS) rule. For instructions, see CORS rules.
<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.3.1/jquery.min.js"></script>
<script>
$(document).ready(function(){
const Url='https://jsonplaceholder.typicode.com/posts'
$('.btn').click(function(){
$.ajax({
url: Url,
type: "GET",
success: function(result){
console.log(result)
},
error:function(error){
console.log(`Error ${error}`)
}
})
})
})
</script>
Last updated: 2026.10.12 14:16:23
All rights reserved © Beijing Volcano Engine Technology Co., Ltd2024
