Docs

Volcengine Kubernetes Engine

MiniMax model deployment

Quickly deploying the MiniMax-M2.7 model by using the LLM general-purpose template

This topic mainly describes how to quickly deploy the MiniMax-M2.7 model in a VKE cluster by using the ServingKit LLM general-purpose template.

Background

MiniMax-M2.7 is an open-source LLM provided by MiniMax. It supports a maximum context window of 196K tokens and has 229B total parameters and 10B active parameters during inference. This model is the result of MiniMax being deeply involved in its own evolution. It can build complex agent frameworks and complete highly sophisticated productivity tasks. This topic describes how to quickly deploy the MiniMax-M2.7 model in a Kubernetes cluster by using the LLM general-purpose template.

Notes

To ensure successful deployment, which involves multiple components depending on each other and a variety of configurations, you need to exactly follow the instructions in this document.

To achieve the expected results and conform to the limits of VKE, you need to perform operations by following the solution described in this article or on the recommended resources. If you need to change your solution, you can consult the Account Manager of the Volcano Engine.

Do not use mGPU to partition GPU resources.

Preparation

Some resources of Volcano Engine at the beta stage are required to deploy AI services. To use the following resources, contact your account manager.

Beta resource	Related service	Description
hpcpni3ln instance optimized for High-Performance Computing based on GPU	GPU Cloud Computing	The HPC instance, providing computing power. When you deploy the MiniMax-M2.7 model, we recommend that you apply for one GPU instance with the ecs.hpcpni3ln.45xlarge specification.

this example, APIG is used to expose the service. Therefore, you need to prepare an APIG instance. You can create an APIG instance in advance, use an existing APIG instance, or leverage automatic instance creation during application deployment on ServingKit.

tip

In create an APIG instance in advance or use an existing one, ensure that the region of the instance matches the region of the VKE cluster. We recommend an instance with both Public network and Private network selected for Network type. For details about creating APIG instances, see Creating instances.

You need to create a high-performance compute (HPC) cluster to achieve logical isolation of HPC GPU instances (compute nodes). Instances in the same cluster are interconnected by Remote Direct Memory Access (RDMA) networks. For details, see Creating HPC clusters.

tip

The HPC cluster must be deployed in the same region and availability zone as the VKE cluster.

Procedure

Step 1: Create a VKE heterogeneous computing cluster

Quickly create a heterogeneous computing cluster by using a VKE cluster template. Take note of the parameter configurations listed in the following table. For more details, see Using a cluster template to create managed clusters for heterogeneous computing.

Parameter	Description
Cluster and node pool configuration
Region	The Region and Availability zone of the cluster must be consistent with those of the prepared HPC cluster. You can switch regions in the top navigation bar.
Availability zone
Instance type	Select the ecs.hpcpni3ln.45xlarge specification of the High Performance Computing Optimized type.
Number of nodes	Set the value to 1.
Advanced settings
Data volume	Configure the following two data volumes: ESSD: set capacity to 1024 GiB and the performance level to the default PL0. Local SSD: Specify /data01 as the mount directory. warning The data01 directory will be used as a dependency later and therefore cannot be modified. Ensure the data that needs long-term storage has been backed up properly in case of computer crashes or disk damage which causes data loss.

Step 2: Deploy MiniMax-M2.7

Download and deploy the model using the LLM General Template provided by ServingKit. During deployment, take note of the parameter configurations listed in the following table. For descriptions of other parameters and detailed procedures, see Deploying general-purpose LLM template applications.

Parameter	Description
Select framework and orchestration
Image	Select Custom and select an appropriate image from the following image addresses based on the region where your business is deployed. China (Beijing): ai-containers-cn-beijing.cr.volces.com/deeplearning/sglang:v0.5.10.byted.202604131511 China (Shanghai): ai-containers-cn-shanghai.cr.volces.com/deeplearning/sglang:v0.5.10.byted.202604131511 Asia Pacific (Johor): ai-containers-ap-southeast-1.cr.volces.com/deeplearning/sglang:v0.5.10.byted.202604131511
Model configuration	StorageClass type: Select Data volume. Select Models: Click Add predefined model, select the MiniMax-M2.7 model, and set Mount path to /data01 and Container mounting path to /data/models. The path settings specify that the model data will be downloaded to the /data01 directory.
Inference mode	Select PD co-location.
Instance specification	Number of instances: Set the value to 1. Single instance GPUs: Set the value to 4.
Resource configuration	Select the VKE heterogeneous computing cluster created in Step 1 and the node pool containing nodes with the ecs.hpcpni3ln.45xlarge specification in the cluster.
Start command	Add the following startup command. For a detailed description of each field in the startup command, see the "Startup command descriptions" table below. GLOO_SOCKET_IFNAME=eth0 NCCL_MIN_NCHANNELS=24 NCCL_IB_QPS_PER_CONNECTION=8 python -m sglang.launch_server --model-path /data/models/MiniMax-M2.7 --tp-size 4 --ep-size 4 --tool-call-parser minimax-m2 --reasoning-parser minimax-append-think --trust-remote-code --host 0.0.0.0 --port 8000 --mem-fraction-static 0.8 --enable-metrics Set Port number to 8000.
API Gateway	Select Enable and associate the prepared APIG instance. tip You can also select Automatically create to have an automatically created APIG instance with a fixed instance specification and configuration specified by ServingKit. Creating an APIG instance will incur fees. For details, see APIG billing.

Startup command descriptions

Parameter	Type	Description	Sample value
python -m sglang.launch_server	Startup command	Start the SGLang model server by using the Python method. This field is a command entry instead of a parameter.	None
--model	Path/Model ID	The loaded LLM model. You can set this field to the following values: Hugging Face model ID Local model path	/data/models/MiniMax-M2.7/
--tp	Integer	Configure tensor parallelism.	4
--ep	Integer	Configure expert parallelism.	4
--host	IP address	The host address bound to the service.	0.0.0.0
--port	Integer	The port number that the service listens on, which is used to connect to the client.	8000
--enable-metrics	Command	Collect basic observability metrics. For detailed metric descriptions, see SGLang documentation.	None

After successful application deployment, model startup time varies depending on model size. After the application status changes to Running, view the logs of the corresponding instance on the Application details page. If the log contains the following message: The server is fired up and ready to roll!, the model in the application has started successfully and is accessible.

If you Step 3: Access the service

After you deploy the MiniMax-M2.7 model service, obtain the service domain name and access the service.

Obtain the domain name of the MiniMax-M2.7 model service.

Click ServingKit > List of AI applications in the left navigation pane of the VKE console. On the page that appears, find the deployed MiniMax-M2.7 model application.

Click the → icon in the application section to go to the application details page and view Service domain names.

In a terminal where the curl command is available, run the following command to access the MiniMax-M2.7 model service.

tip

Replace ${your_service_domain_name} with the service domain name obtained in the previous step.

If no terminal is available, you can log in to the node where the model is deployed by using the ECS Terminal method and use the curl command to access the service. For detailed operations, see ECS Terminal.

curl -X POST http://${your_service_domain_name}/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "MiniMax-M2.7",
"messages": [
{
"role": "user",
"content": "Introduce yourself"
}
],
"max_tokens": 500,
"temperature": 0.7
}'

The descriptions of parameters are as follows:

Parameter	Description	Sample value
model	The model to use.	MiniMax-M2.7
messages	The message list of the conversation. role: The role that initiates the message. content: The content of the message.	None
max_tokens	Specify the maximum number of tokens generated by the model for completion in a single request. Valid values: 1 to 8192. The value must be an integer. Default value: 4096.	500
temperature	The sampling temperature. Valid values: 0 to 2. A higher temperature (such as 1) results in more random output. A lower temperature (such as 0.2) results in more focused and deterministic output.	0.7

The following figure displays the expected response after you run the command.

Subsequent operations

Enhance service security

You can enhance the security of the MiniMax-M2.7 service by using the API Key of APIG.

Create a consumer for the APIG instance. For detailed operations, see Creating consumers.

Generate the Key Auth plugin credential based on the consumer. For detailed operations, see Generating credentials.

Enable the Key Auth plugin: In the left navigation bar, click Plugin Center. On the page that appears, click Key Auth in the Plugin Category section and then click Create Plugin. Specify the parameters of the plugin.

Effective level: Select Routing level, and specify the instance, service, and route to which the plugin belongs.

Authentication configuration: Select header, and specify Authorization as the source, which indicates that the API Key is carried in the Authorization header of the request.

Consumer: Select the consumer created in Step 1 or select all, which indicates that the configuration also applies to newly created consumers.

Keep the default values for other parameters.

After you enable Key Auth plugin authentication, when you access the service by executing the corresponding command, credentials must be included. Otherwise, a message that indicates insufficient permissions will be returned.

curl http://${your_service_domain_name}/v1/chat/completions -X POST \
-H "Content-Type: application/json" \
-H "Authorization: Bearer ${your_api_key}" \
-d '{
"model": "MiniMax-M2.7",
"messages": [
{
"role": "user",
"content": "Who won the world series in 2020?"
}
],
"max_tokens": 500,
"temperature": 0.7
}'

Enabling observability

ServingKit AI applications support basic cloud-native observability capabilities by default. You can view the application monitoring dashboard on the AI application details page.

Click ServingKit > List of AI applications in the left navigation pane of the VKE console. On the page that appears, find the deployed MiniMax-M2.7 model application.

Click the → icon in the application section to go to the application details page and view the dashboard on the Observability tab.

tip

If you have not enabled the observability capability of the relevant cluster, enable observability based on the prompts in the console. For operations related to cloud-native observability capabilities, see Enabling observability and VKE observability.

Last updated: 2026.08.03 21:49:41