Torch Log Service
Parameter | Type | Required | Example value | Description |
Parameter | Type | Required | Example value | Description |
ContentInfo | No | / | Log content delivery format configuration. | |
KafkaShipperInfo | No | / | Kafka delivery configuration. | |
ShipperId | String | Yes | 4a9bd4bd-53f1-43ff-b88a-64ee1be5**** | Delivery configuration ID. |
ShipperName | String | No | test | |
ShipperType | String | No | tos | Type of data source for delivery. Optional values:
|
Status | Boolean | No | true | Enable the delivery configuration. The default value is true. |
TosShipperInfo | No | / | Information related to delivery to TOS object storage. | |
RoleTrn | String | No | trn:iam::2100000001:role/TLSETLAccessForUserA | Trn for custom roles. |
Parameters | Type | Required | Example value | Description |
Parameters | Type | Required | Example value | Description |
Format | String | No | json | Log content parsing format.
|
CsvInfo | No | / | Configuration for CSV-format log content. | |
JsonInfo | No | / | JSON/JSONL format log content configuration. |
Parameter | Type | Required | Example value | Description |
Parameter | Type | Required | Example value | Description |
Compress | String | Yes | snappy | Compression format; currently supports snappy, gzip, lz4, and none. |
Instance | String | Yes | kafka-cnngbnntswg1**** | Kafka instance. |
KafkaTopic | String | Yes | topic-c | Kafka Topic name. All log data delivered using this configuration will be sent to this Topic. |
Parameter | Type | Required | Example value | Description |
Parameter | Type | Required | Example value | Description |
Prefix | String | No | testprefix | Top-level directory name for the bucket. All log data delivered through this configuration will be stored in this directory.
|
MaxSize | Integer | No | 5 | The maximum size of raw files that can be delivered in each shard, which refers to the uncompressed log file size. The unit is MiB. Accepted values range from 5 to 256. |
Compress | String | No | snappy | Compression formats: Currently supports snappy, gzip, lz4, and none. |
Interval | Integer | No | 300 | Delivery interval in seconds; valid range is 300–900. |
PartitionFormat | String | No | %Y/%m/%d/%H/%M | Shard rules for log delivery.
|
Parameter | Type | Required | Example value | Description |
Parameter | Type | Required | Example value | Description |
Keys | Array of String | Yes | ["user","log","ip"] | Configure the fields to be delivered
|
Delimiter | String | Yes | , | Separator. You can use a comma, tab, vertical bar, semicolon, or space. |
EscapeChar | String | Yes | false | Escape character: When a field contains a separator, use an escape character to enclose the field. Only single quotes, double quotes, and empty characters are supported. |
PrintHeader | Boolean | Yes | false | Print the key in the first row. |
NonFieldContent | String | Yes | test | Content for invalid fields; length must be between 0 and 128 characters. |
Parameter | Type | Required | Example value | Description |
Parameter | Type | Required | Example value | Description |
Keys | Array of String | No | ["__content", "__pod_name__"] | When delivering in JSON/JSONL format, if this parameter is not configured, all fields are delivered, including __content__ (required), __source__, __path__, __time__, __image_name__, __container_name__, __pod_name__, __pod_uid__, namespace, __tag____client_ip__, and __tag____receive_time__. |
Enable | Boolean | Yes | true | Enable flag. |
Escape | Boolean | No | true | Escape characters. This must be set to true. |