The LAS metadata management feature supports enabling the audit log function. Once enabled, metadata management operation events will be automatically written to the VolcanoEngineLog Service product (TLS), making it easier to perform retrospective audits of these operations. This document introduces the key points and core operational guidance for auditing operations in the LAS metadata management feature.
warning
After completing the above preparations, you can enable the audit log switch on the LAS metadata management page to deliver logs to TLS.
tip
After enabling the audit log switch, you can view detailed log information only on the TLS page.
tip
To view log details in the TLS Console, ensure that your operating account has at least the permissions to view log projects and log details in the TLS Console.
On the LAS metadata management page, click the TLS Log Service button to go to the TLS console page.
On the Overview page of the TLS console, you can search for the "las-audit-project" project. All log data from LAS metadata management will be delivered to this project.
After clicking the "las-audit-project" project to enter the project details page, you can view all log information.
The following is an example of an audit log record. The key fields included in each audit log and their descriptions are as follows.
{ "request_id": "string", // Unique request identifier, associates multiple events within a single request "account_id": "string", // Tenant/account ID (primary account) "user_id": "string", // User ID (sub-account or actual operator) "event_time": "timestamp", // Event occurrence time (UTC, ISO 8601 format, for example, "2023-01-01T01:01:01.123Z") "service_name": "string", // Service module name, fixed as "las_catalog" "event_name": "string", // Operation name (event type), for example, "CreateTable" "identifier": "string", // Unique identifier of the operation object, for example, "my_db.my_table" "response": { // Response status "statusCode": "integer", // HTTP status code or internal business status code "errorMessage": "string" // Error message, null if successful }, "detail": "string", // Operation details (JSON stringified), contains key parameters of the request "event_date": "string", // Event partition date (YYYY-MM-DD), used for partitioning "schema_version": "string" // Audit log schema version, for example, "1.0" }
Field name | Data type | Core meaning | Example value/Description |
|---|---|---|---|
|
| Unique request identifier |
|
|
| Tenant/account ID | Primary account |
|
| User ID | Sub-account ID |
|
| Event occurrence time (UTC) |
|
|
| Service module name |
|
|
| Operation name (event type) |
|
|
| Response status |
|
|
| Unique identifier of the operation object | You can use the
|
|
| Audit log schema version |
|
|
| Event partition date |
|
|
| Detailed operation description |
event_name | event description |
|---|---|
| Create Catalog |
| Modify Catalog |
| Get Catalog |
| Get Catalogs |
| Delete Catalog |
event_name | event description |
|---|---|
| Create Database |
| Get Database |
| Delete Database |
| Get Databases |
| Get All Databases |
| Modify Database |
| Get Metastore Db Uuid |
event_name | event description |
|---|---|
| Create Table |
| Create Table With Environment Context |
| Delete Table |
| Delete Table With Environment Context |
| Get Table |
| Get Tables |
| Get All Tables |
| Get Table Objects By Name |
| Get Table Names By Filter |
| Modify Table |
| Modify Table With Environment Context |
| Update Table Column Statistics |
| Get Table Column Statistics |
| Get Table Statistics Req |
| Delete Table Column Statistics |
| Modify Table With Cascade |
| Create Table With Constraints |
| Truncate Table |
| Get Tables By Type |
| Get Table Meta |
| Get Table Req |
| Get Table Objects By Name Req |
| Allocate Table Write Ids |
| List Table Names |
| List Table Name And Uris |
event_name | event description |
|---|---|
| Create Role |
| Delete Role |
| Get Role Names |
| Grant Role |
| Revoke Role |
| List Roles |
| Grant/Revoke Role |
| Get Principals In Role |
| Get Role Grants For Principal |
| Get Privilege Set |
| List Privileges |
| Grant Privilege |
| Revoke Privilege |
| Grant/Revoke Privilege |
| Refresh Privileges |
event_name | event description |
|---|---|
| Get Materialized Views For Rewriting |
event_name | event description |
|---|---|
| Create Function |
| Delete Function |
| Modify Function |
| Get Functions |
| Get Function |
| Get All Functions |
| List Function Names |
| List Function Name And Uris |
event_name | event description |
|---|---|
GetMetaConf | Get Meta Conf |
SetMetaConf | Set Meta Conf |
GetType | Get Type |
CreateType | Create Type |
DropType | Delete Type |
GetTypeAll | Get Type All |
GetFields | Get Fields |
GetSchema | Get Schema |
AddPartition | Add Partition |
AddPartitionWithEnvironmentContext | Add Partition With Environment Context |
AddPartitions | Add Partitions |
AddPartitionsPspec | Add Partitions Pspec |
AppendPartition | Append Partition |
AddPartitionsReq | Add Partitions Req |
AppendPartitionWithEnvironmentContext | Append Partition With Environment Context |
AppendPartitionByName | Append Partition By Name |
AppendPartitionByNameWithEnvironmentContext | Append Partition By Name With Environment Context |
DropPartition | Delete Partition |
DropPartitionWithEnvironmentContext | Delete Partition With Environment Context |
DropPartitionByName | Delete Partition By Name |
DropPartitionByNameWithEnvironmentContext | Delete Partition By Name With Environment Context |
DropPartitionsReq | Delete Partitions Req |
GetPartition | Get Partition |
ExchangePartition | Exchange Partition |
GetPartitionWithAuth | Get Partition With Auth |
GetPartitionByName | Get Partition By Name |
GetPartitions | Get Partitions |
GetPartitionsWithAuth | Get Partitions With Auth |
GetPartitionsPspec | Get Partitions Pspec |
GetPartitionNames | Get Partition Names |
GetPartitionsPs | Get Partitions Ps |
GetPartitionsPsWithAuth | Get Partitions Ps With Auth |
GetPartitionNamesPs | Get Partition Names Ps |
GetPartitionsByFilter | Get Partitions By Filter |
GetPartSpecsByFilter | Get Part Specs By Filter |
GetPartitionsByExpr | Get Partitions By Expr |
GetPartitionsByNames | Get Partitions By Names |
AlterPartition | Modify Partition |
AlterPartitions | Modify Partitions |
AlterPartitionWithEnvironmentContext | Modify Partition With Environment Context |
RenamePartition | Rename Partition |
PartitionNameHasValidCharacters | Execute Partition Name Has Valid Characters operation |
GetConfigValue | Get Config Value |
PartitionNameToVals | Execute Partition Name To Vals operation |
PartitionNameToSpec | Execute Partition Name To Spec operation |
MarkPartitionForEvent | Mark Partition For Event |
IsPartitionMarkedForEvent | Judge Partition Marked For Event |
UpdatePartitionColumnStatistics | Update Partition Column Statistics |
GetPartitionColumnStatistics | Get Partition Column Statistics |
GetPartitionsStatisticsReq | Get Partitions Statistics Req |
GetAggrStatsFor | Get Aggr Stats For |
SetAggrStatsFor | Set Aggr Stats For |
DeletePartitionColumnStatistics | Delete Partition Column Statistics |
SetUgi | Set Ugi |
GetDelegationToken | Get Delegation Token |
RenewDelegationToken | Execute Renew Delegation Token operation |
CancelDelegationToken | Cancel Delegation Token |
GetOpenTxns | Get Open Txns |
GetOpenTxnsInfo | Get Open Txns Info |
OpenTxns | Open Txns |
AbortTxn | Abort Txn |
CommitTxn | Commit Txn |
Lock | Lock |
CheckLock | Check Lock |
Unlock | Unlock |
ShowLocks | Show Locks |
Heartbeat | Send Heartbeat |
HeartbeatTxnRange | Send Heartbeat Txn Range |
Compact | Compress Data |
ShowCompact | Show Compact |
AddDynamicPartitions | Add Dynamic Partitions |
FireListenerEvent | Trigger Listener Event |
GetCurrentNotificationEventId | Get Current Notification Event Id |
GetFieldsWithEnvironmentContext | Get Fields With Environment Context |
GetNextNotification | Get Next Notification |
GetSchemaWithEnvironmentContext | Get Schema With Environment Context |
DropConstraint | Delete Constraint |
AddPrimaryKey | Add Primary Key |
AddForeignKey | Add Foreign Key |
AddUniqueConstraint | Add Unique Constraint |
AddNotNullConstraint | Add Not Null Constraint |
AddDefaultConstraint | Add Default Constraint |
AddCheckConstraint | Add Check Constraint |
GetMaterializationInvalidationInfo | Get Materialization Invalidation Info |
UpdateCreationMetadata | Update Creation Metadata |
ExchangePartitions | Exchange Partitions |
GetPartitionValues | Get Partition Values |
GetNumPartitionsByFilter | Get Num Partitions By Filter |
AlterPartitionsWithEnvironmentContext | Modify Partitions With Environment Context |
GetPrimaryKeys | Get Primary Keys |
GetForeignKeys | Get Foreign Keys |
GetUniqueConstraints | Get Unique Constraints |
GetNotNullConstraints | Get Not Null Constraints |
GetDefaultConstraints | Get Default Constraints |
GetCheckConstraints | Get Check Constraints |
AddToken | Add Token |
RemoveToken | Remove Token |
GetToken | Get Token |
GetAllTokenIdentifiers | Get All Token Identifiers |
AddMasterKey | Add Master Key |
UpdateMasterKey | Update Master Key |
RemoveMasterKey | Remove Master Key |
GetMasterKeys | Get Master Keys |
AbortTxns | Abort Txns |
ReplTblWriteidState | Execute Repl Tbl Writeid State operation |
GetValidWriteIds | Get Valid Write Ids |
Compact2 | Compress Data |
GetNotificationEventsCount | Get Notification Events Count |
FlushCache | Execute Flush Cache operation |
CmRecycle | Execute Cm Recycle operation |
GetFileMetadataByExpr | Get File Metadata By Expr |
GetFileMetadata | Get File Metadata |
PutFileMetadata | Write File Metadata |
ClearFileMetadata | Clean File Metadata |
CacheFileMetadata | Cache File Metadata |
CreateResourcePlan | Create Resource Plan |
GetResourcePlan | Get Resource Plan |
GetActiveResourcePlan | Get Active Resource Plan |
GetAllResourcePlans | Get All Resource Plans |
AlterResourcePlan | Modify Resource Plan |
ValidateResourcePlan | Validate Resource Plan |
DropResourcePlan | Delete Resource Plan |
CreateWmTrigger | Create Wm Trigger |
AlterWmTrigger | Modify Wm Trigger |
DropWmTrigger | Delete Wm Trigger |
GetTriggersForResourceplan | Get Triggers For Resourceplan |
CreateWmPool | Create Wm Pool |
AlterWmPool | Modify Wm Pool |
DropWmPool | Delete Wm Pool |
CreateOrUpdateWmMapping | Create Or Update Wm Mapping |
DropWmMapping | Delete Wm Mapping |
CreateOrDropWmTriggerToPoolMapping | Create Or Drop Wm Trigger To Pool Mapping |
CreateIschema | Create Ischema |
AlterIschema | Modify Ischema |
GetIschema | Get Ischema |
DropIschema | Delete Ischema |
AddSchemaVersion | Add Schema Version |
GetSchemaVersion | Get Schema Version |
GetSchemaLatestVersion | Get Schema Latest Version |
GetSchemaAllVersions | Get Schema All Versions |
DropSchemaVersion | Delete Schema Version |
GetSchemasByCols | Get Schemas By Cols |
MapSchemaVersionToSerde | Map Schema Version To Serde |
SetSchemaVersionState | Set Schema Version State |
AddSerde | Add Serde |
GetSerde | Get Serde |
GetLockMaterializationRebuild | Get Lock Materialization Rebuild |
HeartbeatLockMaterializationRebuild | Send Heartbeat Lock Materialization Rebuild |
AddRuntimeStats | Add Runtime Stats |
GetRuntimeStats | Get Runtime Stats |
ListVolumes | List Volumes |
ListVolumeNames | List Volume Names |
GetVolume | Get Volume |
CreateVolume | Create Volume |
AlterVolume | Modify Volume |
DropVolume | Delete Volume |
GetVolumeCredentials | Get Volume Credentials |
ListOperators | List Operators |
ListOperatorNames | List Operator Names |
GetOperator | Get Operator |
UpsertOperator | Merge Write Operator |
CreateOperator | Create Operator |
AlterOperator | Modify Operator |
BatchUpsertOperators | Execute Batch Upsert Operators operation |
DropOperator | Delete Operator |
ListVolumeNameAndUris | List Volume Name And Uris |
ListOperatorNameAndUris | List Operator Name And Uris |
GetDataVersion | Get Data Version |
CreateDataVersion | Create Data Version |
UpdateDataVersion | Update Data Version |
DeleteDataVersion | Delete Data Version |
GetOptimizer | Get Optimizer |
CreateOptimizer | Create Optimizer |
UpdateOptimizer | Update Optimizer |
DeleteOptimizer | Delete Optimizer |
RunOptimizerTask | Run Optimizer Task |
CancelOptimizerTask | Cancel Optimizer Task |
ListOptimizerTasks | List Optimizer Tasks |
GetOptimizerTask | Get Optimizer Task |
CreateOptimizerTask | Create Optimizer Task |
UpdateOptimizerTask | Update Optimizer Task |
DeleteOptimizerTask | Delete Optimizer Task |
GetOptimizerConfigOptions | Get Optimizer Config Options |