This document introduces vePFS log-related features and collection methods.

Feature overview

File storage vePFS is a high-throughput, low-latency, and scalable parallel file system service launched by Volcano Engine.

Supports delivering audit logs provided by vePFS to TLS to record file operations in specified directories, making it easier to trace and analyze operations.

Supports enabling log analysis for vePFS data migration tasks. Once enabled, you can perform real-time queries and analysis of data migration records for the relevant task.

The relevant configurations are as follows:

Configuration	Description
Log type	vePFS audit log. vePFS data migration log.
Log storage location	For audit logs, you need to manually create a project and log topic in TLS, and then configure log delivery when creating an audit policy in the vePFS console. When creating a data migration task, the corresponding project and log topic are automatically created. For details on managing log resources, see Manage vePFS log resources. Project: Audit log: Custom Data migration log: vepfs-service-project-1 Log topic: Audit log: Custom Data migration log: Data migration task ID
Log storage period	The default log storage period for data migration logs is 30 days.
Log shard	The data migration log topic is preset with 1 shard.
Index settings	Indexes are automatically configured.
Log fields	For a detailed list of log fields, see vePFS log fields.

Collect vePFS logs

For instructions on delivering data migration logs to TLS, see Create manual task.

vePFS log fields

Audit log fields

Field name	Description
accessMode	ACCESS_DENIED request type.
acls	List of ACLs involved in the request.
atime	atime of the file.
clientGroupId	Linux GID of the process reading or writing the file.
clientUserId	Linux UID of the process reading or writing the file.
ctime	ctime of the file.
event	Operation type. Includes: High-risk operations: RENAME, RMDIR, UNLINK. Medium-risk operations: OPEN, CREATE, CLOSE, ACCESS_DENIED, ACLCHANGE, XATTRCHANGE.
eventTime	Time when the request occurred.
fileSize	File size.
fsName	File system name.
inode	The inode corresponding to the file.
linkCount	Number of links for the file.
mtime	The mtime of the file.
nodeName	Client host name.
openFlags	Open flags.
ownerGroupId	GID to which the file belongs.
ownerUserId	UID to which the file belongs.
path	File path.
permissions	File permissions.
processId	Process ID corresponding to the event.
subEvent	Sub-event.
xattrs	The extended attributes requested.
bytesRead	Number of bytes requested to read from the file.
bytesWritten	Number of bytes requested to write to the file.
maxReadOffset	End position for reading the file.
maxWriteOffset	End position for writing the file.
minReadOffset	Start position for reading the file.
minWriteOffset	Start position for writing the file.

Data migration log fields

Field name	Description
type	Data flow task type. The types are as follows: TosToFileSystem Event: Preheating event FileSystemToTos Event: Settling event ManualFileDelete Event: Deletion event
success	Whether the data flow task was executed successfully.
file_name	File name.
size_bytes	File size.
object_name	Object name.
version	Object version.
crc	The object's CRC.
inode	File inode.
skipped	Whether it was skipped.