This topic provides a list of functions related to the data transformation features of TLS.

Global operation function

Function type	Function name	Description
flow control function	c_if function	If the condition is met, the corresponding operation will be performed. If not, no operation will be performed and the next condition will be checked.
		c_if_else function	Perform the corresponding operation based on the outcome of condition evaluation.
		c_switch function	If the condition is met, perform the corresponding operation and return the result; if not, skip the operation and proceed to the next condition check.
		c_compose function	Used to combine multiple operations. All operations should be global operation functions.
Event check function	f_match function	Check whether the specified log field value matches the regular expression.
Event check function		f_search function	Check whether the log contains content that matches the query statement.
Event handler functions	e_output function	Export logs to the specified log topic.
		e_auto_output function	Dynamically distribute logs to different log topics.
		e_split function	Split logs into multiple entries based on log field values.
		e_drop function	Delete logs based on specified conditions.
		e_keep function	Determine whether to keep logs based on conditions.
field handler	The v function	Retrieve the value of a specified field in the log. If multiple field names are provided, return the value of the first existing field in the log.
		f_drop function	Delete the specified field.
		f_keep function	Keep the specified field and delete all other fields.
		f_rename function	Rename the specified field.
		f_set function	Add a new field or update the value of an existing field.
field check function	f_has function	Determine whether the specified field exists.
field check function		f_not_has function	Determine whether the specified field does not exist.
Key value extraction function	ext_sep function	Extract field values based on a single separator.
		ext_sepstr function	Extract field values based on a separator string.
		ext_json function	Expand JSON strings in the specified field.
		ext_json_jmes function	Extract field values using jmes expressions.
		ext_kv function	Extract field values using two levels of separators.
		ext_regex function	Extract the value of the specified field using the designated regular expression and assign the value to other fields.
		ext_grok function	Extract specific values using regular expressions.
Enrichment mapping function	F_table_map function	Use this for mapping table data.
Enrichment mapping function		F_dict_map function	Map data with the specified dictionary, converting input fields to a new field based on the mapping rules.

Expression functions

Function type	Function name	Description
date value handler	dt_str function	Convert the value of a time expression (such as a timestamp or string) to a string.
		dt_to_timestamp function	Convert the field value of a time type to a UTC timestamp based on the specified time zone.
		dt_from_timestamp function	Convert timestamp fields of time types to a time string in the specified time zone.
		dt_now function	Get the local time during data transformation calculation.
string handler	str_join function	Join multiple strings using a separator.
		str_len function	Calculate the length of a string.
		str_replace function	String replacement.
		str_format function	String formatting.
type conversion function	ct_int function	Convert integer value base. Supports specifying the original base from 2 to 36; the default base is decimal. The result is returned as a decimal value.
		ct_float function	Convert the original type to a floating-point number.
		ct_str function	Convert the original type to a string.
		ct_bool function	Convert the original type to a bool type.
logical expression function	op_if function	If the condition is true, return the value of the first expression; if false, return the value of the second expression.
		op_and function	Operation: logical AND.
		op_or function	Operation: logical OR.
		op_not function	Operation: logical NOT.
		op_eq Function	Operation: logical equality; supports strings and numbers.
		op_ge function	Operation: greater than or equal to.
		op_gt function	Operation: greater than.
		op_le function	Operation: less than or equal to.
		op_lt function	Operation: less than.
arithmetic expression function	op_add function	Operation: accumulation.
		op_sub function	Operation: subtraction.
		op_mul function	Operation: multiplication.
		op_div function	Operation: division.
		op_sum function	Operation: addition.
		op_mod function	Operation: perform modulo.
		op_null function	Checks for null value; returns true if the value is null; otherwise returns false.
regular expression function	regex_replace function	Matches and replaces strings using regular expressions.
dictionary function	dict_make function	Builds a dictionary.
dictionary function		dict_update function	Update the values in one dictionary with another dictionary.
encoding and decoding function	md5_encoding function	Perform MD5 encoding on the specified field, i.e., calculate the MD5 value of the string.
		base64_encoding function	Encode the specified data with Base64, i.e., calculate the Base64 encoded value of the string.
		base64_decoding function	Decode data using Base64.
		str_encoding function	Encode the string according to the specified encoding format.
		str_decoding function	Decode the string according to the specified encoding format.
regular expression function	geo_parse function	Parse the location information, including geographic position and administrative divisions, based on the IP address.
regular expression function	ua_parse_device function	Parse device information from the User-Agent.
		ua_parse_os function	Parse operation system information from the User-Agent.
		ua_parse_agent function	Parse browser information from the User-Agent string.
structured processing function	if_json function	Determine whether the string is in standard JSON format.
list function	lst_make	Create a new list.
		lst_append	Add elements to the end of the list.
		lst_delete_at	Delete the element at the specified position in the list.
resource function	res_rds_mysql function	Pull table data from Volcanoengine Cloud Database MySQL and self-hosted public MySQL databases.

Torch Log Service