This section introduces the WorkBuddy Observability application for large model log monitoring, available in the TLS application marketplace.

Overview

WorkBuddy is a comprehensive AI office workspace developed by Tencent.

By integrating the WorkBuddy Observability log application, TLS automatically creates a dedicated WorkBuddy Trace log topic, generates visual charts, and displays session, Trace, Token, and tool invocation data, enabling trace tracking and observability. It can be used in the following scenarios:

Observability	Description
Performance analysis	Model invocation latency distribution Tool execution time ranking Token consumption trend
Error tracking	View the complete invocation trace Identify the error stage Analyze the cause of the error
Cost optimization	Identify high-consumption conversations Optimize prompts to reduce tokens Select a more cost-effective model

Prerequisites

Category	Description
Software limits	The host where WorkBuddy is deployed must have NPM and Node.js 22 or later installed.
Region restriction	The host where WorkBuddy is deployed and TLS must be in the same region to ensure network connectivity.
Authentication method	Obtain the user's Access Key ID, Secret Access Key, or APIKey according to the authentication method. AK/SK: AccessKey ID and AccessKey Secret for Volcano Engine accounts. Obtain them on the Volcano Engine console Key Management page. We recommend using IAM user keys. Ensure this user has the required permissions. For details, see IAM overview. Supports automatic creation of TLS resources (project/app/topic) and auto-generates log topic IDs. API Key: A key credential for requesting Volcano TLS. It is used only for reporting Log, Metric, and Trace data. Enforces strict permissions and does not support auto creation of TLS resources. It is suitable for multi-data center environments and strict permission management scenarios. Notice API Key is in closed beta. If needed, contact your account manager for access to the allowlist.

1. Integrate the WorkBuddy log application

Log in to TLS console.

Select the region where log service is located from the top navigation bar.

In the left navigation bar, select AgentLoop > AI observability.

On the AI observability page, click Integrate AI observability.

On the Integrate AI observability page, create an application.

Click the WorkBuddy icon and select the WorkBuddy application.

Configure the integration application parameters, then click Create application.

Parameters	Description
Region	The region where the log application data is stored.
Log project	Select the project where log application data is stored. Notice After the log application is created successfully, a log topic with the WorkBuddy tag will be automatically created in the project to store trace data. The relevant information for this log topic is as follows: Log topic name: Application name_trace Number of shards: 2 Log storage period: Standard storage for 90 days Index: Key-value index configured automatically.
Application name	Enter the name of the WorkBuddy log application. Length must be between 3 and 64 characters. Only supports Chinese, lowercase letters, numbers, underscores (_), and hyphens (-). Can not start or end with a hyphen (-) or underscore (_). Cannot start with tls_, tos_, or certain reserved fields.
Description	Description information for the log application. Length limit is 0–128 characters.

After creating the application, proceed to the next step to obtain the usage guide and integrate the log application.

2. Integrate WorkBuddy application data

Obtain the usage guide for integrating WorkBuddy application data.

Go to the Integration configuration page.

When integrating the log application
After integrating the log application
When creating a WorkBuddy log application in AgentLoop, you can obtain the corresponding usage guide based on the interface prompts.
Refer to 1. Integrate the WorkBuddy log application to integrate the WorkBuddy log application.
On the Integrate AI Observation page, configure the following information in Integration configuration to obtain the usage guide.
Log in to TLS console.
Select the region where log service is located from the top navigation bar.
In the left navigation bar, select AgentLoop > AI Observation.
On the AI Observation page, enter the usage guide page as follows.
Click the integration configuration icon in the Operation column of the target log application.
Click the target log application name, then click Access management.

On the Integration configuration page, select the authentication method, configure the following information, and obtain the usage guide.

AK/SK access
API Key access
For Access method, select AK SK access.
For Connection method, select Public network or Volcano Engine internal network based on actual requirements.
In Usage guide, copy the Auto generation usage guide.
For Access method, select API Key access.
For Connection method, select Public network or Volcano Engine internal network based on actual requirements.
For API Key, select the created API Key.
In Usage guide, copy the Auto generation usage guide.

Usage guide example (AK/SK integration method):

Public network
Volcano Engine internal network

npm exec -y
--registry=https://registry.npmjs.org/
--package=@volcengine/tls-observer-workbuddy-install@latest --
tls-observer-workbuddy-install
--non-interactive
--force
--region The system autopopulates the current region.
--trace-topic-id The system autopopulates the trace-topic-id
--ak <Requires manual replace of the actual tls-ak>
--sk <Requires manual replace of the actual tls-sk>

(AK/SK method only) Modify the authentication information in the usage guide.

Enter the obtained Access Key ID and Secret Access Key into the AK and SK fields in the usage guide, respectively.

Integrate WorkBuddy Observability logs into the log application.

Log in to the server where WorkBuddy is deployed.

Execute the commands obtained from the usage guide to install the TLS plugin.

After the plugin installation is complete, restart the WorkBuddy service.

Return to the TLS console to view the observability chart data.

Monitoring chart details

The monitoring chart details for the WorkBuddy Observability application in TLS are as follows:

Type	Chart
Homepage	Request overview: Session count, conversation count, model request count, tool invocation count, request trends Cost overview: Total Tokens, Input Tokens, Output Tokens, Cache Read Tokens, Reasoning Tokens, Token consumption trend, model invocation trend Tool overview Successful invocation count, failed invocation count, tool invocation latency P90, tool invocation Top 10, tool invocation failure Top 10, tool invocation trend Model performance overview Model invocation distribution Top 10, model invocation latency P90, Provider invocation distribution, Provider invocation latency P90
Trace analysis	Homepage Total trace count, total token consumption, average tokens, P90 duration WorkBuddy invocation chain analysis Display the Trace ID, status, total latency (ms), TotalTokens, start time, end time, and more for the specified invocation chain.
Session analysis	Homepage Session count, total token consumption, model request count, average session tokens Session analysis Display the Input/Session ID, Tokens, total latency (ms), invocation chain, start time, end time, model, and more for the specified session.
Token analysis	Homepage Total Tokens, Input Tokens, Output Tokens, Cache Read Tokens, Reasoning Tokens, Input Tokens (excluding Cache), session Token consumption Top 10, model Token consumption Top 10, Token category proportion
Topic list	Display the log types, projects, log topics, and description information generated by the current log application.

Manage my applications

After the log application is successfully connected, you can manage connected log applications as follows:

AgentLoop

Application marketplace

Log in to TLS console.

Select the region where log service is located from the top navigation bar.

In the left navigation bar, select AgentLoop > AI observation.

On the AI observation page, in the Actions column for the corresponding log application, the following management operations are supported:

Edit application information: Click the edit icon to modify the application name and description information.

Obtain a usage guide: Click the access configuration icon to open the access configuration dialog box, where you can obtain sample information for the usage guide.

Delete my application: Click the delete icon to delete this log application.

Application name_trace (log topic) log fields

Field	Type	Description
Attributes	json	Custom key-value pairs attached to the Span, recording business-related information.
Duration	long	The duration of the Span (End - Start), measuring the time consumed by the operation.
End	long	Span end time.
Events	text	Events that occur during the Span lifecycle.
Host	text	The host running the service.
Kind	text	The type of the Span.
Links	text	References to other Spans (used for cross-Trace associations, such as asynchronous task scenarios).
Name	text	The name of the Span, usually describing the operation.
OTLPName	text	The original name reported via the OTLP protocol (OTLP = OpenTelemetry Protocol).
OTLPVersion	text	The version number of the OTLP protocol used.
ParentSpanID	text	The ID of the parent Span, indicating which operation triggered the current operation. This field is empty for the root node.
Resource	json	A set of attributes describing the service itself (more comprehensive than ServiceName), such as service name, version, runtime environment, and so on.
ServiceName	text	The name of the service that generated this Span.
SpanID	text	The unique ID of the current Span.
Start	long	Span start time.
StatusCode	text	The execution result of the Span.
StatusDescription	text	Supplementary description of the execution result of the Span.
TracelD	text	The TraceID for the entire call chain. All Spans for the same request share the same TraceID.
TraceState	text	Custom trace context metadata.

Attributes

Field	Type	Description
gen_ai.input.messages	text	The complete list of input messages sent to the model.
gen_ai.provider.name	text	The name of the model provider.
gen_ai.request.model	text	The specified model name for the request.
gen_ai.tool.name	text	The name of the tool involved in this call.
gen_ai.usage.cache_read.input_tokens	long	The number of input tokens that hit the KV Cache.
gen_ai.usage.input_tokens	long	The number of input tokens consumed by this request.
gen_ai.usage.output_tokens	long	The number of output tokens consumed by this request.
gen_ai.usage.reasoning.output_tokens	long	Number of output tokens consumed by Reasoning.
gen_ai.usage.total_tokens	long	Total number of tokens.
session.id	text	ID of the current Session.
session.name	text	Name of the current Session.
tls.app.type	text	Application type identifier, indicating which log application form this Span belongs to.
tls.plugin.version	text	Version number of the observability plugin.
tool.error	text	Error message when tool execution fails.

Torch Log Service