Monitoring and Observability ​
The Agent Starter Pack offers robust options to monitor your agent's behavior, performance, and resource usage. This allows you to debug issues, optimize costs, and understand how your agent is functioning.
There are two primary observability features available:
Agent Telemetry Events (Cloud Trace): Provides OpenTelemetry-based tracing and spans for all agent operations, automatically exported to Google Cloud Trace. This is enabled by default and great for understanding execution flow and latency.
BigQuery Agent Analytics Plugin: An opt-in plugin for ADK-based agents that logs detailed agent events, including LLM interactions, tool calls, and outcomes, directly to BigQuery. This enables in-depth analysis, LLM based evals and observability, use of BigQuery conversational analytics and custom dashboards.
Choosing an Approach ​
| Feature | Cloud Trace Telemetry | BigQuery Agent Analytics Plugin |
|---|---|---|
| Enabling | Enabled by default | Opt-in via --bq-analytics flag |
| Primary Use Case | Execution flow, latency, debugging | Deep analysis, llm-as-a-judge, conversational analytics, dashboards |
| Data Destination | Google Cloud Trace | Google BigQuery |
| Schema | OpenTelemetry Spans | Predefined BigQuery Table Schema |
| Content Logging | Span attributes (Metadata) | Detailed JSON payloads, GCS offloading for large content |
| Agent Compatibility | All Templates | ADK-based agents only |
| Setup | None | Enable flag during project creation |
Recommendation:
- Use Cloud Trace Telemetry for real-time debugging and performance monitoring of all agents.
- Enable the BigQuery Agent Analytics Plugin when you need to perform detailed analysis on agent behavior, run LLM based evaluations, use BigQuery conversational analytics, track events over time, or build custom reporting dashboards for your ADK-based agents.