Broadcast (Beta)
Datadog
Send LLM traces to Datadog for monitoring and LLM Observability.
Datadog is a cloud monitoring and analytics platform. With its LLM Observability feature, you can track costs, latency, and quality of your LLM calls.
Setup
Get your Datadog API key
- Sign in to Datadog
- Go to Organization Settings > API Keys
- Create or copy an API key with LLM Observability permissions
See Datadog API and Application Keys for details.
Add the destination in EUrouter
- Go to Broadcast in your dashboard
- Click Add Destination next to Datadog
- Enter your API key
- Set your ML App name to identify your application in Datadog
- Update the URL if you're not in the EU region
- Click Test Connection to verify
- Click Create
Configuration
| Field | Required | Description |
|---|---|---|
| API key | Yes | Datadog API key with LLM Observability permissions |
| ML App | No | Name for your application in Datadog LLM Observability |
| URL | No | Datadog API URL for your region. Default: https://trace.agent.datadoghq.eu |
| Headers | No | Custom HTTP headers (comma-separated key=value pairs) |
Regional endpoints
| Region | URL |
|---|---|
| EU | https://trace.agent.datadoghq.eu (default) |
| US1 | https://trace.agent.datadoghq.com |
| US3 | https://trace.agent.us3.datadoghq.com |
| US5 | https://trace.agent.us5.datadoghq.com |
What you'll see in Datadog
Once connected, your LLM requests appear in Datadog LLM Observability with:
- Model and provider information
- Input/output messages (unless Privacy Mode is on)
- Token usage and estimated cost
- Latency metrics
- Your configured ML App name for filtering