AI apps and agents

AI observability

One trace from the HTTP request through every agent step, tool call, model call and database query. Tokens, cost, latency and quality for every model your product uses.

Scout AI observability with requests, cost and token usage

Trusted by industry leaders

KuluGlomoDPDZeroZinc Learning Labs
Features

See what your AI is actually doing

Scout follows OpenTelemetry's GenAI semantic conventions, so every LLM call and agent run lands in the same traces, metrics and logs as the rest of your stack.

Scout LLM prompt and completion trace

Every agent run is one waterfall: invoke_agent, chat, execute_tool and MCP tool spans stitched to the HTTP, queue and database spans around them, bound by a conversation ID.

  • Tool and MCP call spans
  • Multi-agent handoffs
  • Conversation ID filter
Scout AI observability with requests, cost and token usage

Input and output tokens on every model call, rolled up by model, agent, tool or any attribute you add. Cost is estimated from a price table you control, so local models and new providers are never a blind spot.

  • Token usage by model
  • Cost by agent
  • Cost spike alerts
Scout LLM usage and cost by model

Catch the failures a successful run hides: tool calls that errored and recovered, retries, fallbacks and nested agent errors, grouped by error type.

  • Error type grouping
  • Retry and fallback counters
  • Human-wait durations
Scout LLM usage by model and prompt

Prompts and completions stay off by default. Turn them on per span or event, scrub PII before export, and attach evaluation scores to the spans they judged.

  • Evaluation events and scores
  • PII scrubbing
  • Version prompts with Scope
Open standards

Built on OpenTelemetry's GenAI conventions

No proprietary SDK. Instrument once with OpenTelemetry and send to Scout or any other OTLP backend.

  • OpenTelemetry GenAI

    The official GenAI instrumentation packages for OpenAI, Anthropic and Google, plus the semantic conventions for agents, tools and MCP, with versions pinned and documented.

  • Your framework's telemetry

    Step-by-step guides for LangGraph, LangChain, LlamaIndex, Pydantic AI, Strands Agents, Google ADK, Microsoft Agent Framework, OpenAI Agents SDK, Vercel AI SDK and Mastra.

  • Coding agents too

    Collect telemetry from Claude Code, Codex CLI and OpenClaw, and from LiteLLM and vLLM, into the same workspace.

Trusted worldwide

10s of TB
Ingested daily
Telemetry processed every day
80%
Cost reduction
Versus legacy tools
99.9%
Uptime SLA
Enterprise reliability
Customer stories

Notes from the field

“Our goal was to improve reliability without increasing cost, and base14 made that possible. The ability to view APM, infra, and database insights together has helped our team move from reactive to data-driven problem solving. It's an observability platform that actually makes engineers faster and executives more confident.”
Glomo

Sahil Kharb

Founder, Glomo

FAQ

AI observability FAQs

Common questions about tracing LLM apps and agents with Scout

See your agents end to end

Book a walkthrough with the team that wrote the guides