What is the difference between Agent Tracking and AgentOps or LangSmith?
AgentOps, LangSmith, Langfuse and similar tools trace the agents you build, from inside your own code: prompts, spans, token costs, evaluation runs. Agent Tracking measures agents other people run when they visit your website, from the outside, through a script tag and your server log. One is observability for your product; the other is analytics for your site. A team that builds agents and runs a website may need both.
By Gorden Wübbe · Updated 2026-09-08
Where each one sits
Observability lives in your application: an SDK wraps your LLM calls and tool executions and sends traces to a dashboard. It answers why your agent produced an output and what it cost. Agent Tracking lives on your web pages: a script watches referrals and tool calls, a log import watches crawlers. It answers which agents use your site and what they achieve.
What only one of them can tell you
Only observability knows the prompt, the chain of thought and the token bill of your agent. Only Agent Tracking knows that ChatGPT sent 40 visitors to your pricing page this week, that PerplexityBot fetched 300 pages last night, or that an assistant called your booking tool six times and failed on a required field. The data never overlaps, because the agents are different: yours versus everyone else's.
Why the name collides
Both fields use the word agent, and both count tool calls. The difference is whose tool: observability counts calls your agent makes to its tools; Agent Tracking counts calls other agents make to your site's WebMCP tools. The confusion is common enough that this site says on its home page what it is not.
When you want both
If you publish WebMCP tools and also build agents, run an observability tool for the agents and Agent Tracking for the site. The stats API and the MCP tool make it easy to pull the site numbers into whatever dashboard your observability lives in.
In short
Can Agent Tracking trace my own agent?
No. It has no SDK, sees no prompts and no spans. Use AgentOps, LangSmith, Langfuse or OpenTelemetry for that.
Can LangSmith see who visits my website?
No. It has no presence on the page or in the server log; it only sees what your own code sends it.