Skip to content
All tool news

Tool desk · Updated daily

Tool news·Intercom·

Intercom Introduces Automation Rate as New North Star Metric for AI Agents.

Intercom unveils Automation Rate metric to measure AI agent effectiveness alongside existing CX Score quality measurement.

CW

Create With tool desk

1 source checked · 2 min read · 2 sections

ShareLinkedIn
Intercom Introduces Automation Rate as New North Star Metric for AI Agents

Intercom has introduced Automation Rate as a new metric for measuring the effectiveness of AI customer service agents, positioning it alongside the company's existing CX Score quality measurement.

The customer support platform announced the new metric through a LinkedIn post featuring Brian, though limited technical details were shared publicly. Intercom frames Automation Rate as the critical performance indicator that CEOs should track when evaluating their AI agent deployments, calling it a "North Star metric" for understanding how well AI automates customer service workflows.

Measuring Effectiveness vs Quality

The distinction between effectiveness and quality represents a shift in how companies evaluate AI agent performance. While CX Score measures the quality of customer interactions handled by AI, Automation Rate appears focused on quantifying how much work AI agents actually complete without human intervention.

This dual-metric approach addresses a common challenge in AI customer service: an agent might deliver high-quality responses (strong CX Score) but handle relatively few inquiries end-to-end (low Automation Rate), or conversely, resolve many simple requests (high Automation Rate) while struggling with complex issues that impact customer satisfaction.

Intercom has been steadily expanding its AI capabilities following its major Intercom 2 platform overhaul, which introduced over 60 updates focused on AI-first customer support. The company has also recently expanded beyond support with Fin for Sales, bringing AI agent capabilities to sales workflows.

Why Automation Rate Matters

By positioning Automation Rate as a CEO-level metric, Intercom signals that AI agent effectiveness has become a business priority rather than a technical detail. The metric likely helps leadership teams understand the return on their AI investments by showing what percentage of customer service volume AI handles independently.

For support teams using platforms like Crisp or similar customer messaging tools, this focus on automation measurement could influence how they evaluate and deploy AI capabilities. The trend toward quantifying AI effectiveness through specific metrics like Automation Rate may become standard across the customer support software category.

Intercom has not yet published detailed documentation on how Automation Rate is calculated or what benchmarks companies should target. The company operates its AI agent platform, Fin, which competes with other AI-powered support solutions in helping businesses reduce support ticket volume through automated responses.

The announcement comes as customer support platforms increasingly compete on AI capabilities, with vendors racing to demonstrate measurable business impact from their AI features beyond basic chatbot functionality.

Sources

1 checked

How we cover tool news: Create With's tool desk drafts these reports with AI from the sources listed above and checks them against those sources before publishing.

Worth passing on?

ShareLinkedIn

Latest tool news

What else changed this week.

All tool news
VercelDigest

What Vercel Shipped in Late October

Vercel shipped quicker static deployments, four AI Gateway models, more free domain choices and new CLI controls in late October. The changes cover developers testing sites…

Vercel

Vercel Adds Submit_feedback to Its MCP

submitfeedback is a new Vercel MCP tool that lets agents and harnesses send bug reports, friction reports and feature requests directly to the Vercel team. Feedback can include…

The Create With Briefing

Don't watch forty changelogs. Read one email.

Every Tuesday: the tool changes worth knowing, real business use cases, and what's on near you. Free, unsubscribe any time.