When I build a QA scorecard, I do not start with the form. I start with behavior. I want to know which customer moments actually shape loyalty, repeat purchase, and churn risk. A scorecard that only measures compliance or script usage may tell me whether an agent followed process, but it rarely...
Nov 16, 2026
• by Claire Moreau
Latest News from Customer Carenumber Co
When I run pilots for new automation—especially AI that interacts directly with customers—I want one thing above all: clear, defensible evidence that the tech improves outcomes people care about. Recently I built a seven-day experiment to prove a GPT-powered assistant could reduce reopen rates without hurting CSAT. Below I’ll walk you through the exact design I used, why each step matters,...
Read more...
When you deploy AI chat assistants in regulated support — whether handling finance queries, healthcare triage, or any situation touching payment or personal data — the risks aren’t hypothetical. I’ve seen automated agents make confident but non‑compliant recommendations, omit required disclosures, or prompt customers to share sensitive information in the wrong channel. That’s why I...
Read more...
When I help teams measure the true impact of proactive channels—like in-app messages versus email nurture—the trickiest challenge is isolating deflection lift. In plain terms: how many support contacts did you avoid because you reached customers proactively, rather than because of general product improvements, seasonality, or customers who would have self-served anyway? I’ve run this...
Read more...
I run experiments like this all the time: short, focused trials that answer one clear question. In this case I wanted to know which platform—Zendesk or Intercom—delivers better conversational quality for new users during the critical onboarding period, without conflating results with onboarding content or product maturity. Below I’ll walk you through a reproducible, seven-day trial I use to...
Read more...
I’ve spent years combing through mountains of agent and bot transcripts — chat, email, social, SMS, voice-to-text — looking for the subtle patterns that quietly push conversations toward costly escalations. Those triggers are rarely dramatic: they’re buried in phrasing, timing, handoffs and small policy gaps. But when you detect them early and change a few behaviors or flows, you can...
Read more...
I recently led a small experiment to answer a simple but business-critical question: can GPT-assisted replies reduce handle time (AHT) for our support team without increasing privacy risk for customers? We had to prove the effect with the minimal amount of data—both because of privacy constraints and because collecting extra fields would slow down implementation and invite compliance overhead....
Read more...
I used to cringe every time a chat transcript ended with a handoff that read like an apology stitched into a system log: “Transferring to agent… estimated wait: unknown.” If your chatbot hands off poorly, customers feel abandoned and CSAT tanks. Over the years I’ve distilled a repeatable eight-step checklist that I run whenever handoffs are the weak link. It’s designed to deliver a...
Read more...
I recently ran a blind A/B trial to compare GPT-assisted agent replies with responses written by experienced agents, and it taught me a lot about balancing experimental rigor with the compliance and safety needs every support operation must meet. If you’re thinking of testing generative AI in live support, this is a practical playbook you can apply straight away — how I set up the trial, the...
Read more...
When I run audits for support teams, one thing I’m always asked is: “Can we tweak the chatbot prompt and actually improve CSAT without making conversations longer?” The short answer is yes — and the way to find that single high-impact prompt is through a focused, one-week audit that balances quantitative signals with lightweight qualitative testing.In this post I’ll walk you through the...
Read more...
When a leadership team asks me whether they should replace phone support with asynchronous chat, the real question is rarely about preference. It’s about money, capacity, and customer experience. The word “replace” hides a lot of trade-offs: cost per contact, resolution time, customer satisfaction, and the impact on workforce design. In this piece I’ll walk you through a pragmatic,...
Read more...