New guide: assessing organisational readiness for Microsoft 365 Copilot. Read the guide

Article ยท Business Applications

Designing service triage that scales without frustrating customers

Automation in customer service works when the boundary between machine and human is explicit, measured and adjustable.

24 March 2026 7 min read Daniel Osei

Service automation fails in a specific way: it handles the easy cases well, mishandles a minority, and the mishandled minority generates the complaints that define the programme. The design question is not how much to automate but where the boundary sits and how quickly it can be moved.

Start from the volume, not from the technology

Twelve months of case history usually shows that a small number of intents account for most volume. Classify that history first. The intents worth automating are high-volume, low-variation and low-consequence-if-wrong. Everything else stays with people until the evidence changes.

Three boundary rules

  1. Confidence thresholds route uncertain cases to human triage rather than guessing. An unclassified case is a manageable cost; a confidently misclassified one is not.
  2. Escalation is always available and never hidden. Customers who cannot reach a person escalate through complaint channels instead, which is more expensive for everyone.
  3. Sensitive circumstances such as vulnerability indicators, complaints and regulatory matters bypass automation entirely by rule, not by model judgement.

Measure the things that reveal failure

Measure What it tells you
Containment rateShare of cases resolved without a human
Escalation after automated responseWhether the automation is genuinely resolving
Repeat contact within 7 daysHidden failure that containment alone hides
Human triage volumeWhether confidence thresholds are set sensibly

Agent assistance before agent replacement

Drafting support for human agents is usually the higher-return starting point. It affects every case rather than a subset, keeps a person accountable for the response, and produces the review data needed to decide which intents can later be handled end to end.

Written by

Daniel Osei

Daniel designs and delivers Dynamics 365 and Power Platform solutions, with a strong bias towards configuration, explicit process design and data quality controls that hold up long after go-live. He has spent much of his career untangling CRM implementations that recorded administration rather than supporting work.

  • Dynamics 365
  • Dataverse
  • Power Apps
  • Process design
  • CRM data quality

Relevant industries

  • Telecommunications
  • Insurance
  • Retail and Consumer

Related insights

Discuss it

Recognise this problem in your organisation?

These pieces come from engagements. If one describes your situation, the follow-up conversation is usually short and specific.

Talk to an expert Solutions