New guide: assessing organisational readiness for Microsoft 365 Copilot. Read the guide

Enterprise Services Organisation ยท Professional Services

An internal knowledge assistant for a professional services organisation

A grounded internal assistant, including the content preparation that makes the answers trustworthy.

17 March 2026 Professional Services

Technologies

  • Copilot Studio
  • Microsoft 365 Copilot
  • SharePoint Online
  • Microsoft Teams
  • Microsoft Entra ID

Outcome themes

  • Faster answers
  • Reduced repeat enquiries
  • Content quality

Client context

A professional services organisation holds policies, methodologies and delivery standards across an intranet, a document management library and several team sites. Employees ask internal teams the same questions repeatedly because finding the current version is unreliable.

The challenge

The content estate contains duplicates and superseded material with no clear ownership. Grounding an assistant on it directly would produce confident answers from obsolete documents. Some content is restricted, so the assistant must respect existing permissions exactly.

Objectives

  • Answer common internal questions from approved, current content
  • Respect existing Microsoft 365 permissions without a parallel permission model
  • Cite the source document for every answer
  • Identify content gaps from real questions
  • Establish ownership so the content estate does not decay again

The solution

Content preparation runs first: an audit of the scenarios in scope, retirement of superseded material, ownership assignment and review scheduling. A Copilot Studio agent is then grounded on the curated set, inheriting Microsoft 365 permissions so each user only receives answers from content they can already open. Every answer cites its source. Questions the agent cannot answer confidently route to the owning team and are logged, so the content backlog is driven by real demand. The agent is surfaced in Microsoft Teams rather than as a separate destination.

Architecture

  • Curated SharePoint Online grounding set with assigned owners and review dates
  • Copilot Studio agent with permission-trimmed retrieval over the curated set
  • Microsoft Teams as the delivery surface for the agent
  • Microsoft Entra ID group-based access aligned to existing content permissions
  • Evaluation set of representative questions with agreed correct answers, run before each change
  • Usage and gap logging to Dataverse, feeding a content improvement backlog

Delivery approach

How the work ran

  1. Prepare content

    Scenario-scoped audit, duplicate retirement, ownership assignment and review scheduling.

    Content inventory Ownership register Retirement log
  2. Design

    Grounding scope, answer format, citation requirements, escalation routes and evaluation approach.

    Agent design Evaluation set Escalation matrix
  3. Build and evaluate

    Iterative agent build with evaluation runs against known-answer questions after each change.

    Agent Evaluation results Tuning log
  4. Pilot

    Controlled cohort with structured feedback capture and weekly gap review.

    Pilot report Gap backlog Rollout recommendation
  5. Operate

    Content owners maintain grounding sources; gaps feed a standing backlog.

    Operating model Review cadence Usage reporting

Outcomes

What changed

Answers cite their source

Users can verify an answer against the document it came from.

Permissions respected exactly

No parallel permission model was introduced; existing entitlements govern retrieval.

Gaps identified from real demand

Unanswered questions drive the content backlog rather than assumptions.

Content ownership established

Each grounding source has a named owner and a review date.

Lessons learned

What we would tell the next organisation

Every engagement produces something worth carrying forward. These are the points that mattered most in this one.

  • Content preparation consumes more of the timeline than agent construction, and should be planned accordingly.
  • An evaluation set with known correct answers converts quality discussions from anecdote to evidence.
  • Surfacing the assistant inside Teams materially outperforms a separate destination.

More customer stories

Next step

Start with the problem, not the platform

The first conversation is about what is not working today. Product selection comes later, and sometimes the answer is that you do not need a new one.

Talk to an expert Solutions