Verifying AI Outputs: Your Quality Check

Why verification isn’t optional

The verification toolkit

1. Citation checks

When Copilot provides references (like file names, email senders, or dates), verify them:

• Click the citation link — does the source actually say what Copilot claims?
• Check the date — is this the most recent version?
• Confirm the author/sender — did this person actually say or write this?

💡 Real-world: Ava's citation catch

Ava asked Copilot to summarise client feedback from the past month. Copilot cited an email from “Tomas, 3 April” about a design revision.

Ava clicked the citation and discovered the email was from March 3rd, not April. The feedback was outdated — the client had already approved a new design.

Without the citation check, Ava would have included old feedback in a client report. A 10-second click saved a potentially embarrassing mistake.

2. Human review

Not every Copilot output needs the same level of scrutiny. Match the review to the stakes:

Scenario	Review Level	What to Check
Internal brainstorming notes	Light scan	General accuracy, nothing offensive
Email to a colleague	Quick read	Tone, key facts, correct names
Client-facing report	Thorough review	Every fact, every number, every citation
Legal/financial document	Expert review	Subject-matter expert validates content, compliance check
Executive summary for leadership	Senior review	Strategic accuracy, appropriate framing, no sensitive data leaks

Exam tip: When a question asks “what verification is appropriate?” — look at the stakes of the output. Higher stakes = more thorough verification. The exam doesn’t expect you to verify a casual internal draft the same way you’d verify a client contract.

3. Sensitive data review

Even with permissions in place, Copilot might surface information you didn’t intend to share:

• A meeting summary might include someone’s salary mentioned in passing
• A document summary might pull in data from a linked spreadsheet with confidential figures
• A cross-app search might surface information from a private Teams chat

Before sharing any Copilot output externally, ask:

• Does this contain any information that shouldn’t leave the organisation?
• Does this include personal information about colleagues?
• Is there any data here that the recipient shouldn’t see?

Matching verification to the task

Verification Step	When to Use	What to Look For
Citation check	Any time Copilot references a source	Source exists, content matches, date is current
Quick scan	Internal, low-stakes content	Obvious errors, wrong names, tone issues
Thorough review	External-facing or important content	Every fact, number, and citation verified against sources
Expert review	Legal, financial, or compliance content	Subject-matter accuracy, regulatory compliance, appropriate language
Sensitive data check	Before sharing any output externally	Personal data, confidential information, unintended data exposure

The verification workflow

A practical four-step process for any Copilot output:

1. Read the output — does it make sense? Anything obviously wrong?
2. Check citations — click through, verify sources exist and match
3. Scan for sensitive data — names, numbers, confidential information that shouldn’t be shared
4. Match to audience — is this appropriate for who’s going to read it?

💡 Real-world: Jordan's data exposure near-miss

Jordan asked Copilot Chat to prepare a summary of the Peak Solutions Q3 pipeline for a partner meeting. Copilot generated a great overview — but included a line:

“Notable deal: Acme Corp renewal at $450K, currently flagged as at-risk due to competitor pricing pressure.”

This was pulled from an internal Teams chat between Jordan and Raj. Accurate — but absolutely not something to share with external partners. Jordan caught it in the sensitive data check and removed it before the meeting.

Copilot did its job (found relevant pipeline data). Jordan did his job (reviewed before sharing).

🎬 Video walkthrough

🎬 Video coming soon

Verifying AI Outputs — AB-730 Module 6

Verifying AI Outputs — AB-730 Module 6

~8 min

Flashcards

Question

What is a citation check in the context of AI verification?

Click or press Enter to reveal answer

Answer

Clicking through Copilot's referenced sources (emails, files, meetings) to verify that the source actually exists, the content matches what Copilot claims, and the information is current.

Click to flip back

💡 Show hint

Question

How should you match verification effort to the task?

Click or press Enter to reveal answer

Answer

Low-stakes (internal notes) = quick scan. Medium-stakes (client email) = thorough review. High-stakes (legal/financial) = expert review. The higher the consequences of an error, the more rigorous the verification.

Click to flip back

💡 Show hint

Question

Why should you check Copilot outputs for sensitive data before sharing?

Click or press Enter to reveal answer

Answer

Copilot might surface information from private chats, linked documents, or mentioned-in-passing data that the user didn't intend to include. Always review for personal information, confidential figures, and unintended data exposure before sharing externally.

Click to flip back

Knowledge Check

Knowledge Check

Dana at Oakfield Healthcare asks Copilot to draft an email to the board summarising employee satisfaction survey results. The draft includes specific complaint quotes from anonymous survey responses. What should Dana do?

ASend the email as-is — the survey data is accurate and Copilot found itBAsk Copilot to make the quotes less specific so they're harder to identifyCRemove the specific quotes and replace with aggregate statistics, then have the HR team review before sending to the boardDAdd a disclaimer that the quotes are AI-generated and may not be accurate

Check Answer

Knowledge Check

Marcus uses Copilot to generate a report on warehouse efficiency for a partner company. Copilot includes internal profit margin data from a linked spreadsheet. Marcus didn't ask for this. What type of risk is this?

AFabrication — Copilot invented the profit margin dataBPrompt injection — someone tricked Copilot into revealing financial dataCUnintended data exposure — Copilot surfaced internal data that shouldn't be shared externallyDOver-reliance — Marcus trusted the AI too much

Check Answer

Knowledge Check

Ava is writing a client proposal using Copilot in Word. The draft cites 'BrightLoop's Q3 Performance Report, page 12' for a key statistic. What verification step is MOST important?

AAsk Copilot if the citation is accurateBCheck the Q3 Performance Report, page 12, to verify the statistic actually appears thereCRemove all citations from the proposal to avoid any riskDHave Copilot regenerate the proposal to see if it produces the same statistic

Check Answer

---

Next up: You understand the fundamentals and risks. Now let’s get practical — learn how to craft prompts that actually get great results from Copilot.