NEURATIC
CUSTOM AI • HUMAN OVERSIGHT
COURSE 3 OF 5 · NEURATIC ACADEMY
5 short modules · for owners, managers and reviewers
WELCOME
1
Explain why human review protects the business
2
Write clear review rules for any workflow
3
Approve, edit, reject or escalate with confidence
4
Write review notes that improve the AI
5
Give AI more freedom, safely, over time
6
Decide whether to build guardrails or buy them
NEURATIC
Human-in-the-Loop Basics · Welcome
HOW THIS COURSE WORKS
01
Why review matters
02
Design review rules
03
Run the reviewer’s desk
04
From review to autonomy
05
Build it or buy it
Bring one workflow you already run with AI, or plan to. You’ll design its review setup as we go.
NEURATIC
Human-in-the-Loop Basics · Welcome
01
MODULE 1
One unchecked mistake can cost more than a year of checking.
NEURATIC
Human-in-the-Loop Basics · Module 1
MODULE 1 · WHY REVIEW MATTERS
One wrong reply can undo years of trust.
A wrong payment or refund is hard to get back.
A missed notice or a wrong promise creates liability.
A public post or review reply stays online.
AI makes fewer mistakes than tired people. But it makes them faster, and at scale.
NEURATIC
Human-in-the-Loop Basics · Module 1
MODULE 1 · WHY REVIEW MATTERS
1
Situations it hasn’t seen before.
2
Things nobody told it, like a promise made on the phone.
3
A believable detail that simply isn’t true.
4
A price or policy that changed last week.
Good review rules point a person at exactly these moments.
NEURATIC
Human-in-the-Loop Basics · Module 1
02
MODULE 2
Decide in advance what stops for a person.
NEURATIC
Human-in-the-Loop Basics · Module 2
MODULE 2 · REVIEW RULES
The AI is unsure, below a level you set.
An amount over your limit.
Always-check types: legal, refunds, complaints.
Angry, upset or urgent messages.
A new customer, supplier or kind of request.
Most workflows need two or three triggers. Not all five.
NEURATIC
Human-in-the-Loop Basics · Module 2
MODULE 2 · REVIEW RULES
THE RULE TEMPLATE
If [trigger], then [who] checks it within [time]. Until then, [what happens].
EXAMPLE · REFUNDS
If a refund is over $500, the office manager checks it within 4 hours. Until then, the customer gets a “we’re on it” message.
EXAMPLE · PAYMENTS
If a supplier’s bank details change, the owner checks by phone the same day. Until then, no payment goes out.
NEURATIC
Human-in-the-Loop Basics · Module 2 · Task: write two rules
03
MODULE 3
Fast, consistent decisions, every day.
NEURATIC
Human-in-the-Loop Basics · Module 3
MODULE 3 · THE REVIEWER’S DESK
It’s right. Send it as it is.
Mostly right. Make a small fix, then send.
Wrong. Redo it, or handle it by hand.
Beyond your authority. Pass it up with a note.
Every decision gets logged. That record is your audit trail.
NEURATIC
Human-in-the-Loop Basics · Module 3
MODULE 3 · THE REVIEWER’S DESK
UNHELPFUL NOTE
“Wrong.”
Nobody can fix the instruction from this.
USEFUL NOTE
“Offered a 20% discount. Our policy for late deliveries is a free reschedule only. Changed it and sent.”
What was wrong
What’s right
What you did
NEURATIC
Human-in-the-Loop Basics · Module 3
MODULE 3 · THE REVIEWER’S DESK
| Flagged work | Checked within | Checked by |
|---|---|---|
| Customer replies | 1 hour | Front desk lead |
| Refunds over the limit | Same day | Office manager |
| Supplier payments | Before the payment run | Bookkeeper |
| Legal notices | Same day | Owner |
Example times. Set yours to match how fast each kind of work really needs to move.
Name a backup for each reviewer. Flagged work shouldn’t wait for someone’s vacation to end.
NEURATIC
Human-in-the-Loop Basics · Module 3
04
MODULE 4
Give AI more freedom, one step at a time.
NEURATIC
Human-in-the-Loop Basics · Module 4
MODULE 4 · REVIEW TO AUTONOMY
STEP 1
Every result is checked. You learn where the AI struggles.
STEP 2
Only work that matches a rule stops for a person.
STEP 3
Proven work runs alone. A person still checks a sample every week.
Climb one workflow at a time. Never skip the sample checks.
NEURATIC
Human-in-the-Loop Basics · Module 4
MODULE 4 · REVIEW TO AUTONOMY
NEURATIC
Human-in-the-Loop Basics · Module 4
05
MODULE 5
Someone has to own the checking.
NEURATIC
Human-in-the-Loop Basics · Module 5
MODULE 5 · BUILD OR BUY
OPTION A
Best when: volume is low and your team has time.
OPTION B
Best when: volume is high or your team is stretched.
NEURATIC
Human-in-the-Loop Basics · Module 5
PUTTING IT TOGETHER
WEEK 1
List every AI workflow and where it could go wrong.
WEEK 2
Write two or three rules each, with times and owners.
WEEK 3
Review everything. Write useful notes.
WEEK 4
Read the notes. Move one workflow up the ladder.
NEURATIC
Human-in-the-Loop Basics · Your plan
RECAP
1
AI’s mistakes are fast and at scale. Review is your brake.
2
Triggers: confidence, value, category, sentiment, novelty.
3
If, then who, within when, and until then.
4
Approve, edit, reject or escalate. Log it all.
5
Notes say what was wrong, what’s right, what you did.
6
Climb the trust ladder. Keep sample checks forever.
NEURATIC
Human-in-the-Loop Basics · Recap
WHAT’S NEXT
NEXT COURSE
Content, lead follow-up and reviews, with the right checks.
TEMPLATES
Rule template, decision log and note format.
DONE FOR YOU
Our trained reviewers check your AI’s work.
neuratic.ai · Custom AI with human oversight
NEURATIC
Human-in-the-Loop Basics · Course 3 of 5
Keyboard: Space to play or pause, ← → to change slides.