# Human-in-the-loop AI support: approvals that are fast for customers and light for your team

> Human-in-the-loop AI support works when the AI prepares everything, one person makes one decision, and the customer always knows where things stand. Here's how.

Source: https://pengo.chat/blog/human-in-the-loop-ai-support/
Topic: AI support
Updated: 2026-10-21

## The short version

- Human-in-the-loop done well means **the AI prepares everything, a person makes one decision, and the customer is kept informed** the whole time.
- A good approval request carries the customer, the exact action, what it touches and **the amount taken from the order, not the chat**, so nobody has to open another tab to decide.
- Route by risk: **any teammate for everyday changes, managers for high-risk ones**, and a second person when a teammate goes above their own limit.
- Send requests to wherever people already are (phone, watch, email, Slack, inbox), let **the first decision win**, and make sure an unanswered request **reminds, escalates and expires without ever approving itself**.
- Use the activity log to **graduate the boring actions to Auto with guardrails**, and keep the judgement calls with a person.

Once an AI assistant can act in your tools (cancel an order, refund a payment, skip a subscription), the obvious question is who gets to say yes. Most teams' first instinct is one of two extremes. Either the AI does everything on its own and you hope for the best, or every request goes to a person and the AI becomes a very polite receptionist.

Neither works for long. The good version sits in between, and it's more specific than "a human checks it". The AI prepares everything. A person makes one decision. The customer is told what's happening the whole way through.

This guide covers how to build that: what an approval request should contain, who should approve what, where approvals should reach people, what the customer sees while they wait, and how to decide, with evidence, what can stop needing approval at all.

## What human-in-the-loop AI support means

> **Human-in-the-loop AI support**
>
Human-in-the-loop AI support is a set-up where an AI assistant handles a customer's request up to the point of a decision, then a person makes that decision before anything changes. The AI gathers the facts, prepares the action and tells the customer it's with the team; a teammate approves, edits, rejects or takes over; the AI carries out the result and follows up.

The key word is *decision*. A person in the loop shouldn't be redoing the work. They shouldn't be opening the store admin to find the order, checking whether it shipped, or working out the refund. If they are, the AI hasn't really done its part.

Done well, a teammate's whole involvement is a glance and a tap. Done badly, it's the same ten-minute task as before, with an extra notification on top.

## Why both extremes fail

### Full autonomy

Letting the AI run every action on its own sounds efficient until you picture the bad day. A customer insists an order never arrived and asks for a refund. Another wants to cancel a subscription that, with a short conversation, they'd have paused. A third claims to be someone they're not. An AI acting alone treats all three the same way as the easy cases.

The issue isn't that the AI is careless. It's that some decisions involve money that doesn't come back, judgement about a relationship, or certainty about identity, and those deserve a person. Full autonomy also makes it hard to build trust gradually: you only find out what you're comfortable with after something has already happened.

### Everything to a person

The opposite extreme feels safe, and it quietly brings back the problem you were trying to fix. If every action needs a teammate, the AI's main contribution is typing "I've passed this to the team". Customers wait as long as they did before. Your team approves dozens of lookups and tag changes that never needed a human. Before long people start approving without reading, which is worse than having no approvals at all.

### The middle that works

The fix is to sort actions by what's at stake. Lookups and changes inside your help desk run on their own, because there's nothing worth approving. Changes in your tools wait for a person, at least to start with. A few actions that need judgement are handed to a teammate outright. Then, over time, you use evidence to move the everyday cases to running on their own with limits.

If you're still choosing which actions to switch on at all, our guide to [AI that takes actions in customer support](/blog/ai-actions-customer-support/) covers the four kinds of work and how to roll them out in phases.

## What a good approval request contains

An approval request is a decision someone makes in a few seconds, often on a phone, often between other tasks. It has to carry everything needed to decide, and nothing that makes them go and look something up.

_Figure: One approval request, broken into what a person needs to decide in one look: the exact action, who it's for and how sure we are, what it touches, the amount from the order, what the customer was told, and the choices available._

Six things make a request decidable at a glance.

1. **The action, by its real name.** "Cancel an order", not "handle the customer's request". The approver should know exactly what Approve will do.
2. **The customer, and how sure you are it's them.** A cancellation for a signed-in, verified customer is a different decision from one for an anonymous visitor who typed an email address. The best systems don't even raise the second kind: if the identity rule isn't met, the action doesn't run.
3. **What it touches.** The order number, the item, and the state that makes the change possible ("not shipped"). If the order has already shipped, the request shouldn't exist.
4. **The amount, from the order.** The refund should be read from the order or invoice itself, never from what the customer said in the chat. "It was only £5" is not a source of truth.
5. **What the customer has been told.** So the approver doesn't contradict it, and knows the customer is waiting.
6. **The choices.** Approve, edit and approve, reject, or take over. One decision, with room to adjust it.

Notice what's missing: the whole conversation. The approver can open it if they want to, but they shouldn't need to. If your requests regularly send people back to the transcript, the request is missing a detail.

## Who approves

Not every approval needs the same person. Route requests by risk, the same way you'd route spending.

- **Everyday changes, any teammate.** Changing a shipping address before dispatch, skipping one subscription payment, adding a note to an order. Anyone working the inbox should be able to say yes.
- **High-risk changes, managers and the owner.** Refunds, cancellations, account credit and plan changes involve money and can't easily be undone. Keep the yes with people who own those calls.
- **Above a teammate's limit, a second person.** When a teammate runs a change themselves that goes past their own limit, another person approves it. This is the familiar four-eyes rule from finance, applied to support.

Two rules hold this together. First, the people who set the rules (which actions run on their own, which wait, who approves) should be a small group, typically the owner and managers. Second, identity rules should apply whatever the mode. Even an approved request shouldn't run for a customer who doesn't meet the action's identity check.

In Pengo, by default any teammate can approve low- and medium-risk actions, and managers and the owner approve high-risk ones. A teammate running a change above their own limit needs a second person to approve it. The owner or a manager sets each action's mode in **Intelligence › Actions**, per website. See [guardrails and limits](/help/actions/guardrails-and-limits/).

## Where people approve

An approval only helps the customer if someone sees it. A request sitting in a dashboard tab nobody has open is just slow support with extra steps.

So send requests to the places your team already looks, and let whoever is free decide.

| Where | Good for | What to expect |
|---|---|---|
| **Phone notification** | Owners and leads away from their desk | Approve, decline or take over from the notification. On iPhone, Approve needs Face ID or your passcode. |
| **Apple Watch** | A quick yes between other things | Approve or decline from your wrist. |
| **Email** | People who live in their inbox | Open the request and confirm on a secure page. High-risk changes ask you to sign in. |
| **Slack** | Teams that coordinate in a channel | Approve, decline or take over from the message. |
| **Support inbox** | Whoever is working the conversation | Approve, edit the details and approve, decline, or take over. |

Sending one request to several places raises an obvious question: what if two people tap Approve? The answer should be simple. **The first decision wins**, and everyone else sees who decided and where. The action never runs twice, and nobody has to ask in the team chat whether it's been handled.

Each person should choose where they get requests. A lead might want phone and Watch; a part-time teammate might want email only.

Pengo sends approval requests to iPhone and Android notifications, Apple Watch, email, Slack and the inbox. The first decision wins, and everyone else sees who decided and where, for example "Already approved by Owen via Slack". Each teammate picks where they get requests in **Settings › Your profile › Notifications**. See [approve from anywhere](/help/actions/approve-from-anywhere/) and [push notifications](/help/mobile/push-notifications/).

## Approve, edit, decline or take over

A yes-or-no button is not enough. Real requests need four kinds of decision.

**Approve** when the request is right as prepared. This should be the common case, and the one you measure: a high rate of unchanged approvals is your evidence that an action is ready to run on its own.

**Edit and approve** when the request is nearly right. A partial refund instead of a full one, a different address line, the shipping refunded rather than the whole order. Editing keeps the AI's preparation and the customer's momentum, with your correction on top.

**Decline, with a message** when the answer is no. A decline shouldn't leave the customer hanging. Add a short message and it goes to them in the conversation: "We can only refund unworn boots, but Hannah will be in touch about a repair or replacement" lands far better than silence.

**Take over** when the request opens a conversation a person should have. A cancellation that sounds like frustration, a refund request with a complaint attached. Taking over claims the chat, tells the customer a teammate is joining, and keeps the action ready so you can still run it when you're done talking.

## What the customer sees, while waiting and after

This is where human-in-the-loop either feels fast or feels like a queue. The customer doesn't see your approval flow. They see the chat. Three rules make waiting feel like progress.

**Say it's with the team, not that it's done.** The AI should never announce an outcome before it happens. "I've asked the team to skip your next payment, and I'll confirm here as soon as it's done" is honest and specific. "Done!" followed by a rejection is the fastest way to lose a customer's trust.

**Follow up with exactly what happened.** Approved and done: a confirmation of the change. Rejected: a teammate reviewed it and will follow up. Couldn't be completed (the tool refused, an integration was disconnected): a teammate will follow up. The follow-up should be a fixed message or built from the action's own result, never improvised by the AI, so it can't say more than what actually happened.

**Reply where they are.** The follow-up should go out on the customer's channel, in their language, whether that's the website chat, email or a messaging app.

Here's one request from both sides. Ruth runs a small design agency and uses Tallybook for invoicing. She wants to skip August.

_Figure: One approval from both sides. Ruth hears the request is with the team, then gets a confirmation five minutes later. In the inbox, the same request shows as approved by Inês via Slack, and when Owen taps Approve on his phone a minute later, he sees it's already handled. The action runs once._

Ruth never sees Inês, Slack or the approval banner. She sees a clear promise, then a confirmation that matches it. That's the whole job of the customer-facing side.

While a request waits, Pengo tells the customer it has asked the team, for example "I've asked the team to cancel it with a full refund, and I'll confirm here as soon as it's done." Follow-ups are fixed messages or come from the action's own result, never from the AI guessing, and they're written in the customer's language on their channel: the widget, email or SMS. See [what customers see](/help/actions/what-customers-see/).

## Reminders and expiry: nothing waits forever

Every approval flow needs an answer to "what if nobody decides?" The wrong answers are "it waits indefinitely" (the customer is stuck) and "it approves itself after a while" (the approval was never real). The right answer is a ladder.

_Figure: What happens to an unanswered request. Approvers are reminded after 15 minutes, managers and the owner after an hour, and after 4 hours the request expires and the conversation is handed to your team. A decision at any point ends it. Expiry never approves anything._

The ladder matters for two reasons. It keeps the customer's wait bounded, so a request raised at 09:42 is in a person's hands by early afternoon at the latest, even on a chaotic day. And it makes the safety guarantee simple to explain to anyone: **time running out never approves anything**. The worst case is that a person handles it, which is where you started.

If you find requests regularly climbing the ladder, that's a signal, not a nuisance. Either approvals aren't reaching the right people, or the action is one your team doesn't feel able to approve, and needs a clearer rule.

## Team only: when a person should own it

Some actions shouldn't go through approval at all, because the decision isn't "is this request correct?" but "what should we do for this customer?"

A subscription cancellation is the classic example. You could approve it in a tap. But a short conversation might reveal that a pause would suit them better, or that one of your approved coupons would keep them. Goodwill credit after a bad experience is another: how much is a judgement about the relationship, not a check of the facts.

For these, the better pattern is to hand over with the work done. The AI tells the customer a teammate is joining, passes the conversation over, and leaves the action pre-filled and ready to run. The teammate has the conversation, then runs the action in one click, and the AI drafts the reply describing what was done.

Pengo's **Team only** mode does exactly this. If Pengo is chatting when a customer needs the action, it says a teammate is joining, hands over, and leaves the action pre-filled in the inbox **Actions** button for a one-click run with a drafted reply. If the customer isn't verified, Pengo warns the teammate before a change and asks them to confirm they've checked who it is, and that confirmation is recorded. See [run actions from the inbox](/help/actions/run-actions-from-the-inbox/).

## Use the activity log to decide what graduates

Human-in-the-loop isn't a permanent state for every action. It's how you earn the evidence to automate the right ones.

Review the activity log weekly and sort each action's requests into four piles:

- **Approved unchanged.** A long run of these, with no rejections, is the case for moving the action to running on its own.
- **Edited before approval.** The AI is missing context. Fix the content, the rule or the integration before you automate anything.
- **Rejected.** Read the reasons. Often it's a policy the AI doesn't know yet, or a request that should never have been raised.
- **Approved but failed.** Rarely the AI's fault. Usually a disconnected integration, a missing permission, or the tool refusing the change, such as cancelling an order that has already shipped. Fix it once.

When an action graduates, don't flip it straight to running unlimited. Add guardrails: run on its own up to an amount, ask above it, and cap how much it can do in a day. The amount should come from the order or invoice, never from the chat. Then keep reviewing. The everyday £8.00 refund for a missing pair of socks runs on its own; the £79 one for a whole Fellside Daypack still waits for a manager.

## What good tooling looks like

Everything above depends on the tool giving you the controls. When you compare options, check for these:

| Capability | Why it matters |
|---|---|
| **A mode per action** | Lookups run free, changes wait, judgement calls go to a person. One switch for "AI on" is not enough. |
| **Requests that carry the facts** | Customer, action, record, amount from the order. Nobody should need another tab to decide. |
| **Risk-based approvers** | Any teammate for everyday changes, managers for high-risk ones, a second person above a limit. |
| **Approvals everywhere** | Phone, watch, email, Slack and inbox, with the first decision winning. |
| **Edit, decline with a message, take over** | Real decisions aren't just yes or no. |
| **Honest customer messages** | "Asked the team" while waiting, follow-ups built from what actually happened. |
| **Reminders and expiry that never approves** | Nothing waits forever, and nothing approves itself. |
| **A full record** | Every run, approval and rejection, with who decided. |

[Pengo Actions](/actions/) are built around this list. Pengo prepares changes in [Shopify](/integrations/shopify/), [WooCommerce](/integrations/woocommerce/), [BigCommerce](/integrations/bigcommerce/), [Stripe](/integrations/stripe/) and [HubSpot](/integrations/hubspot/), shows each request in the inbox as **Needs approval** with the details and **Approve**, **Decline** or **Take over**, lists waiting requests in the **Approvals** tab of **Intelligence › Actions**, and sends them to phone, Apple Watch, email and Slack. Every action Pengo runs or requests is in the **Activity** tab, and every run, approval and rejection is logged with who decided. Identity is checked every time, whatever the mode, and customers always know where their request stands. It all runs on [Pengo Intelligence](/ai/), the assistant that answers from your content and hands off cleanly when it should.

## Mistakes we see most often

- **Approving lookups.** If an action can't change anything, approval is noise. It trains people to tap Approve without reading, which is exactly the habit you don't want on refunds.
- **Requests that need a second tab.** If an approver has to open the store admin to check the amount or the shipping status, the request is missing facts.
- **One approver for everything.** A single person who has to clear every request becomes the bottleneck the AI was meant to remove. Spread everyday approvals across the team.
- **Telling the customer it's done before it is.** The waiting message is a promise. Keep it honest and specific.
- **Letting requests approve themselves.** A timeout that approves is not a safety net. Remind, escalate, then hand to a person.
- **Never graduating anything.** If nothing ever moves to Auto, your team has swapped doing tasks for approving them. Use the evidence.

## Your approval set-up checklist

**Human-in-the-loop set-up checklist**

- [ ] Sort your actions by what’s at stake
- [ ] Check every request carries the facts
- [ ] Decide who approves what
- [ ] Ask every approver to choose where they get requests
- [ ] Agree when to edit, decline with a message or take over
- [ ] Read the customer messages for every outcome
- [ ] Confirm reminders, escalation and expiry
- [ ] Move judgement calls to Team only
- [ ] Review the activity log weekly
- [ ] Graduate everyday actions to Auto with guardrails

The best human-in-the-loop set-up is one your customers never notice and your team barely feels. The AI does the legwork, a person makes the call in seconds from wherever they are, and the customer gets a clear promise followed by a confirmation that matches it. Start strict, read what your team approves, and let the evidence decide what needs a human next month.

## Questions people ask

### What is human-in-the-loop AI in customer service?

It's an AI support set-up where the AI does the preparation and a person makes the decision on anything that matters. The AI finds the order, works out the refund and drafts the change; a teammate approves, edits or rejects it, and the customer is told what's happening at each step. Low-risk work runs on its own, so people only see the decisions worth their time.

### Doesn't requiring approval slow support down?

Only if approvals are hard to reach or hard to read. When the request arrives on a teammate's phone, watch, Slack or inbox with everything needed to decide, a yes takes seconds. The customer is also told the request is with the team, so a short wait feels like progress rather than silence. What slows support down is a person doing the whole task by hand.

### Who should approve actions an AI wants to take?

Match the approver to the risk. Everyday changes such as an address fix or a skipped payment can be approved by any teammate. High-risk ones, like refunds and cancellations, are better with managers or the owner. When a teammate runs a change above their own limit, a second person should approve it.

### What happens if nobody approves the request?

A good system reminds approvers, then escalates to managers, and finally hands the conversation to your team so a person picks it up. It should never approve anything because time ran out. In Pengo, approvers are reminded after 15 minutes, managers and the owner after an hour, and the request expires after 4 hours.

### Can I approve AI requests from my phone or Slack?

With the right tool, yes. Pengo sends approval requests to iPhone and Android notifications, Apple Watch, email, Slack and the inbox, so whoever is free can decide. On iPhone, Approve needs Face ID or your passcode, and on email high-risk changes ask you to sign in.

### When should an AI action skip approval altogether?

When there's nothing meaningful to approve. Lookups never change anything, and changes inside your help desk, like tags and internal notes, are invisible to customers and easy to undo. Everyday changes you've approved unchanged many times can move to running on their own, ideally with an amount limit and a daily cap.
