Agency Checkby Cyber Strategy Institute

Agency Check

Use cases

A check before an agent books, connects, sends, or starts a trial.

Clarify one thing

"Booked" isn't booked until the provider says so

You ask your agent to book a dental cleaning for Tuesday at 3pm. It replies 'Appointment booked successfully.' Your calendar has no event and there's no confirmation email.

The call

{
  "action": {
    "kind": "claim_review",
    "task": "Book a dentist cleaning for Tuesday 3pm"
  },
  "completion_evidence": {
    "status": "none",
    "summary": "No confirmation email or calendar entry exists"
  },
  "claims": [
    {
      "text": "Appointment booked successfully for Tuesday 3pm",
      "status": "unverifiable"
    }
  ],
  "context": "user ask + agent reply + calendar/inbox search (dummy)"
}

What came back

Your agent said this is done, but what you shared only shows that a request was received.

Next step. Get the provider's confirmation before you change plans.

Why it matters

An agent's 'done' is a claim, not a record. Agency Check lists what isn't supported yet (the provider's confirmation) so you don't skip a real appointment.

One line you can post

My agent said the appointment was booked. Agency Check asked one question: where's the confirmation? There wasn't one.

Inspired by a public post

Clarify one thing

A GitHub connector that asks for delete and push when you only wanted to read issues

You add a community GitHub MCP server so your assistant can read issues. Its tool list also registers delete_repository and push_to_main, both able to run without asking you.

The call

{
  "action": {
    "kind": "install_connector",
    "provider": "community-github-mcp",
    "access": [
      {
        "label": "read issues",
        "needed": true
      },
      {
        "label": "delete_repository",
        "needed": false,
        "acts_without_asking": true
      },
      {
        "label": "push_to_main",
        "needed": false,
        "acts_without_asking": true
      }
    ]
  },
  "user_goal": "Let my assistant read GitHub issues."
}

What came back

Connecting would let it do more than this task needs.

  • It could delete repository without asking you first
  • It could push to main without asking you first

Question. What should it be able to do? Only what this task needs | Everything it asks for

Why it matters

Reading issues doesn't need delete or push. The card names the extra access before you connect, while it's still easy to say no.

One line you can post

I wanted my agent to read GitHub issues. The connector also wanted delete_repository. Agency Check caught it before I clicked connect.

Inspired by a public post

Clarify one thing

One recipient asked for, 214 about to get it

You ask your agent to send the Q3 salary spreadsheet to Dana in HR. It's about to send it to the All Staff list, 214 people.

The call

{
  "action": {
    "kind": "send_message",
    "content_type": "document",
    "data_label": "Q3 salary spreadsheet",
    "recipients": {
      "count": 214,
      "group_name": "All Staff"
    }
  },
  "user_goal": {
    "text": "Send the Q3 salary spreadsheet to Dana in HR.",
    "intended_recipients": [
      "Dana (HR)"
    ]
  },
  "action_record": {
    "audience_count": 214,
    "undo_available": false
  }
}

What came back

This is about to go to All Staff (214 people), which is more people than you named.

  • This goes to 214 people in All Staff, not just Dana (HR)
  • Once it's read, it can't be unread

Question. Who should see this in All Staff? All 214 | Just Dana (HR) | Not now

Why it matters

A send can't be recalled. Comparing who you named with who it's going to takes one call and stops the worst kind of reply-all.

One line you can post

I said 'send it to Dana.' My agent picked All Staff. Agency Check asked: all 214, or just Dana?

Inspired by a public post

Ready to review

A free trial that's one click to start and a phone call to cancel

You ask your agent to try an AI writing tool for one blog post. It starts a 7-day free trial with your saved card. The trial auto-renews at $49/month and cancels only by phone.

The call

{
  "action": {
    "kind": "sign_up",
    "merchant": "Example AI Writer",
    "offer": "7-day free trial",
    "terms": {
      "trial_days": 7,
      "auto_renews": true,
      "price_after_usd": 49,
      "billing_period": "month",
      "cancel_method": "phone"
    }
  },
  "user_goal": "Try an AI writing tool for one blog post."
}

What came back

  • Signing up took a click. Canceling takes a phone call.

Next step. Set a reminder a few days before it renews, so keeping it is a choice.

Remind me before it renews · Turn off auto-renew · Go ahead as is

Why it matters

For a one-off task, a trial that renews by default and cancels by phone is how a $0 test becomes a monthly bill.

One line you can post

My agent started a 'free' trial for one blog post. Agency Check pointed out the cancel button is a phone call, and offered a reminder.

Inspired by a public post

Start free

Run the next check yourself.

Connect Agency Check, then say "Check this first" before your agent books, sends, or signs up.

Start free, no cardSee pricing

20 checks a month free. Pro from $9 a month.