AI

How to test an AI agent in Playground

Send realistic DMs to an agent and check the reply, action, confidence, grounding, and sources before publishing.

Updated May 6, 20265 min read

When to test

Test before publishing a new agent, after changing knowledge, and before switching from Review first to Auto-send when confident.

Steps

  1. 1Open Dashboard, then AI.
  2. 2Open Playground.
  3. 3Choose the agent from Chat with.
  4. 4Write a message a real fan might send.
  5. 5Run the playground.
  6. 6Read the reply in Live preview.
  7. 7Check the action, confidence, grounding score, and source context.
  8. 8Edit the agent or knowledge if the answer is weak.
  9. 9Retest with messy wording, short questions, and questions the agent should refuse.

What good looks like

  • The reply uses assigned knowledge instead of making things up.
  • The right Smart Link appears only when the message actually asks for it.
  • Confidence and grounding are high for supported answers.
  • Unsupported questions stage for review, hand off, use fallback, or skip based on your settings.

Related articles

Did this answer your question?

Placeholder for feedback controls. Helpful, not helpful, and maybe a tiny sigh button later.