Agent Simulator

The Agent Simulator allows you to test how changes to an agent’s prompt affect its responses. It enables you to replay past conversations and evaluate how the agent would behave after modifying the prompt, without affecting live deployments.

To begin testing an agent:

  1. Open the agent you want to test.

  2. Click the Simulation button in the top-right corner of the screen. This opens the Simulation dialog box where you can replay and test past conversations.

  3. To load a previous interaction, go to History, select Conversation, and enter the Conversation ID.

  4. Toggle the switch to enable text box mode, which displays the full conversation messages in the simulator.

  5. Review the conversation to identify the point where the agent behaved incorrectly. For example, when the assistant asks for the city the user will be traveling from, the user may reply with “Bangalore.” Due to a transcription error, this may be interpreted as Hindi text, causing the agent to switch from English to Hindi without the user requesting it.

  6. To correct this behavior, open Prompt Settings, scroll to the Language section, and add a rule that prevents the agent from switching languages unless the user explicitly asks for it. Save the updated prompt as a draft.

  7. Return to the Simulation window and reload the same conversation.

  8. Select the number of iterations and click Run to generate multiple responses with the updated prompt.

  9. Review the generated responses. If the agent now responds in the intended language across all iterations, the prompt change has successfully fixed the issue.