Skip to main content
4. Future Consideration

Automated Testing Framework for Moveworks Creator Studio Use Cases

Related products:Agent Studio
  • April 10, 2025
  • 3 replies
  • 35 views

afleury
Forum|alt.badge.img+4

Idea: Develop an automated testing framework for chatbots that periodically and automatically runs test cases to verify access, functionality, and performance. These tests should be executed by both admin and user roles and triggered following any Moveworks updates or changes.

Key Features:

  • Periodic and Automated Testing: Schedule tests to run at regular intervals and automatically after updates.
  • Role-Based Execution: Ensure tests cover both admin and user roles to validate different access levels and functionalities.
  • Comprehensive Coverage: Include tests for access, functionality, and performance to ensure all aspects of the platform are verified.
  • Alert System: Implement an alert mechanism to notify the team immediately if any test case fails, ensuring quick response to potential issues.
  • Custom Flow Validation: Ensure that all custom flows are tested to confirm they are not impacted by code changes.

Benefits:

  • Increased Confidence: Provide peace of mind that the platform is functioning correctly after updates.
  • Early Issue Detection: Quickly identify and address issues before they impact users.
  • Efficiency: Automate repetitive testing tasks, freeing up resources for other critical activities.


Similar to Automated Test Framework - Now Platform - ServiceNow

3 replies

Ajay Merchia
Forum|alt.badge.img+3
  • Community Manager
  • April 18, 2025

@afleury This is a great idea, and we'll definitely consider it for our future roadmap. 

We do this internally across our evaluation dataset to ensure that the Agentic Reasoning Engine is performing well with Agent Studio plugins as a whole. But I definitely understand the need to make sure that your APIs haven't broken or haven't misconfigured a policy validator or something.

Can you actually share a little bit more detail on the types of errors that you're expecting to catch?  

One thing that we will probably have to get right is this idea of action mocking because we don't want these automated tests to trigger real actions in your systems. 

 


Ajay Merchia
Forum|alt.badge.img+3
  • Community Manager
  • April 18, 2025
1. New4. Future Consideration

afleury
Forum|alt.badge.img+4
  • Author
  • Inspiring
  • June 23, 2026

Hi Team, any updates on this one?