Proactive Monitoring and Health Dashboard for MW Chatbot Skills

We recently encountered an issue where MW chatbot failed to return relevant articles for a specific query. After reaching out to the support team, I learned that the bot didn’t trigger the knowledge skill plugin, which is responsible for searching related articles. Support team made the necessary adjustments, and the fix worked.

However, this raised a concern: how can we proactively track and measure the health of the knowledge skill? We can’t always wait for users to report issues, as this impacts engagement and overall user experience.

Wouldn’t it be beneficial if MW offered a health dashboard for all configured skills, allowing admins to monitor performance and make informed decisions? Additionally, having the option to subscribe to status notifications for specific skills would help us catch and address issues in real-time, ensuring smoother operations and exception handling.