Analytics Overview Confusion

Since switching to the new AI Assistant version of the bot, we’ve learned a lot about using and interpreting the analytics that come with it, and overall, the improvements over time have been great. That said, there are a few areas where enhancements could make a big difference in usability of the data without adding extra steps or the need to dig in to feel confident with the data.

Some details, like formatting and consistency, are minor. The bigger challenge for us is the Overview page in AI Assistant Insights.

For example, the report at the bottom of the page shows plugin calls categorized as unsuccessful, served, and used. While this is interesting, it’s hard to apply in a meaningful way. It often requires cross-referencing individual plugin insights pages to track activity and effectiveness, which adds complexity.

It would be incredibly helpful to have options to filter this data, like viewing only served and/or used plugin calls and to click on categories to see relevant chat data directly. This would reduce the need to navigate to “View interactions” or dig through raw data with multiple filters just to understand interaction patterns.

I’d love to hear how others might be using this data as it is right now, though. If anyone has suggestions, I’d be open to hearing them!