Confidence Scores of Generated Responses

Question

Does Moveworks track confidence level/scores of the bot’s responses to a user? (even if this is tracked only on the back end)

What are some ways to determine the accuracy of responses besides asking users to report feedback?

andrew.mairena · Answer

No, confident scores associated to the response - The Moveworks Assistant has a Reasoning Engine that has a complex setup that use a mix of retrieval and classification models to filter / select plugins and take action / retrieve resources, which is then sent to the Reasoning Engine to summarize the response to the user. The summarization response doesn’t have any confidence levels associated to it.

Some customers have asked their employees to leverage Thumbs up / down to collect feedback and routinely review within the Moveworks Insights Analytics dashboard.

Sign up

If you're a Moveworks customer, you can click the SSO button below to login-even if it's your first time. Everyone else can use email or click create an account above to register.

Login or create an account

If you're a Moveworks customer, you can click the SSO button below to login-even if it's your first time. Everyone else can use email or click create an account above to register.