What is it
- Bring all your Creator Studio use cases (from the Classic architecture) to the new Copilot architecture as plugins.
Key Dates
- Limited Preview: March 2024
- Preview: August 2024
Current State
- Queries & Events in Copilot are already in Preview!
- Paths in Copilot is in Limited Preview. Please use the experimental feature tab to enroll in the feature!
- We have finished implementing core capabilities and we are working on some ML enhancements before launching the capability to Preview.
Key improvements
Copilot’s generative framework brings intelligent reasoning to your Creator Studio use cases. This means many out-of-the-box benefits (such as implicit slot filling, easy context switching & more). Check out our documentation for examples & details.
Core Capabilities
We have finished implementing the core capabilities.
| Capability Name | Status | Release Date |
|---|---|---|
| Paths - APIs, KBs & Free-text Solutions | ✅ Supported | Feb 2024 |
| Paths - Free-input & multiple choice slots | ✅ Supported | Feb 2024 |
| Paths - Date slots | ✅ Supported | April 2024 |
| Paths - Markup support (free-text responses) | ✅ Supported | May 2024 |
| Paths - Form actions | ✅ Supported | May 2024 |
| Queries - API responses | ✅ Supported | Jan 2024 |
| Queries - URL follow up actions | ✅ Supported | April 2024 |
| Events - Event notifications | ✅ Supported | Jan 2024 |
| Events - Event-triggered Paths | ✅ Supported | April 2024 |
| Launch rules | ✅ Supported | Jan 2024 |
| API logs | ✅ Supported | May 2024 |
Plugin Reliability
All plugins (especially multi-turn ones) have challenges when working with LLMs. LLMs may not correctly interpret how a plugin is supposed to be used.
We want to ensure CREST plugins behave at least as well on NGCP (if not better). We’re evaluating & improving LLM behavior across a variety of LLM parameters to ensure this:
- Plugin selection: Does the plugin trigger when expected?
- Plugin re-selection: If a user replies to a plugin, does the Copilot stay focused?
- Slot filling: Are inputs extracted correctly?
- Question generation: When inputs are needed, is the Copilot clear (with help text as needed)?
- Inference confirmations: When inputs are assumed, is the user made aware?
- Action confirmations: Is the confirmation message clear before actions are executed?
- Response generation: Is the summary after actions are executed clear?
Once we can guarantee a sufficient quality for LLM behavior with plugins, we will release the capability by default (as Preview).
Related Roadmap Capabilities
To make it possible to control your plugins more reliably, we are introducing new developer controls. You can see those feature requests below.
FAQ
Q. So when should I start rolling out Creator Studio in Copilot?
A. You should start today (if you haven’t already)! We’ll continue to improve our LLM performance & build the above improvements over the next few months. Remember to enable the experimental feature flag for Paths in Copilot when you’re ready!
Our team is excited to bring your Creator Studio plugins to Copilot. Please let us know what you think.
