Message ID: MC918562
Custom engine agents and Teams bots can now stream responses like Microsoft Copilot. They can provide real-time updates on their actions while delivering parts of the response as they generate it, making interactions feel faster and more engaging.
This message is associated with Microsoft 365 Roadmap ID 422261
[When this will happen:]
Targeted Release: We will begin rolling out mid-November 2024 and expect to complete by late-November 2024.
General Availability (Worldwide): We will begin rolling out mid-December 2024 and expect to complete by late-December 2024.
[How this will affect your organization:]
When users interact with a custom engine agent or Teams bot that streams its response, they will experience the new UX.
Users will first see informative updates from the agent on what it is doing while it generates a response to the user’s message:
Once the agent has performed prerequisite actions and is ready to respond, users will start to see the agent’s response flow in as incremental chunks until the full response is available. This experience is very similar to how the response iteratively appears on leading AI experiences like ChatGPT or Copilot:
Users will have the option to stop generating the response if they feel the agent is headed down an ineffective path. Users can simply click on the stop button underneath the response, and this will stop the agent’s response. Users can then prompt the agent again:
[What you need to do to prepare:]
You may consider updating your training and documentation as appropriate.
Source: Microsoft
The latest update on Microsoft Teams is bringing some exciting changes for admins and users alike! With the new Stream Custom Agent and Bot Responses feature, custom engine agents and Teams bots will now be able to stream responses in real-time, just like Microsoft Copilot. This means users will get updates on their actions as they happen, making interactions feel faster and more engaging.
For admins, this update will require some adjustments to training and documentation to make the most of this new feature. It’s a great opportunity to enhance user experience and streamline communication within the organization.
As for users, get ready for a more dynamic and interactive experience when interacting with custom engine agents and Teams bots. You’ll see informative updates on what the agent is doing while it generates a response, and then watch the response flow in incrementally until it’s fully available. If you feel the agent is going off track, you even have the option to stop the response and prompt it again.
Overall, the impact of these changes is expected to be quite significant, adding a new layer of responsiveness and engagement to your Teams interactions. I’m excited to see how this update transforms the user experience! What are your thoughts? Feel free to share your comments and let’s keep the conversation going!