We are announcing the ability to leverage Quality Evaluation Agent simulation to test & fine tune evaluation criteria in Dynamics 365 Customer Service. This feature will reach general availability on February 6, 2026.
How does this affect me?
This feature enables supervisors to validate new or updated evaluation criteria using real customer engagement data and see predicted outcomes before rolling the criteria out broadly. With the following capabilities introduced with this feature, supervisors can simulate evaluation criteria on a controlled sample of real engagements, iterate quickly, then publish.
- Run simulations directly from Evaluation Criteria to test how your criteria will score real cases without mixing test runs into production evaluation history.
- Choose which records to test using selection controls (e.g., filtering/conditions) so you can target the right scenarios and validate predictions against the interactions that matter most.
- Review Quality Evaluation Agent’s predicted answers and outcomes to confirm the criteria is producing the intended results, then refine questions and instructions and rerun one or more simulations until outcomes match your expectations.
- Support draft and published criteria testing with governance tied to criteria versions, so you can test safely and keep clarity on what was validated before publication.
- Track simulation runs for a criterion (including rerun/retrigger workflows in the experience) so teams can iterate efficiently during tuning and rollout readiness.
- Publish when ready. Once validated, you can confidently publish the updated criteria and use it for quality evaluations at enterprise scale.
This message is for awareness, and no action is required.
Source: Microsoft
Latest Posts
- MC1519871: Microsoft Copilot Code Expands to Mobile and Mac with Local Sandbox for Frontier Users

- MC1557760: Microsoft Teams Increases Registration Capacity for Town Halls and Webinars to 20,000

- MC1557764: Agent 365 Business Analytics Adds Access Management for Admin Role and Permission Control

- MC1557754: Microsoft Copilot Adds Usage-Based Billing to Continue Model Access with Copilot Credits






