Skip to content
Follow on X @MWorkspacePro
Modern Workspace Pro

Stay Informed, Stay Ahead in the Cloud with Copilot, Azure, AWS, and GCP

  • Home
  • Platform
    • Microsoft 365 Copilot
      • Power Platform
    • Azure
    • Amazon Web Services
    • Google Cloud Platform
    • Snowflake
    • Cloudflare
  • Categories
    • Stay informed
    • Plan for change
    • Prevent or fix issues
    • GitHub Projects
    • Microsoft 365 Blog
  • Tags
    • Major update
    • New feature
    • New release
    • Feature update
    • User impact
    • Admin impact
    • Updated message
    • Data privacy
    • Retirement
  • Pro Tips
    • Revolutionize Your SharePoint Experience with AI-Powered Agents
      • Powering Up: Enabling Pay-As-You-Go for SharePoint Agents
      • From Setup to Superpowers: Building and Using SharePoint Agents
    • Power Platform Pro Tips
      • Power Platform Environment Groups: The Art of Digital Order and Security
      • Complete Microsoft Automation, App, and Data Platform Comparison Chart
    • Power Automate Pro Tips
    • The Hidden User List in SharePoint Online
    • User Information List – Master SharePoint Online with PowerShell
  • Resources
    • Downloads
    • Cheat Sheets and Reference Guides
    • Power Platform Tools
    • SEO Tools

Find product changes, feature rollouts and announcements

AI Crawl Control

Home » AI Crawl Control

Explore by Platform
Microsoft 365 Copilot
Azure
Amazon Web Services
Google Cloud
Snowflake
Cloudflare
DigitalOcean - Coming Soon
OCI - Coming Soon
AI Crawl Control – New Robots.txt tab for tracking crawler compliance
Posted inAI Crawl Control Cloudflare

AI Crawl Control – New Robots.txt tab for tracking crawler compliance

AI Crawl Control now includes a Robots.txt tab that provides insights into how AI crawlers interact with your robots.txt files. What's new The Robots.txt tab allows you to: Monitor the health status of robots.txt files across all your hostnames, including…
Read More
Posted by Modern Workspace Pro 24 October 2025No Comments
AI Crawl Control – Enhanced AI Crawl Control metrics with new drilldowns and filters
Posted inAI Crawl Control Cloudflare

AI Crawl Control – Enhanced AI Crawl Control metrics with new drilldowns and filters

AI Crawl Control now provides enhanced metrics and CSV data exports to help you better understand AI crawler activity across your sites. What's new Track crawler requests over time Visualize crawler activity patterns over time, and group data by different…
Read More
Posted by Modern Workspace Pro 15 October 2025No Comments
Services
Archives

Latest Comments

  1. Snow Rider 3D on Amazon Cognito now supports resource indicators to simplify enhancing protection of OAuth 2.0 resources28 October 2025

    Wow, this change in Cognito sounds like a game-changer for security! It's kinda wild how little things like specifying resource…

  2. URL on Update to inline image representation in Outlook on the web and new Outlook for Windows [MC1174855]24 October 2025

    ... [Trackback] [...] Read More here: mwpro.co.uk/blog/2025/10/18/update-to-inline-image-representation-in-outlook-on-the-web-and-new-outlook-for-windows-mc1174855/ [...]

  3. Mike on GCP Release Notes: October 01, 20252 October 2025

    Haha, “magical shrinking sauce” is such a perfect way to describe it! The new InPlaceOrRecreate mode really does feel like…

  4. Mike on GCP Release Notes: October 01, 20252 October 2025

    Haha, love the imagery — “tiny floating islands” vs “resource-guzzling behemoths” is exactly how VPA feels sometimes! Kubernetes definitely keeps…

  5. Mike on Upcoming Secure by Default Settings Changes for Exchange and Teams APIs [MC1163922]2 October 2025

    Absolutely nailed it — this update does feel like Microsoft handing the keys back to IT admins, but with a…

Admin impact (1311) comparison (1) Feature update (623) New feature (1671) New Release (22) Plan for change (747) Prevent or fix issues (21) Retirement (194) Stay informed (1934) Updated message (768) User impact (1629)

Amazon Web Services (1005) Cloudflare (132) Dynamics 365 Apps (207) Exchange Online (238) Google Cloud Platform (127) Microsoft 365 apps (417) Microsoft 365 for the web (133) Microsoft 365 suite (214) Microsoft Dataverse (73) Microsoft Power Automate (109) Microsoft Purview (69) Microsoft Teams (630) Microsoft Viva (278) Power BI (114) Power Platform (274) SharePoint Online (183)

Site info
  • About us
  • Contact us
  • Privacy and Cookies Policy
  • Terms and Conditions
  • Affilate Disclosure
  • Sitemap
Copyright 2025 — Modern Workspace Pro. All rights reserved.
Scroll to Top