The Apache Spark troubleshooting agent and upgrade agent for Amazon EMR are now available as Kiro powers, bringing one-click access to AI-assisted Spark operations directly in Kiro. With these powers, data engineers can reduce troubleshooting time from hours to minutes and compress Spark version upgrades from months to weeks.
When a Spark job fails, the troubleshooting power identifies the root cause by analyzing logs, metrics, and configurations across EMR on EC2 and EMR Serverless, and provides specific code recommendations for PySpark applications. The upgrade power automates Spark version upgrades, such as moving from EMR 6.5 to EMR 7.12, by handling code transformation and dependency resolution through remote validation and data quality comparison on EMR. Both powers connect to Spark agents through MCP Proxy for AWS with IAM role-based authentication, and all actions are recorded in AWS CloudTrail for full auditability..
The Apache Spark troubleshooting and upgrade powers are available with Amazon EMR in all AWS commercial regions. To get started, install the Apache Spark troubleshooting power or the upgrade power from the Kiro IDE. For more information, see the troubleshooting agent and upgrade agent documentation.
Categories: marketing:marchitecture/analytics,general:products/amazon-emr
Source: Amazon Web Services
Latest Posts
- Amazon Location Service adds Search Nearby support for GrabMaps in Southeast Asia
- MC1440972: Microsoft Edge Brings Upgraded Copilot New Tab Page with Integrated Chat and Work Content
- Amazon RDS for Oracle now offers Reserved Instances for R8i and M8i instances
- AWS Lambda now supports Java 8, 11, and 17 on Amazon Linux 2023
