The Apache Spark troubleshooting agent and upgrade agent for Amazon EMR are now available as Kiro powers, bringing one-click access to AI-assisted Spark operations directly in Kiro. With these powers, data engineers can reduce troubleshooting time from hours to minutes and compress Spark version upgrades from months to weeks.
When a Spark job fails, the troubleshooting power identifies the root cause by analyzing logs, metrics, and configurations across EMR on EC2 and EMR Serverless, and provides specific code recommendations for PySpark applications. The upgrade power automates Spark version upgrades, such as moving from EMR 6.5 to EMR 7.12, by handling code transformation and dependency resolution through remote validation and data quality comparison on EMR. Both powers connect to Spark agents through MCP Proxy for AWS with IAM role-based authentication, and all actions are recorded in AWS CloudTrail for full auditability..
The Apache Spark troubleshooting and upgrade powers are available with Amazon EMR in all AWS commercial regions. To get started, install the Apache Spark troubleshooting power or the upgrade power from the Kiro IDE. For more information, see the troubleshooting agent and upgrade agent documentation.
Categories: marketing:marchitecture/analytics,general:products/amazon-emr
Source: Amazon Web Services
Latest Posts
- (Updated) Collect Diagnostics change to Get Diagnostics for Outlook Mobile and Mac [MC1308855]
- (Updated) Smart Calendar available in Classic Outlook for Microsoft 365 Copilot users [MC1181279]
- Amazon Bedrock Guardrails announces a new API targeting agentic AI workflows
- Amazon FSx for Lustre Intelligent-Tiering storage class is now available in 13 additional AWS Regions
![Microsoft Teams: New chat sections for muted and meeting chats [MC1269864]](https://mwpro.co.uk/wp-content/uploads/2024/08/pexels-apasaric-325185-150x150.webp "Microsoft Teams: New chat sections for muted and meeting chats [MC1269864] 7")