AWS Glue now supports a new Amazon DynamoDB connector that works natively with Apache Spark DataFrames. This enhancement allows Spark developers to work directly with Spark DataFrames, to share code easily across AWS Glue, Amazon EMR, and other Spark environments.
Previously, developers working with DynamoDB data in AWS Glue were required to use the Glue-specific DynamicFrame object. With this new connector, developers can now reuse their existing Spark DataFrame code with minimal modifications. This change streamlines the process of migrating jobs to AWS Glue and simplifies data pipeline development. Additionally, the connector unlocks access to the full range of Spark DataFrame operations and the latest performance optimizations.
The new connector is available in all AWS Commercial Regions where AWS Glue is available. To get started, visit AWS Glue documentation.
Categories: marketing:marchitecture/serverless,marketing:marchitecture/analytics,general:products/aws-glue
Source: Amazon Web Services
Latest Posts
- Cloudflare Web Analytics – Improved reliability for account-wide Web Analytics dashboards
- WAF – WAF Release – 2026-07-14
- AWS Partner Central subsidiary connections now support qualification sharing
- Amazon DocumentDB (with MongoDB compatibility) adds support for 46 new MongoDB operators in version 8.0.1
