AWS Glue now supports a new Amazon DynamoDB connector that works natively with Apache Spark DataFrames. This enhancement allows Spark developers to work directly with Spark DataFrames, to share code easily across AWS Glue, Amazon EMR, and other Spark environments.
Previously, developers working with DynamoDB data in AWS Glue were required to use the Glue-specific DynamicFrame object. With this new connector, developers can now reuse their existing Spark DataFrame code with minimal modifications. This change streamlines the process of migrating jobs to AWS Glue and simplifies data pipeline development. Additionally, the connector unlocks access to the full range of Spark DataFrame operations and the latest performance optimizations.
The new connector is available in all AWS Commercial Regions where AWS Glue is available. To get started, visit AWS Glue documentation.
Categories: marketing:marchitecture/serverless,marketing:marchitecture/analytics,general:products/aws-glue
Source: Amazon Web Services
Latest Posts
- (Updated) New flexibility and choice for sharing organizational data across Microsoft 365 and Viva apps [MC1316232]
- AWS announces AWS Blocks, an open-source framework for composing application backends on AWS (Preview)
- (Updated) Microsoft Edge moving to a 2-week release cycle starting with Edge 152 [MC1387532]
- Updates available for Microsoft 365 Apps for Current Channel [MC1393672]
