Simplify data pipelines with AWS Glue automatic code generation and Workflows

In the previous post of the series, we discussed how AWS Glue job bookmarks help you to incrementally load data from Amazon S3 and relational databases. We also saw how using the AWS Glue optimized Apache Parquet writer can help improve performance and manage schema evolution.

Source : https://aws.amazon.com/blogs/big-data/simplify-data-pipelines-with-aws-glue-automatic-code-generation-and-workflows/

Date : April 29, 2020 at 09:17PM

Tag(s) : #DATA ENG