You generally write unit tests for your code, but do you also test your data? Incoming data quality can make or break your application. Incorrect, missing, or malformed data can have a large impact on production systems.
Source : https://aws.amazon.com/blogs/big-data/testing-data-quality-at-scale-with-pydeequ/
Date : December 30, 2020 at 09:54PM
Tag(s) : #DATA ENG
