Use an open-source tool to move large data to cloud object storage

There are many occasions that require moving data from Hadoop Distributed File System (HDFS) to cloud object storage. Occasionally, data scientists may decide to archive part or all of their HDFS data to cloud object storage for later use, or to migrate part or all of their data and processing to a different cluster that is already connected to cloud object storage.

Source : https://developer.ibm.com/blogs/moving-data-from-hdfs-to-ibm-cloud-object-storage-with-cosdistcp/

Date : November 8, 2019 at 12:21AM

Tag(s) : #AI ENG