'Not able to copy data from hdfs to s3 on cdp

WARN impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). INFO impl.MetricsSystemImpl: s3a-file-system metrics system started INFO Configuration.deprecation: No unit for fs.s3a.connection.request.timeout(0) assuming SECONDS

I am trying to run below command but getting above warning hadoop distcp -Dfs.s3a.access.key=key -Dfs.s3a.secret.key=key hdfs://pth s3a://path



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source