'AWS Glue Job-bookmark not working when sending data from dynamodb to s3
I am trying to send data from dynamodb to s3 using AWS Glue. In the documentation, it is mentioned that job bookmark will keep a state of past jobs hence will only transfer new data into s3. But its not working when I am sending data to s3. It's copying whole dynamodb table to s3 instead of copying only newly added data. I need to use the SQL functionality of Athena. How do I rectify it?
amazon-web-servicesSolution 1:[1]
Please be advised that AWS Glue job bookmark feature works for S3 and JDBC datasources only as documented here
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | swapnil bhoite |