How to Export million records DynamoDB table as a CSV using Data Pipeline?

0
votes

I have a million record DynamoDB table. I am using the Data Pipeline to export the DynamoDb table to S3. But the Data Pipeline exports the table as a group of raw json files in DynamoDB JSON format. After the Data Pipeline ran for an hour, the EMR failed due to timeout exception.

Is there any way to export the DynamoDB table as a CSV and increase the EMR timeout configuration in Data Pipeline?

1
csvamazon-dynamodbetlamazon-data-pipeline

1 Answers

0
votes

You may check DynamoDBToCSV exporter service. This tool is a simple node project where you have to put your AWS configuration and then after you can run and download all the records from dynamoDB table.