how to load dynamodb table with AWS Glue ETL

4
votes

A simple way to load dynamodb table with AWS Glue is to load with Glue Crawler. This is described in https://aws.amazon.com/blogs/database/simplify-amazon-dynamodb-data-extraction-and-analysis-by-using-aws-glue-and-amazon-athena/ Now I'm wondering if there is a way to load dynamodb table with AWS Glue ETL directly, say, without AWS Glue Crawler. I don't find any related topic so anyone could help is highly appreciated.

1
amazon-dynamodbaws-glue

1 Answers

5
votes

Finally found connection_options works without a crawler.

ddb_table = glueContext.create_dynamic_frame.from_options(
    connection_type="dynamodb",
    connection_options = {"dynamodb.input.tableName":"table_name", "dynamodb.throughput.read.percent":"0.5"}
)