AWS-EMR-S3DISTCP - Does aws charges for s3 actions?

0
votes

I was looking into the documentation of s3distcp (https://docs.aws.amazon.com/emr/latest/ReleaseGuide/UsingEMR_s3distcp.html) but I was not able to find any explicit site where mention about costs of each action. This is a sample scenario:

  1. I have a bucket with 10,000 objects.
  2. An EMR cluster with 3 instances will be used to execute s3distcp.
  3. s3distcp has --deleteOnSuccess option enabled.
  4. Source and destination bucket, along with the EMR, are on the same account and region.

Questions is:

  1. Apart of the EMR usage (based on instance type, elapsed time, etc), is there an additional cost for s3 actions (ie. if I moved all 10K objects, does it mean 10K COPY requests)? Or billing will be associated only with the EMR costs?
1
amazon-s3amazon-emrs3distcpaws-billing

1 Answers

1
votes

AWS S3 costs will be billed as separate line items from your AWS EMR costs, so you should factor in S3 costs in addition to the EMR charges. S3 costs in this scenario will include charges for requests and possibly data transfer as per the S3 pricing guide.

That said, the associated S3 charges are likely to be trivial relative to the cost of an EMR cluster.