MSCK REPAIR TABLE working strangely on delta tables

0
votes

I have a delta table in s3 and for the same table, I have defined an external table in Athena. After creating the Athena table and generating manifests, I am loading the partitions using MSCK REPAIR TABLE. All the partition columns are in snake_case. But still, I am getting

Partitions not in metastore.

Any idea what am I missing here?

2
amazon-athenadelta-lake
are you getting this directly after generation of manifest & MSCK? - Alex Ott
Yes, when I download the output of MSCK, I see these lines in that file. - Ankit Anand
Did you check the error logs for athena query ? - Nishu Tayal

2 Answers

1
votes

The IAM user or role doesn't have a policy that allows the glue:BatchCreatePartition action. You have to allow glue:BatchCreatePartition in the IAM policy and it should work.

0
votes

Resolved the issue. I was putting partition columns in wrong order while creating the table.