AWS Glue+Athena skip header row

Question

As of January 19, 2018 updates, Athena can skip the header row of files,

Support for ignoring headers. You can use the skip.header.line.count property when defining tables, to allow Athena to ignore headers.

I use AWS Glue in Cloudformation to manage my Athena tables. Using the Glue Table Input, how can I tell Athena to skip the header row?

ignorance ignorance · Accepted Answer · 2018-04-16T21:28:34

Basing off the full template for AWS::Glue::Table here, making the change from,

Resources:
  ...
  MyGlueTable:
    ...
    Properties:
      ...
      TableInput:
        ...
        StorageDescriptor:
          ...
          SerdeInfo:
            Parameters: { "separatorChar" : "," }

To,

            Parameters:
              separatorChar : ","
              "skip.header.line.count" : 1

Does the trick.

AWS Glue+Athena skip header row

1 Answers