How to get the second last partition in hive (HQL)

Question

I have a hive table with below partitions:

part_date='07-12-2016'

part_date='04-12-2016'

part_date='01-12-2016'

Now how can I get the first partition which is less than the most recent partition in hive query. Assuming the partition values are the date when the data is ingested into the table. In this case it should be part_date='04-12-2016'.

so the query should be like:

select part_date from table_A where part_date > second_last_partition(ie 04-12-2016);

Thanks in advance

Vamsi Prabhala Vamsi Prabhala · Accepted Answer · 2016-07-21T18:36:25

You can use the row_number window function and get the second latest row.

select part_date
from (select part_date,row_number() over(order by part_date desc) as rn 
      from table_A) t
where rn = 2

I assume the part_date column is distinct. If not, you should use the dense_rank function.

How to get the second last partition in hive (HQL)

1 Answers