Spark -Hive integration for Struct values - NULL output

0
votes

Using Spark 2.2

I have populated a parquet struct column from spark program also another parquet column struct array

when it reading it from hive as external table; struct array is properly populated, but struct(Non-Array type) fields generated as NULL. Note: In parquet both struct and struct array values populated. Only in Hive we have problem Any thoughts on this?

1
apache-sparkstructhive
"struct<lastName:string,firstName:string>" "<array<struct<lastName:string,firstName:string>> - SRV

1 Answers

0
votes

I got the problem, it was with column name change in hive table