0
votes

We are reading data from a hive table with hiveContext using a spark dataframe. After doing some aggregations on the data we store this data into another table (which already has data). But the new data is not being appended to the existing table... and not showing any error either...

Note: Before storing into hive I am able to print the dataframe.

1
Please add relevant information. How are you writing the data to the table? How is the table structured? And other related information that might help the answerers. Also, read How to Ask and minimal reproducible example. - philantrovert
post the code and errors/exceptions which you are using and getting. No one be able to help without that information. They can be so many reasons by theory - Amit Kumar
grammatical fixes. - Mark
Thanks for your replay... the was issue resolved... - somu

1 Answers

0
votes
df.write.insertInto(target_db.target_table,overwrite = False)