1
votes

How to run a shell script from Azure Data Factory. Inside the shell script I am trying to execute an hql file like below:

/usr/bin/hive -f "wasbs://[email protected]/hivetest/extracttemp.hql" > 
wasbs://[email protected]/hivetest/extracttemp.csv

My hql file is stored inside a Blob Storage and I want to execute it and collect the result into a csv file and store it back to Blob Storage . This entire script is stored in shell script which also in a Blob Storage. NowIi want to execute in a Azure Data Factory in hive activity. Help will be appreciated.

1

1 Answers

0
votes

You could use Hadoop hive activity in ADF. Please take a look at this doc. And you could build your pipeline with ADF V2 UI.