Coping files from Azure blob storage to azure data lake store

1
votes

I am Coping files from Azure blob storage to azure data lake store, I need to pick files from year(folder)\month(folder)\day(txt files are on day bases).I am able to do one file with hadrcoded path but i am not able to pick file per day and process to copy in azure data lake store. Can anyone please help me.

I am using ADF V2 and using UI designer to create my connections,datasets and pipeline my steps are which i is working fine

  • copy file from blob storage to data lake store
  • picking that file from data lake store and processing through usql for transform data.
  • that transform data i am saving in Azure SQL DB

Please give me answer i am not able to get any help b/c all help is in JSON i am looking how i will define and pass parameters in UI designer.

Thanks

1
azure-data-factoryazure-data-lake

1 Answers

1
votes

For the partitioned file path part, you could take a look at this post. You could use copy data tool to handle it.