Azure Data Factory- Data Flow - After completion - move

0
votes

I am using ADF v2 DataFlow ativity to load data from a csv file in a Blob Storage into a table in Azure SQL database. In the Dataflow (Source - Blob storage), in Source options, there is an option 'After Completion(No Action/Delete Source file/ Move)'. I am looking to utilize the move option to save those csv files in a container renaming those files in concatenation with with today's date. How do I frame the logic for this? Can someone please help?

1
azureazure-sql-databaseazure-storage-blobsazure-data-factory-2azure-data-flow
Hi @Pranjal, do you have any other concerns? Please feel free to let me know. If my answer is helpful for you, hope you can accept it as answer. This can be beneficial to other community members. Thank you. - Leon Yue

1 Answers

1
votes

You could parameter the source file to achieve that. Please ref my example.

Data Flow parameter settings: enter image description here

Set the source file and move expression in Source Options: enter image description here

Expressions to rename the source with "name + current date":

concat(substring($filename, 1, length($filename)-4),toString(currentUTC(),'yyyy-MM-dd') )

My full file name is "word.csv", the output file name is "word2020-01-26", enter image description here

HTH.