We are using AdLS (Azure data lake storage)as a temporary storage in our ADF (Azure data factory - V2) pipeline. What is the best way to delete the data that is stored temporarily in ADLS?
U-SQL only supports DDL and not DML, so can’t delete the temporary data(files) stored in ADLS using ADLA(Azure data lake analytics)
I plan on using ADF's "Web Activity" DELETE method, but that uses tokens that expire and I have to keep updating them.
Can any one please let me know what other options do we have?