How to access the filename from a blob while copying into Azure Data Factory V2

1
votes

I'm trying to copy a bunch of files from a folder in Azure Data Lake Storage Gen 2 using Data Factory. I need to access the filenames of the blobs that I am copying at runtime so that I can inspect it and parse the name to retrieve important metadata. Unfortunately, I do not see a way to do this using Data Factory V2 on Azure. If anyone knows how to do this it would be greatly appreciated if you shared this with me.

1
azureazure-data-factory-2

1 Answers

1
votes

You could get an idea of Get Metadata Activity in Azure Data Factory which can be used to retrieve metadata of any data in Azure Data Factory.

However,only below connectors are supported so far:

enter image description here

Since your data is stored in ADL Gen2,you could try to transfer the data from ADL Gen2 to Azure Blob Storage.Then use Metadata Activity to access the file name in folder: https://docs.microsoft.com/en-us/azure/data-factory/control-flow-get-metadata-activity#get-a-folders-metadata