Pick files with specific filenames in Azure Data Factory

Question

I am looking to copy files from blob storage to another blob using Azure Data Factory. However I want to pick only files which starts with say AAABBBCCC , XXXYYYZZZ and MMMNNNOOO. And the remaining I would like to ignore.

Answer 1

In ADF, use the Copy Activity and the wildcard path to set your matching file patterns

Answer 2

You could use prefix to pick the files that you want to copy. And this sample shows how to copy blob to blob using Azure Data Factory.

prefix: Specifies a string that filters the results to return only blobs whose name begins with the specified prefix.

// List blobs start with "AAABBBCCC" in the container
await foreach (BlobItem blobItem in client.GetBlobsAsync(prefix: "AAABBBCCC"))
{
    Console.WriteLine(blobItem.Name);
}

With ADF setting:

Set Wildcard paths with AAABBBCCC*. For more details, see here.