Move Files from one directory to another using SSIS Package in Azure Data Lake Store Gen1

0
votes

I am creating SSIS package and planning to use ADF to run it.

I am using Azure Data Lake Gen1 as File Store.

And as per our process once a file load completed we will move the file from one directory to another into Data Lake.

But not able to find anything in SSIS to do it. Anyone have any idea about it.

Your help is highly appreciated.

1
sql-serverazuressisazure-data-factoryazure-data-lake
what's the thing you want to find? How the SSIS package works in Data Factory? – Leon Yue
Is the source directory in data lake or is it on-premise? If everything is in datalake, I suggest you just use ADF to do it - don't use SSIS. If you must use SSIS, you can use the SSIS Azure Feature Pack docs.microsoft.com/en-us/sql/integration-services/control-flow/… – Nick.McDermaid
@Nick.McDermaid For the time being it's kind of must to use SSIS, and yes I am using SSIS Azure Feature Pack to handle files from Data Lake but their's no option to move files in Data Lake. – Prabir
@LeonYue We will deploy the SSIS package in ADF using (Configure SSIS Integration) – Prabir
Please make it clear: are you trying to move a file from one folder to another in data lake? From my understanding this is a rename function. There are a number of API – Nick.McDermaid

1 Answers

0
votes

As you said in comment, you will deploy the SSIS package in ADF using (Configure SSIS Integration).

You can reference this document to Provision the Azure-SSIS Integration Runtime in Azure Data Factory.

This tutorial provides steps for using the Azure portal to provision an Azure-SQL Server Integration Services (SSIS) Integration Runtime (IR) in Azure Data Factory (ADF). Azure-SSIS IR supports running packages deployed into SSIS catalog (SSISDB) hosted by Azure SQL Database server/Managed Instance (Project Deployment Model) and those deployed into file systems/file shares/Azure Files (Package Deployment Model). Once Azure-SSIS IR is provisioned, you can then use familiar tools, such as SQL Server Data Tools (SSDT)/SQL Server Management Studio (SSMS), and command line utilities, such as dtinstall/dtutil/dtexec, to deploy and run your packages in Azure.

  1. Create an Azure-SSIS integration runtime
  2. Provision an Azure-SSIS integration runtime
  3. Deploy SSIS packages

After you have created and configured the Azure-SSIS integration runtime, about how to run your SSIS package in Data Factory, Data Factory also give us so many ways:

  1. Execute SSIS packages in Azure from SSDT
  2. Run an SSIS package with the Execute SSIS Package activity in Azure Data Factory
  3. Run an SSIS package with the Stored Procedure activity in Azure Data Factory

Just choose the one which you like.

Hope this helps.