Data Migration from Azure SQL Databases to Dynamics 365 for Marketing using Azure Data Factory

1
votes

I want to migrate data from Azure SQL Database(around 100 databases) to Dynamics 365 for marketing using Azure Data Factory. As I am new to Azure, I have several questions regarding this.

  1. Is this possible to copy from such large number of databases to Dynamics 365 for Marketing?

  2. I have several tables and long list of columns from databases, but I want to move only some data to Dynamics 365. Is it possible to create related records in CRM and assign them to the primary entity using Azure Data Factory?

  3. Can anyone explain me what needs to be done in order to achieve this?

Thank You.

1
azuredynamics-365azure-data-factory-2

1 Answers

1
votes

that is a very big question, let's break it down a bit:

  • Q: Does Azure Data Factory support Azure SQL and Dynamics 365

  • A: Yes. both are supported as a source and a sink (target) data store. The list of supported connectors is here

  • Q: Can you import data from multiple databases and sources

  • A: Sure, but you need to be a bit clever. Some tools and techniques that will help:

    1. Use the Data Factory loop construct
    2. Use Azure ARM templates to help set up your database connections (you can write some simple code to automatically generate all the relevant linked services)
    3. Use queries to shape the data you want to import. Look for sqlReaderQuery in these docs

  • Q: Is it possible to create related records in CRM and assign them to the primary entity using Azure Data Factory?

  • A: I don't think this is possible. You are limited to what the connector will do for you. Look for the "Sink" section in this documentation to see what the connector can do. An alternative is to write your own custom activity that does sink, and then you have full control over the behaviour.

Hope that gets you started!