0
votes

If you have a pipeline with a copy data activity, which copies data from an on-prem SQL server to an azure data lake storage account - and you choose some form of compression.

Where is the compression happening? Is the data transfered over the internet to the cloud, and then compressed. Or does it get compressed on-prem by the self-hosted integration runtime?

1

1 Answers

2
votes

Where is the compression happening?

The compression happens on the self-hosted Integration Runtime.

If it is a staged copy, the IR will compress the data when writing to the intermediate blob storage account. And if it's not a staged copy, the IR writes the files directly to ADLS.