1
votes

I'm using ADF pipeline for storing data from data lake into cosmos db sql api. On triggering pipeline run, I see the following error:

enter image description here

Currently I'm using Throughput 5000 RU/s for the cosmos db container. Please help me understand why it is showing this error?

enter image description here

Here is my pipeline:

enter image description here enter image description here

1

1 Answers

2
votes

For saving your cost, don't unlimited increase RUs setting of cosmos db. Based on the error message you provided in your answer,it indicates that cosmos db can't process so many rows in unit time. So i suggest you throttling the transfer data procedure. Please consider using below configuration for the sink dataset of your copy activity.

enter image description here

The default value is 10,000, please decrease the number here if you do not concern the speed of transmission.More details ,please refer to this document.

enter image description here

Additional, you could throttling the max concurrent connections:

enter image description here