Azure Event Hub - Outgoing message/bytes doesn't increase after increasing throughput units and IEventProcessor instances

1
votes

I have an EventHub instance with 200 partitions (Dedicated cluster). Originally, I have a consumer group with 70 instances of IEventProcessor + 1 throughput unit.

It appears that I can only have 30M outgoing messages per hour while there are double of that amount for incoming. So I increased to 20 throughput units and 100 processor instances. But the outgoing messages don't increase beyond 30M. I don't see any throttle messages.

Are there other EventHub limits that I should adjust here?

EDIT 1:

After setting prefetch and batch size to 1000 I still only see moderate increase: Imgur

1
azure-eventhub

1 Answers

0
votes

Couple things I can recommend to check and do:

  1. Increase batch and prefetch size.
  2. Check client side resources like CPU and available memory. See if there is any high resource utilization which may become a bottleneck.
  3. If hosts are on in a different region than the eventhub, network latency can slow down the receives. Co-locate hosts with eventhub if so.

Consider creating a support ticket so PG can do a proper investigation.