How to get high rps with JMeter load testing https endpoint

Question

I'm trying to test my https endpoint with JMeter. I want to make at least 10000 requests per second, but when I set the number of threads to 10000 I get way less rps, around 500.

I've tried setting the number of threads to 1000 and 100, surprisingly I get this same number of rps. I'm using HTTP Sampler and "use Keep-Alive" is set to true. When I look in the statistics I see that when using 100 threads, it makes use of Keep-Alive and connect_time is around 100 ms, but when the number of threads is higher connect_time grows, it's like it stops reusing the connections.

I know this isn't a server issue, because I've tried testing that same endpoint with Yandex.Tank and phantom and it can easily maintain 10 000 requests per second, the problem is it can't use response data to make furhter requests, that's why I have to use JMeter for this task.

Answer 1

This can be done by using "Stepping thread group". It will allow you to send 10000 request per second upto specified time. Refer below image.

Stepping Thread Group

Download jar from below link.

https://jmeter-plugins.org/wiki/SteppingThreadGroup/

Answer 2

I hope you are trying to achieve this using one machine. Try with multiple machine or jmeter distributed mode.

https://jmeter.apache.org/usermanual/jmeter_distributed_testing_step_by_step.pdf https://www.blazemeter.com/blog/how-to-perform-distributed-testing-in-jmeter/ https://blazemeter.com/blog/3-common-issues-when-running-jmeter-scripts-and-how-solve-them/

I am assuming that it is the issue with machine which is not able to generate that much load. Usually, i have use max 300 threads per machine but it depend on the machine config. Just check if the machine is having issue and multiple machine is able to generate more load, considering server is not having any issue.

Hope this helps.

Update:-Usually 200-500 can be handled my modern machines. Please check the below link to have some more info:-

1.How do threads and number of iterations impact test and what is JMeter’s max. thread limit
2.https://www.blazemeter.com/blog/what%e2%80%99s-the-max-number-of-users-you-can-test-on-jmeter/ .