gRPC java client channel pooling and server concurrent request handling

Question

We are developing grpc based services in JAVA using SpringBoot.

We are following https://github.com/LogNet/grpc-spring-boot-starter

@GrpcService : used at server side service

@GrpcClient : used at client side stub

I am able to test this application.

Question : On production , we will be receiving around 5000 request per second with each request may take from 25 ms to 1 second.

Client side : How to implement connection (channel) pooling?

Server side : How to make server to handle multiple request simultaneously like any web server does ?

Answer 1

Client side : How to implement connection (channel) pooling?

Please describe what kind of pooling you are expecting - whether multiple channels using sub-channels/connections from a pool or a higher level pooling mechanisms for the channels themselves?

Server side : How to make server to handle multiple request simultaneously like any web server does ?

This is already the case. Look at ServerBuilder.executor() which allows you to specify your own executor for concurrent handling of requests.