flink events are coming to jobmanager but not to taskmanager in cluster

Question

I am trying to run flink application on cluster. Application deployed successfully and I can see jobmanger and taskmanager are running and resource registration is done successfully.

Application need dummy event and it is working fine and sql query is also returning the result (by taskmanager).

Problem: Application receiving events from message hub but these messages are with jobmanager only and to coming to taskmanager for execution in cluster (standalone). But it works fine with intelliJ.

I understand if it would have kafka then addSource(new FlinkKafkaConsumer()) work but for me I have to register callback and then message comes onEvent.

is there any mechanism which can help to send events to taskmanager from jobmanager in cluster?

Answer 1

Events should not be processed on the JobManager at all. A possible reason for that behavior is that you start the application with a local executor. Could you double-check how you create your stream environment?