need to use mysql connection within flink MapFunction

Question

We have a flink job that need to transform kafka event from type1 to type2. But during the transformation, I need to call query mysql for additional information to construct type2. MysqlConnection is not serializable, could anyone suggest what's a better way to do this ?

Answer 1

Try make you connection field transient and initialize it in open method or constructor.

Answer 2

Georgy's answer is the simplest approach. For better throughput and resource utilization, consider using async i/o. The documentation includes an AsyncDatabaseRequest example.