I'm trying to write to a kafka sink using this documentation: https://docs.databricks.com/spark/latest/structured-streaming/avro-dataframe.html#example-with-schema-registry
However, I can't find to_avro function with more than one parameter in spark-avro(https://mvnrepository.com/artifact/org.apache.spark/spark-avro_2.11). Does anybody know if it has been moved/renamed or I should use another library? Thank you!
