Adjust streaming rate in dataflow pubsub to bigquery template

0
votes

I want to use the Google-provided template for streaming data from Pubsub to Bigquery, although I want the streaming to be done at 1 row per second. How can I update the streaming speed? Any advice would be appreciated

1
google-cloud-platformgoogle-bigquerygoogle-cloud-dataflowgoogle-cloud-pubsub
is there any reason why? – Felipe Hoffa
Because I am using Data Studio to visualize the real-time streaming data and it would look good if the data came in every second.. – Parth Desai
oh - note that Data Studio doesn't refresh in real time - hence you won't be able to see data refreshing every second regardless – Felipe Hoffa

1 Answers

1
votes

I don't think you can do that with the template. Only option I see is throttling the rate of messages published to the topic.