Is it possible to delete data from a BigQuery table while loading data into it from an Apache Beam pipeline.
Our use case is such that we need to delete 3 days prior data from the table on the basis of a timestamp field (time when Dataflow pulls message from Pubsub topic).
Is it recommended to do something like this? If yes, is there any way to achieve this?
Thank You.