I'm streaming data into a bigquery table, for some reason last few times I checked the data isn't available instantly. The streamed data eventually is available to query, sometimes it looks like it's more than an hour out of sync. But data does eventually appear after some delays.
Is this expected? If it is, what are the ways around it? The table is partitioned by date and we are not "load"-ing data into any particular partition, we are streaming data only for the current day.
Update:
When I say data is not available, I mean running following query doesn't seem to match date/time the data was pushed to Bigquery.
select max(dateTime) from [nproj.reporting] ;