Is it possible to pull AWS IoT analytics datastore data into the dataset in real time?

Question

I am using AWS QuickSight to display charts. The data source is an AWS IoT analytics dataset.

Is it possible to have AWS IoT analytics datastore data into the dataset in real time? I know that we can manually do run now and this will have data as of the time we press the run now. Is there any way to automatically have realtime data into the dataset?

Currently the minimum frequency for automating pulling of data from the datastore into the dataset is 1 minute. This means that the data in the dataset (and hence QuickSight charts) will always be 1 minute stale.

Answer 1

Scheduling your query to run regularly in order to refresh the dataset is the only automated option when you use AWS IoT Analytics datasets. The highest frequency is 1 minute (near real-time) which is perfectly fine for most IoT-enabled solutions.

An alternative solution that is worth investigating would be using AWS IoT Core and forwarding messages from the topic stream to Lambda through IoT Core rules, then putting records on an Amazon Kinesis Data Firehose delivery stream, and finally using Amazon QuickSight to visualize the data stored within an S3 bucket. This link is a tutorial about how to accomplish it.