Hi All,
My requirement is to have end users view, slice, filter my custom made dashboards/reports with the data being refreshed in as close to real-time as possible (preferably under 1 minute).
My datasets are curated from an API and pre-processed in python (necessary step) - this portion happens in real-time in the background. Currently, I save these outputs to .csv and set up a scheduled refresh in PowerBI service every ~1.5hours (limited to max 8 scheduled refreshes per day).
This is too slow for people to rely on for day-to-day functions so I'm looking for a solution to have the reports updated faster to reflect the true data in the background.
Is this possible with PowerBI? I'm open to using new architectures if required - eg. moving processed data into SQL if that enables real-time updates etc.
Thanks for any assistance.