Hi,
I would like to set up an automatic refresh of a BigQuery every 1, 12, 24, or 48 hours (complete customization is preferred but these are great starting places).
We are using a BigQuery Table as a secondary “users” table where it has information on the user based on other data sources (things like phone number, team name, etc). We pull that in using a relation to their email and then write it to the user’s table upon user creation. However, right now the BigQuery is running every time a user refreshes the app, and that is causing us to use lots of data processed through BigQuery for something that only needs to be refreshed once a day since the information is not changing often (someone may get a new phone number, but that will only happen occasionally).
Right now every time a user refreshes the app the BigQuery is reloading which causes more latency issues than anything.
Thank you!