How to Schedule a Backfill Data Transfer for BigQuery

This guide will show you how to set up a data backfill request to add historical data to your project with Supermetrics for BigQuery.

Before You Begin

  • Make sure the initial transfer has been completed successfully for your data source of choice: How to Configure a Data Transfer in BigQuery
  • Trial licenses can only backfill up to 14 days. If you try to backfill farther than that, the transfer will fail.
  • You can bulk transfer up to 6 months worth of data at one time. If you need more time than that, you will need to do it in separate, 6-month-sized batches.
  • Different data sources have different data retention policies, so you may only be able to fetch up to their maximum value. See their API documentation for further details.

Schedule Backfill

  1. Open your BigQuery project that was connected to the Supermetrics data source.
  2. Click on Transfers.
  3. Find the transfer in the list you want to use for the backfill request. Click it to open details page.

    Orange box highlighting the transfer we want to use to backfill data into the dataset></p>
	<li>Then click <strong>Schedule backfill</strong>.

		<p><img src=

  4. Select the CONFIGURATION tab, and then click MORE.

    Orange box highlights the "CONFIGURATION" section, and then an arrow points to MORE to see additional options for the transfer.

  5. In the menu, select Schedule backfill.

    Orange box highlights "Schedule backfill" option in the MORE menu.

  6. Set the Start Date and  End Date values for the historical data you want to transfer into the dataset. Note that you can only do maximum 6-months at once (so you may need to do the backfill in batches for longer periods). Some data sources may not be able to handle requests for the current date.

    Example date range selection for the scheduled backfill run - shows past 7 days

  7. Click SCHEDULE to start the transfer process.
  8. It will add a new transfer request for each day in the range in the RUN HISTORY section. This may take some time to complete, depending on how much you requested at once. You can monitor the progress there in BigQuery or in Team Management (How to Monitor Your Daily BigQuery Transfers).

    Example Run History with 7 additional requests to add past data

  9. Once all the requests are complete, you can now see the additional tables for each day in the backfill in the dataset and can now utilize that data in your queries and reporting.

    Orange box highlights the date drop-down for the table "FBADS_DA_*" showing the newly added past dates

What's Next!?

Need help? Contact Supermetrics Support

Did you find it helpful? Yes No

Send feedback
Sorry we couldn't be helpful. Help us improve this article with your feedback.