Supermetrics Support Forum

How to Configure a Data Transfer in BigQuery

This guide will give a full walk-through of how to set up a Supermetrics data source to start transferring data into BigQuery. This example will show Facebook Ads as the data source, but the same steps can be used for other sources Supermetrics supports.


Here's a video showing you how to set this up (written directions below as well):


These written instructions assume you have already enrolled the data source and added it to your BigQuery project. If you have not done this yet, see First Steps (Getting Supermetrics Into Your BigQuery Project).

  1. Navigate to https://console.cloud.google.com/.
  2. Verify you have the correct project selected (listed in the upper-right under Project info).

    Example showing active project info to use with BigQuery

  3. Under Resources, click on "Big Query" to open it.

    Orange arrow points to the BigQuery option under Resources menu.

  4. Click on the main project name in the navigation tree to the left, which will reveal the CREATE DATASET option. Click on it to add a new dataset.

    Orange arrow points to "CREATE DATASET" option to create a new dataset for your transfers

    • Note - You can also select an existing dataset if you have one ready to receive the data tables.
  5. Give the dataset a meaningful name in Dataset ID and select a Data Location closest to you for best performance.

    Example setup for a new dataset in BigQuery

  6. Click Create dataset to finish the creation process.
  7. Next click Transfers to go to the transfer list.

    Orange box highlights the "Transfers" option in the list of BigQuery actions

  8. Click +CREATE.

    Orange box highlights blue text to "CREATE" and start the setup process for a transfer.

  9. Under the Source drop-down, select the data source connection you wish to use. For this walk-through, we will select "Facebook Ads by Supermetrics" as the example data source, but you can use any Supermetrics data source for the next steps.

    Orange box highlighting the "Source" drop-down, Facebook Ads by Supermetrics is selected as an example source

  10. Add a meaningful Transfer config name for the transfer.
  11. Set up your Scheduling options for when the transfer will run:
    • Select Start now to have the initial transfer start immediately after the configuration is saved.
    • Set Repeats to "Daily" option to have new data added once a day.
    • The Start date and run time is locked with "Start now" selected, so that can be ignored.
    • Example Schedule options set up to run the transfer now and once a day in the future.

  12. Select the Destination dataset, which will be the one defined earlier in steps 4-6.
  13. Optionally, you can enable Notification options so that the transfer administrator will get notifications about failures.
  14. Click CONNECT SOURCE proceed.

    Example Completed Transfer Setup:

    Example setup for Facebook Ads data transfer in BigQuery

  15. A pop-up will appear asking you to enabled a third party connection. To accept and proceed, click ACCEPT AGREEMENT.

    Orange arrow points to blue text to "ACCEPT AGREEMENT" to using a 3rd-party source that will write to your BigQuery project.

  16. Next it will ask you to sign in with your Google account. Press the button and follow the prompts to log in with the account that has access to your BigQuery project.

    Orange arrow points to button to "Sign in with Google" to log in with your Google account

  17. If you belong to multiple Supermetrics Teams, it will ask you to select the team you wish to use. If you only have one team it will skip to the next step.
  18. Then it will ask you to Authorize with Facebook Ads. (The exact text will change depending on which data source you selected.)

    Example login screen for Facebook Ads. Clicking the blue authorize button will allow one to log into Facebook and authorize the connection to their ad account

  19. Click on the Authorize with... button to proceed and you will be taken through a process to log into the data source with your user account for that platform.
    • Note that some data sources, like Facebook, will use your current browser cookies to log in you as that account. If you do not wish to log in as that account, log that user out of the platform in the browser and then proceed to authorize with Supermetrics. It should then give you the option to log in as any account.
  20. Select the ad account(s) you wish to have as part of the data transfer (note you can select more than one account), and fill in any additional settings if the connector supports them.

    Example ad account selection for the Facebook Ads data source. Account name drop-down shows "Supermetrics Ads".

  21. Click Submit to continue.
  22. If the data source was successfully connected, a pop-up will confirm this and then it will show the same in the transfer configuration, like so:

    Orange box highlights the green check icon and note that "Source connected" showing it was successfully connected

  23. Click SAVE to save the transfer. This will also start the initial data transfer.
  24. Orange arrow points to blue "SAVE" button which will save the configuration and begin the transfer at the time set in the settings.
  25. You can watch the progress in the Run History section (you may need to refresh the page to get the current status). Depending on the data source and the amount of data, it may take several minutes to complete the initial transfer.
  26. Once the initial transfer is complete, it will look something like this:

    Orange boxes highlight the parts of the Run History section that show the transfer completed successfully.

  27. Checking the dataset will now reveal a couple of new tables based on the default schema the data source uses (you can see the table definitions here for each source that is supported).
  28. They should usually be named with the following format:

    Datasource_Type_YYYYMMDD

    • Datasource is the short-code for the source the data came from - FBADS for Facebook Ads, for example
    • Type is the kind of data it is - campaign, demographics, post, etc.
    • YYYYMMDD is the date the table was transfered into BigQuery. New tables will be added for every day
  29. Next is to run a test query against one of the tables to verify there are results. 
  30. Select one table under the dataset and then click QUERY TABLE to load that table into the query editor.
  31. Create a basic query and run it.

    Example query and output against the Facebook Ads Campaign table:

    Example basic query to check the results of the Facebook Ads Campaign table

  32. Now you are ready to work with the data! This transfer will now automatically upload new daily values once a day, per the configuration in step 11.

What's Next!?


Need help? Contact Supermetrics Support

Did you find it helpful? Yes No

Send feedback
Sorry we couldn't be helpful. Help us improve this article with your feedback.