This guide will give a full walk-through of how to set up a Supermetrics data source to start transferring data into BigQuery. This example will show Facebook Ads as the data source, but the same steps can be used for other sources Supermetrics supports.
Here's a video showing you how to set this up (written directions below as well):
These written instructions assume you have already enrolled the data source and added it to your BigQuery project. If you have not done this yet, see First Steps (Getting Supermetrics Into Your BigQuery Project).
- Navigate to https://console.cloud.google.com/.
- Verify you have the correct project selected (listed in the upper-right under Project info).
- Under Resources, click on "Big Query" to open it.
- Click on the main project name in the navigation tree to the left, which will reveal the CREATE DATASET option. Click on it to add a new dataset.
- Note - You can also select an existing dataset if you have one ready to receive the data tables.
- Give the dataset a meaningful name in Dataset ID and select a Data Location closest to you for best performance.
- Click Create dataset to finish the creation process.
- Next click Transfers to go to the transfer list.
- Click +CREATE.
- Under the Source drop-down, select the data source connection you wish to use. For this walk-through, we will select "Facebook Ads by Supermetrics" as the example data source, but you can use any Supermetrics data source for the next steps.
- If you did not yet enroll a data source for your project, see First Steps (Getting Supermetrics Into Your BigQuery Project) for how to set this up.
- Add a meaningful Transfer config name for the transfer.
- Set up your Scheduling options for when the transfer will run:
- Select Start now to have the initial transfer start immediately after the configuration is saved.
- Set Repeats to "Daily" option to have new data added once a day.
- The Start date and run time is locked with "Start now" selected, so that can be ignored.
- Select the Destination dataset, which will be the one defined earlier in steps 4-6.
- Optionally, you can enable Notification options so that the transfer administrator will get notifications about failures.
- Click CONNECT SOURCE proceed.
Example Completed Transfer Setup:
- A pop-up will appear asking you to enabled a third party connection. To accept and proceed, click ACCEPT AGREEMENT.
- Next it will ask you to sign in with your Google account. Press the button and follow the prompts to log in with the account that has access to your BigQuery project.
- If you belong to multiple Supermetrics Teams, it will ask you to select the team you wish to use. If you only have one team it will skip to the next step.
- Then it will ask you to Authorize with Facebook Ads. (The exact text will change depending on which data source you selected.)
- Click on the Authorize with... button to proceed and you will be taken through a process to log into the data source with your user account for that platform.
- Note that some data sources, like Facebook, will use your current browser cookies to log in you as that account. If you do not wish to log in as that account, log that user out of the platform in the browser and then proceed to authorize with Supermetrics. It should then give you the option to log in as any account.
- Select the ad account(s) you wish to have as part of the data transfer (note you can select more than one account), and fill in any additional settings if the connector supports them.
- Click Submit to continue.
- If the data source was successfully connected, a pop-up will confirm this and then it will show the same in the transfer configuration, like so:
- Click SAVE to save the transfer. This will also start the initial data transfer.
- You can watch the progress in the Run History section (you may need to refresh the page to get the current status). Depending on the data source and the amount of data, it may take several minutes to complete the initial transfer.
- Once the initial transfer is complete, it will look something like this:
- Checking the dataset will now reveal a couple of new tables based on the default schema the data source uses (you can see the table definitions here for each source that is supported).
- They should usually be named with the following format:
- Datasource is the short-code for the source the data came from - FBADS for Facebook Ads, for example
- Type is the kind of data it is - campaign, demographics, post, etc.
- YYYYMMDD is the date the table was transfered into BigQuery. New tables will be added for every day
- Next is to run a test query against one of the tables to verify there are results.
- Select one table under the dataset and then click QUERY TABLE to load that table into the query editor.
- Create a basic query and run it.
Example query and output against the Facebook Ads Campaign table:
- Now you are ready to work with the data! This transfer will now automatically upload new daily values once a day, per the configuration in step 11.
- Set up a backfill request to add historical data: How to Schedule a Backfill Data Transfer for BigQuery
- Check out the Data Warehouse Table descriptions to see what is available for other sources
- How to Monitor Your Daily BigQuery Transfers from Team Management
- Visualizing Your BigQuery Data in Data Studio
Need help? Contact Supermetrics Support