As previously communicated, our Twitter data source connectors are going through major changes in May.
The Twitter Public Data data source connector remains available, but due to Twitter policy changes, it's required that our customers purchase an additional Twitter Basic API subscription from Twitter directly. The required subscription starts from 100 USD per month.
The change to Twitter Public Data will come into effect on May 31, 2023. You can take steps now to set up your own Twitter Basic API subscription so you can switch over on May 31 and keep existing queries running. Otherwise, queries will stop working.
What is required
You'll need the following items on May 31 to successfully log in to and use the Supermetrics Twitter Public Data data source:
- A Twitter developer account
- A valid subscription to Twitter’s Basic API access (100 USD a month)
- Twitter's Pro API access also works (5K USD a month) and provides more generous tweet fetching limits
- A live Twitter application (app) tied to your developer account
- Twitter API key and API key secret for that app so you can log in to Supermetrics
This article instructs you on how to get set up with the required items.
If you do not have one already, the first step is to create the developer account that will be linked to your Twitter Basic subscription and your app that will be used by the data source.
- Go to Twitter Developer Platform.
- Log in with the Twitter profile you want to have your Basic API subscription attached to.
This should automatically create a developer account for your profile.
- If you check your Twitter Developer Portal dashboard now, you should have a project and an app with the Free tier.
Now you're ready to set up Basic API access!
Once you have your developer account, now you can start the process of subscribing to Twitter's Basic API access. This level of API access will cost 100 USD a month to maintain and is required to use the Twitter Public Data data source.
- Go to https://developer.twitter.com/en/portal/petition/essential/basic-info.
- Click Subscribe.
- Fill in the Describe all of your use cases of Twitter’s data and API box with following:
The API access will be used to fetch reporting and analytics data for Twitter profiles using Supermetrics in order to automate manual reporting activities. The data will be used for marketing purposes to understand how profile follower base evolves and which tweets are performing the best.
- Check the boxes to agree to their terms and conditions.
- Click Submit to continue.
- Add your credit card information that will be used for the recurring 100 USD fee.
- Click Save payment method.
- Your Twitter Products dashboard will now update to show you have Basic access.
Now you're ready to get your API keys!
- Go back to your Twitter Developer Portal dashboard.
- You should see one project and one project app.
- On the project app, click the key icon to open the Keys and tokens panel.
- Under the Consume Keys section, click Regenerate.
- You'll get a popup with your API key and API key secret. Copy them for later use — these two values are what is needed to log in to the Twitter Public Data data source.
Store the API key and API key secret securely
Treat the API key and API key secret like a username and password. Save them securely, such as in a password vault, in case you need to reconnect later. This information is only shown once — if you lose them, you'll need to regenerate them and log in to the data source again with the new keys.
With your API key and API key secret saved, you're now ready to log in to the data source on May 31, when the changes take place!
Actions to take on May 31 to keep queries running
When the changes to Twitter Public Data are live on May 31, you'll need to take the following steps to ensure your API keys are in our system and keep existing queries running.
- Open the data destination of your choice, or go to the data source management page on the Supermetrics Hub.
- In the Data Source list, pick Twitter Public Data.
- Click + Add connection.
- Fill in the fields — all are required.
- Client ID: the API key from your Twitter app
- Client Secret: the API key secret from your Twitter app
- App name: Any 3-50 character long name to identify the app
- Choose to make this connection shared or private.
- Click Start.
- If the keys are correct, the login flow takes you back to the data destination or data source management page.
- Finally, follow the steps here to replace your old Twitter Public Data connection to use the new API key login.
Now your existing queries should automatically update to use the API key login!
Breaking changes in Twitter Public Data
In addition to the login updates above, there are additional changes to the data source that may affect existing queries.
- Tweet source
- Is truncated
- Is geo enabled
- Status place
- Status source
- Favourites count
For the "Twitter tweets by keyword" query type, the Result type setting changes. The Result type setting value "Mixed popular & recent" will reference only recency instead. Only two options will remain - "Recent" and "Relevant".
Tweet fetching limitations:
The Basic API package allows user to fetch up to 10K tweets per month (30 day period), which is more restrictive than the data source used to be. Please be mindful of the amount of profiles and tweets you are fetching, as it's not possible to reset the monthly limit.
If one is struggling to work within the 10K tweet limit, one can upgrade to the newly announced Pro level, which includes 1 million tweets per month. You can upgrade directly within the developer portal.