• Spice Name: Scrape a Twitter profile
  • Results: Find valuable information about any Twitter profile

About scraping any Twitter profile

Twitter is an amazing place to find leads for sales and to sell something you need to have a clear idea of what exactly your target audience should look like. We have created this spice to help you create buyer personas by scraping any Twitter profile. This will help you understand your audience and sell more.

How to scrape any Twitter profile?

Profile URL is the primary input for this spice. You can create a list of profile URLs in a CSV or Google sheet to scrape their profile.

Here are the steps to use this spice

  1. Create a free TexAu account here
  2. Enter Twitter session cookie manually or simply use TexAu Chrome Extension
  3. If you have a list of Profile URLs you want to scrape, create a CSV or Google sheet and link it in the steps shown below.

Limitations & important points to note

  1. There’s no limit to this spice. However, you will have to keep in mind your daily limit. Find those details here.
  2. If you’re using the web version, make sure you toggle the ‘Use Proxy button’. This will require you to add a proxy to your account. If you use the TexAu Desktop app, you don’t have to worry about purchasing a proxy or even setting one.

Understanding the whole execution of this spice

Here we will see the steps of the execution & the inputs required for this spice.

The whole execution will play around these 5 input points & the total time to execute this will be around 1-2 minutes, depending on the number of Twitter Profile URLs you want to scrape.

Here’s what each of the input points means:

Scrape a Twitter Profile
  1. Auth_Token: Twitter uses this piece of information to ensure it’s really you who’s using the profile.
  2. Profile URL: Enter the Profile URL in this field. If you have a list of Profile URL in a CSV or a Google sheet. Use that in step 3
  3. Upload a CSV or Link a Google Sheet: Here you can upload a CSV or link a Google sheet. There are some extra steps here & we will cover them in the next section
  4. Scrape Twitter Profile: Clicking on this button will immediately start the execution
  5. Schedule this spice: You can choose to schedule this spice for later

How to scrape any Twitter profile?

Once your account is set up and you have completed the onboarding, visit the Spice page in the app. TexAu acts on your behalf on Twitter to run this automation.

TexAu is the safest automation platform on the web, it uses your Twitter session cookie to authenticate as you to run this automation. We never ask for your login credentials.

To make filling session cookies easier, you can use the TexAu Chrome extension. This process only requires 2 clicks.

Download TexAu Extension for Chrome here: TexAu Chrome Extension [Used and loved by over 4000+ customers]

Refresh your automation page and click on the Get Cookie button. Make sure you’re logged in to your Twitter account & the activated chrome extension will do the job.

In case if you are not using Google Chrome, check this guide on how to get cookies manually from your browser. We are working hard to bring our extension to all the major browsers very soon.

Step 2: Upload the CSV or paste Google sheet URL (only if you have multiple profile URLs)

If you have a CSV, simply upload it from your PC. If you have a Google Sheet, there are some extra steps.

  • First, paste the Google sheet’s URL.
  • Either get the session cookie or use our chrome extension to do it with the click of a button.
  • Input the column containing the Profile URLs. Make sure you choose the right column for successful execution.
Twitter Profile URLs — TexAu

For the final touch, make sure you have set the sheet as public (as shown below) so the TexAu can access it.

Step 3: Start execution or schedule the automation

Clicking on the Scrape Twitter Profile button will immediately start the execution. Based on the number of Profile URLs, the execution time will vary.

Scheduling the automation will give you additional points to control the execution. You can choose specific days of the week or month, specific times daily. You can even set a specific start & end time of the execution.

The advantage of automating the whole process is that you don’t have to actively sit in front of your PC while TexAu does its job.

Step 4: Download execution results to your local PC

Once you click on the Scrape Twitter Profile button, the execution will begin and then you will see the following message in the execution log.

Scrape a Twitter Profile Automation Completed

Once you see, click on the ‘Result’ button where you can view your results & download the result as a CSV file as shown below.

Download CSV Scrape A Twitter Profile

Note: Alternatively you can download results from the Results menu on the left-hand navigation, just hover over the menu & click on Results as shown below:

That’s all you need to scrape any Twitter profile.

In case if you have any questions related to this spice or anything related to TexAU, just drop us a message and we will get back in 10 minutes 🙂