Why Scrape Threads.net ?

Threads.net, Meta's new social media platform, emerges as a powerful alternative to existing platforms like Twitter. With a core focus on sharing text, discussions, and ideas, and fostering online community building, Threads offers a wealth of social data waiting to be explored. From trends in social discussions to identifying influencers, the data available on Threads can offer businesses and researchers valuable insights.

Scraping data from Threads provides an in-depth understanding of social trends, user behaviors, and patterns in user engagement. This understanding is invaluable for businesses aiming to tailor their marketing strategies, improve customer engagement, or develop new products or services. With the rise of big data, scraping Threads.net becomes a critical tool for staying competitive in the fast-paced world of social media.

What Will We Scrape ?

At the moment we have 2 differents way to scrape Threads by Meta. We can scrape User Profile or Threads (Post message).

We will scrape the following social data from Threads.net :

User profile :

  • username
  • full name
  • followers
  • pictures
  • biography

Threads :

  • username
  • message
  • pictures
  • like counter
  • timestamp

Example for Scraping Social Data from Threads.net

Request :

curl --location --request GET 'https://autom.dev/api/v1/threads/info?query=zuck' \
--header 'Content-Type: application/json' \
--header 'x-api-key: <token>'
curl --location --request GET 'https://autom.dev/api/v1/threads/info?query=zuck' \
--header 'Content-Type: application/json' \
--header 'x-api-key: <token>'

Response :

{
  "id": "314216",
  "username": "zuck",
  "full_name": "Mark Zuckerberg",
  "follower_count": 2116745,
  "profile_pic_url": "https://scontent.cdninstagram.com/v/t51.2885-19/357376107_1330597350674698_8884059223384672080_n.jpg?stp=dst-jpg_s150x150&_nc_ht=scontent.cdninstagram.com&_nc_cat=1&_nc_ohc=euIj8dtTGIkAX9OxQ0Y&edm=APs17CUBAAAA&ccb=7-5&oh=00_AfDXBpXzKhAi9pNeWU96QHMdTXe4Ch2hN2IhMoUt8WbiNQ&oe=64ACDDC0&_nc_sid=10d13b",
  "biography": "",
  "bio_links": [
    {
      "url": ""
    }
  ]
}
{
  "id": "314216",
  "username": "zuck",
  "full_name": "Mark Zuckerberg",
  "follower_count": 2116745,
  "profile_pic_url": "https://scontent.cdninstagram.com/v/t51.2885-19/357376107_1330597350674698_8884059223384672080_n.jpg?stp=dst-jpg_s150x150&_nc_ht=scontent.cdninstagram.com&_nc_cat=1&_nc_ohc=euIj8dtTGIkAX9OxQ0Y&edm=APs17CUBAAAA&ccb=7-5&oh=00_AfDXBpXzKhAi9pNeWU96QHMdTXe4Ch2hN2IhMoUt8WbiNQ&oe=64ACDDC0&_nc_sid=10d13b",
  "biography": "",
  "bio_links": [
    {
      "url": ""
    }
  ]
}

And an exemple with the threads data api methods :

Request :

curl --location --request GET 'https://autom.dev/api/v1/threads/threads?query=zuck' \
--header 'Content-Type: application/json' \
--header 'x-api-key: <token>'
curl --location --request GET 'https://autom.dev/api/v1/threads/threads?query=zuck' \
--header 'Content-Type: application/json' \
--header 'x-api-key: <token>'

Response :

{
  "thread_items": [
    {
      "post": {
        "user": {
          "profile_pic_url": "https://scontent.cdninstagram.com/v/t51.2885-19/357376107_1330597350674698_8884059223384672080_n.jpg?stp=dst-jpg_s150x150&_nc_ht=scontent.cdninstagram.com&_nc_cat=1&_nc_ohc=euIj8dtTGIkAX9F9kax&edm=APs17CUBAAAA&ccb=7-5&oh=00_AfCPGIHuV3MZdBQIoFvJT1ZW1iYUxgtSxx0Jgu5QDHpkoA&oe=64ACDDC0&_nc_sid=10d13b",
          "username": "zuck",
          "is_verified": true,
          "pk": "314216"
        },
        "image_versions2": {
          "candidates": [
            {
              "height": 3000,
              "url": "https://scontent.cdninstagram.com/v/t51.2885-15/357916630_786901039847062_4398530087245184228_n.jpg?se=7&stp=dst-jpg_e35&_nc_ht=scontent.cdninstagram.com&_nc_cat=1&_nc_ohc=vSLyED13mHsAX-fLa0m&edm=APs17CUBAAAA&ccb=7-5&ig_cache_key=MzE0MTAwMjI5NTIzNTA5OTE2NQ%3D%3D.2-ccb7-5&oh=00_AfCqy638kKM79lalKe76xxAdri_wek8kc3FfsDKUnAi2xA&oe=64ACBB47&_nc_sid=10d13b",
              "width": 4000,
              "__typename": "XDTImageCandidate"
            }
            // MORE CANDIDATES
          ]
        },
        "__typename": "XDTPost"
      },
      "should_show_replies_cta": true,
      "__typename": "XDTThreadItem",
      "user_dict": {
        "__typename": "XDTUserDict",
        "profile_pic_url": "https://scontent.cdninstagram.com/v/t51.2885-19/358049234_1408689016649519_5266582489725644814_n.jpg?stp=dst-jpg_s150x150&_nc_ht=scontent.cdninstagram.com&_nc_cat=111&_nc_ohc=aGV46oiRJQsAX-H9lGF&edm=APs17CUBAAAA&ccb=7-5&oh=00_AfABE6cTNPLf0kPlHbSrLVkl7_TYRjxAZCq4qi2pL00Obw&oe=64AC963C&_nc_sid=10d13b"
      }
    }
    // MORE THREAD ITEMS
  ],
  "id": "3138977881796614961"
}
{
  "thread_items": [
    {
      "post": {
        "user": {
          "profile_pic_url": "https://scontent.cdninstagram.com/v/t51.2885-19/357376107_1330597350674698_8884059223384672080_n.jpg?stp=dst-jpg_s150x150&_nc_ht=scontent.cdninstagram.com&_nc_cat=1&_nc_ohc=euIj8dtTGIkAX9F9kax&edm=APs17CUBAAAA&ccb=7-5&oh=00_AfCPGIHuV3MZdBQIoFvJT1ZW1iYUxgtSxx0Jgu5QDHpkoA&oe=64ACDDC0&_nc_sid=10d13b",
          "username": "zuck",
          "is_verified": true,
          "pk": "314216"
        },
        "image_versions2": {
          "candidates": [
            {
              "height": 3000,
              "url": "https://scontent.cdninstagram.com/v/t51.2885-15/357916630_786901039847062_4398530087245184228_n.jpg?se=7&stp=dst-jpg_e35&_nc_ht=scontent.cdninstagram.com&_nc_cat=1&_nc_ohc=vSLyED13mHsAX-fLa0m&edm=APs17CUBAAAA&ccb=7-5&ig_cache_key=MzE0MTAwMjI5NTIzNTA5OTE2NQ%3D%3D.2-ccb7-5&oh=00_AfCqy638kKM79lalKe76xxAdri_wek8kc3FfsDKUnAi2xA&oe=64ACBB47&_nc_sid=10d13b",
              "width": 4000,
              "__typename": "XDTImageCandidate"
            }
            // MORE CANDIDATES
          ]
        },
        "__typename": "XDTPost"
      },
      "should_show_replies_cta": true,
      "__typename": "XDTThreadItem",
      "user_dict": {
        "__typename": "XDTUserDict",
        "profile_pic_url": "https://scontent.cdninstagram.com/v/t51.2885-19/358049234_1408689016649519_5266582489725644814_n.jpg?stp=dst-jpg_s150x150&_nc_ht=scontent.cdninstagram.com&_nc_cat=111&_nc_ohc=aGV46oiRJQsAX-H9lGF&edm=APs17CUBAAAA&ccb=7-5&oh=00_AfABE6cTNPLf0kPlHbSrLVkl7_TYRjxAZCq4qi2pL00Obw&oe=64AC963C&_nc_sid=10d13b"
      }
    }
    // MORE THREAD ITEMS
  ],
  "id": "3138977881796614961"
}

Ready to Scrape Data from Threads.net ?

Are you looking to harness the social data from Threads.net for your project? Or perhaps you're interested in gaining comprehensive social media insights? Autom.dev is your go-to partner.

Our team at Autom.dev excels in diverse data scraping projects, mass data extraction, monitoring, and API creation and management. We tailor our services to meet your unique business needs, providing the most efficient solutions.

Stay ahead of the social media curve with fresh, reliable data. With Autom.dev, you can unlock the insights you need to drive your business forward. Ready to transform your data scraping project into a success? Contact us today to get started.