Why Scrape Rakuten?

Rakuten is a significant online marketplace renowned for offering a wide range of products across various categories, including electronics, fashion, and home goods. With its diverse product offerings from different sellers, the platform has become a go-to marketplace for online shoppers around the globe.

The value of scraping Rakuten data extends beyond mere curiosity. The platform's rich, diverse, and dynamic dataset can offer invaluable insights into the world of e-commerce. From understanding pricing trends and buyer behaviour to tracking the value of products over time, this information can help businesses make data-driven decisions and develop competitive strategies in the online retail industry.

What Will We Scrape?

In this article, we'll focus on scraping the following product data from Rakuten:

  • Product ID
  • Product title and description
  • Product images
  • Seller details
  • Product availability
  • Initial and final price
  • Product category
  • Product rating and reviews

We'll use the Apple iPhone 13 product as an example to illustrate the scraping process.

Request :

curl --location --request GET 'https://autom.dev/api/v1/rakuten/product?query=https://fr.shopping.rakuten.com/mfp/7270256/apple-iphone-13?pid=7197507097' \
--header 'Content-Type: application/json' \
--header 'x-api-key: <token>'
curl --location --request GET 'https://autom.dev/api/v1/rakuten/product?query=https://fr.shopping.rakuten.com/mfp/7270256/apple-iphone-13?pid=7197507097' \
--header 'Content-Type: application/json' \
--header 'x-api-key: <token>'

Response

{
  "productId": "7197507097",
  "Title": "Apple iPhone 13 - 128 Go - 5G - Starlight",
  "Brand": "Apple",
  "Description": "The Apple iPhone 13 is a smartphone designed for performance. It features a 6.1-inch Super Retina XDR display and is powered by the A15 Bionic chip for incredibly fast processing speeds. With a dual-camera system, you can take stunning photos and videos. It also offers 5G connectivity for fast downloads and streaming.",
  "Availability": "In stock.",
  "InitialPrice": "909.90",
  "FinalPrice": "759.00",
  "Discount": "-8%",
  "Currency": "€",
  "Coupon": "",
  "EndOfDeal": "",
  "LightningDeal": false,
  "Delivery": ["FREE delivery: Within France "],
  "SellerName": "Apple Store",
  "PricingUrl": "https://fr.shopping.rakuten.com/mfp/7270256/apple-iphone-13?pid=7197507097",
  "ImageURL": "https://fr.shopping.rakuten.com/photo/iphone-13-128-go-5g-starlight-7197507097_ML.jpg",
  "ImageSet": [
    "https://fr.shopping.rakuten.com/photo/iphone-13-128-go-5g-starlight-7197507097_ML.jpg"
  ],
  "CategoryTree": ["Mobile Phones", "Apple iPhone"],
  "ReviewsCount": "",
  "TopReview": "",
  "Rating": "",
  "PanelVariations": [],
  "MenuVariations": [],
  "ProductSpecs": {
    "Brand": "Apple",
    "Model": "iPhone 13",
    "Colour": "Starlight",
    "Capacity": "128GB",
    "Connectivity": "5G",
    "ASIN": "B08XLZDBJ8",
    "Date First Available": "September 14, 2023",
    "Manufacturer": "Apple",
    "Item Weight": "174 grams",
    "Part Number": "MKQD3ZD/A",
    "Included Components": "iPhone with iOS 15, USB-C to Lightning Cable, Documentation",
    "Country of Origin": "USA",
    "Customer Reviews": "4.6 out of 5 stars",
    "Best Sellers Rank": "#1 in Smartphones"
  },
  "BestSellersRank": "N/A",
  "SalesRank": ["#1 in Smartphones"],
  "Manufacturer": "Apple",
  "Features": [
    "6.1-inch Super Retina XDR display",
    "Ceramic Shield, tougher than any smartphone glass",
    "A15 Bionic chip, the fastest chip ever in a smartphone",
    "Advanced dual-camera system with 12MP Wide and Ultra Wide cameras; Photographic Styles, Night mode, Deep Fusion, Smart HDR 4, 4K Dolby Vision HDR recording"
  ],
  "Format": [],
  "ProductDimensions": "5.78 x 2.82 x 0.30 inches",
  "ItemWeight": "174 grams",
  "Model": "iPhone 13",
  "EnergyEfficiency": "",
  "Capacity": "128GB",
  "NoiseLevel": "",
  "Colour": "Starlight",
  "Voltage": "",
  "Wattage": "",
  "Material": "Glass front, glass back, aluminum frame",
  "Included Components": "iPhone with iOS 15, USB-C to Lightning Cable, Documentation",
  "AnsweredQuestions": "",
  "ISBN10": "",
  "Product Summary": null,
  "Product details": [
    {
      "key": "Brand",
      "value": "Apple"
    },
    {
      "key": "Model",
      "value": "iPhone 13"
    },
    {
      "key": "Capacity",
      "value": "128GB"
    },
    {
      "key": "Colour",
      "value": "Starlight"
    },
    {
      "key": "Connectivity",
      "value": "5G"
    },
    {
      "key": "Manufacturer",
      "value": "Apple"
    },
    {
      "key": "Country of Origin",
      "value": "USA"
    },
    {
      "key": "Customer Reviews",
      "value": "4.6 out of 5 stars"
    },
    {
      "key": "Best Sellers Rank",
      "value": "#1 in Smartphones"
    },
    {
      "key": "Date First Available",
      "value": "September 14, 2023"
    },
    {
      "key": "Item Weight",
      "value": "174 grams"
    }
  ],
  "Size": "",
  "Fits true to size": "",
  "Similar items": [
    "https://fr.shopping.rakuten.com/mfp/6197063/iphone-12-128-go-bleu?pid=6849948609",
    "https://fr.shopping.rakuten.com/mfp/6054619/iphone-11-64-go-blanc?pid=6677984895",
    "https://fr.shopping.rakuten.com/mfp/5825532/iphone-xr-64-go-blanc?pid=6193136997",
    "https://fr.shopping.rakuten.com/mfp/5527772/iphone-8-64-go-gris-sideral?pid=5590230641"
  ],
  "URL": "https://fr.shopping.rakuten.com/mfp/7270256/apple-iphone-13?pid=7197507097"
}
{
  "productId": "7197507097",
  "Title": "Apple iPhone 13 - 128 Go - 5G - Starlight",
  "Brand": "Apple",
  "Description": "The Apple iPhone 13 is a smartphone designed for performance. It features a 6.1-inch Super Retina XDR display and is powered by the A15 Bionic chip for incredibly fast processing speeds. With a dual-camera system, you can take stunning photos and videos. It also offers 5G connectivity for fast downloads and streaming.",
  "Availability": "In stock.",
  "InitialPrice": "909.90",
  "FinalPrice": "759.00",
  "Discount": "-8%",
  "Currency": "€",
  "Coupon": "",
  "EndOfDeal": "",
  "LightningDeal": false,
  "Delivery": ["FREE delivery: Within France "],
  "SellerName": "Apple Store",
  "PricingUrl": "https://fr.shopping.rakuten.com/mfp/7270256/apple-iphone-13?pid=7197507097",
  "ImageURL": "https://fr.shopping.rakuten.com/photo/iphone-13-128-go-5g-starlight-7197507097_ML.jpg",
  "ImageSet": [
    "https://fr.shopping.rakuten.com/photo/iphone-13-128-go-5g-starlight-7197507097_ML.jpg"
  ],
  "CategoryTree": ["Mobile Phones", "Apple iPhone"],
  "ReviewsCount": "",
  "TopReview": "",
  "Rating": "",
  "PanelVariations": [],
  "MenuVariations": [],
  "ProductSpecs": {
    "Brand": "Apple",
    "Model": "iPhone 13",
    "Colour": "Starlight",
    "Capacity": "128GB",
    "Connectivity": "5G",
    "ASIN": "B08XLZDBJ8",
    "Date First Available": "September 14, 2023",
    "Manufacturer": "Apple",
    "Item Weight": "174 grams",
    "Part Number": "MKQD3ZD/A",
    "Included Components": "iPhone with iOS 15, USB-C to Lightning Cable, Documentation",
    "Country of Origin": "USA",
    "Customer Reviews": "4.6 out of 5 stars",
    "Best Sellers Rank": "#1 in Smartphones"
  },
  "BestSellersRank": "N/A",
  "SalesRank": ["#1 in Smartphones"],
  "Manufacturer": "Apple",
  "Features": [
    "6.1-inch Super Retina XDR display",
    "Ceramic Shield, tougher than any smartphone glass",
    "A15 Bionic chip, the fastest chip ever in a smartphone",
    "Advanced dual-camera system with 12MP Wide and Ultra Wide cameras; Photographic Styles, Night mode, Deep Fusion, Smart HDR 4, 4K Dolby Vision HDR recording"
  ],
  "Format": [],
  "ProductDimensions": "5.78 x 2.82 x 0.30 inches",
  "ItemWeight": "174 grams",
  "Model": "iPhone 13",
  "EnergyEfficiency": "",
  "Capacity": "128GB",
  "NoiseLevel": "",
  "Colour": "Starlight",
  "Voltage": "",
  "Wattage": "",
  "Material": "Glass front, glass back, aluminum frame",
  "Included Components": "iPhone with iOS 15, USB-C to Lightning Cable, Documentation",
  "AnsweredQuestions": "",
  "ISBN10": "",
  "Product Summary": null,
  "Product details": [
    {
      "key": "Brand",
      "value": "Apple"
    },
    {
      "key": "Model",
      "value": "iPhone 13"
    },
    {
      "key": "Capacity",
      "value": "128GB"
    },
    {
      "key": "Colour",
      "value": "Starlight"
    },
    {
      "key": "Connectivity",
      "value": "5G"
    },
    {
      "key": "Manufacturer",
      "value": "Apple"
    },
    {
      "key": "Country of Origin",
      "value": "USA"
    },
    {
      "key": "Customer Reviews",
      "value": "4.6 out of 5 stars"
    },
    {
      "key": "Best Sellers Rank",
      "value": "#1 in Smartphones"
    },
    {
      "key": "Date First Available",
      "value": "September 14, 2023"
    },
    {
      "key": "Item Weight",
      "value": "174 grams"
    }
  ],
  "Size": "",
  "Fits true to size": "",
  "Similar items": [
    "https://fr.shopping.rakuten.com/mfp/6197063/iphone-12-128-go-bleu?pid=6849948609",
    "https://fr.shopping.rakuten.com/mfp/6054619/iphone-11-64-go-blanc?pid=6677984895",
    "https://fr.shopping.rakuten.com/mfp/5825532/iphone-xr-64-go-blanc?pid=6193136997",
    "https://fr.shopping.rakuten.com/mfp/5527772/iphone-8-64-go-gris-sideral?pid=5590230641"
  ],
  "URL": "https://fr.shopping.rakuten.com/mfp/7270256/apple-iphone-13?pid=7197507097"
}