Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

1 Commit
Β 
Β 

Repository files navigation

Tokopedia Product Scraper πŸ›οΈ

A high-performance solution for extracting rich product data from Tokopedia search results. It helps automate competitive analysis, pricing research, and product trend monitoring with reliable, structured output. This Tokopedia product scraper is ideal for businesses, analysts, and automation workflows.

Bitbash Banner

Telegram Β  WhatsApp Β  Gmail Β  Website

Created by Bitbash, built to showcase our approach to Scraping and Automation!
If you are looking for tokopedia-product-scraper you've just found your team β€” Let’s Chat. πŸ‘†πŸ‘†

Introduction

This tool gathers detailed product information from Tokopedia search pages. It solves the challenge of collecting accurate product data at scale, enabling better decision-making for pricing, competition tracking, or product discovery. It's built for researchers, e-commerce analysts, automation developers, and data-focused teams.

Why Tokopedia Product Scraping Matters

  • Enables large-scale collection of structured product data for analytics.
  • Helps track real-time market shifts and price movements.
  • Accelerates competitor comparison with accurate product metadata.
  • Supports lead generation for sellers and brands.
  • Provides category, rating, sales, and shop insights in one dataset.

Features

Feature Description
Search result scraping Extracts product data directly from Tokopedia’s search pages.
Rich product metadata Collects IDs, names, URLs, deep links, prices, discounts, and more.
Shop information Captures seller details such as name, location, and tier.
Sales metrics Gathers sold count, COD availability, credibility labels, etc.
Category & rating extraction Provides hierarchical category data and customer rating information.
Proxy support Works more reliably with proxy configurations.
Adjustable limits Set maxItems to control dataset size.
High-performance engine Efficient crawling with browser automation.

What Data This Scraper Extracts

Field Name Field Description
searchUrl The Tokopedia search URL from which results were gathered.
id Unique product identifier used by Tokopedia.
name Product name as listed on Tokopedia.
url Canonical product page URL.
applink Mobile deep link path for Tokopedia app navigation.
mediaURL Object containing product images and video references.
shop Seller details including ID, name, city, and tier.
badge Shop or product badge metadata.
price Current price, original price, discount percentage, and formatted text.
freeShipping Free-shipping indicators with media URLs if present.
labelGroups Credibility and offer labels such as β€œ10rb+ terjual” or β€œBisa COD”.
category Category tree, breadcrumbs, and analytics keys.
rating Average rating value.
wishlist Whether the product is bookmarked by users.
ads Advertising metadata attached to the product.
meta Warehouse, parent ID, and product visual metadata.

Example Output

[
    {
        "searchUrl": "https://www.tokopedia.com/search?st=&q=gift&srp_component_id=02.01.00.00&srp_page_id=&srp_page_title=&navsource=",
        "oldID": 100000290323,
        "id": "100000290323",
        "name": "MOSSDOOM Paperbag For Gift Kertas",
        "url": "https://www.tokopedia.com/mossdoom/mossdoom-paperbag-for-gift-kertas-1730264220216886630",
        "applink": "tokopedia://product/100000290323",
        "mediaURL": {
            "image": "https://images.tokopedia.net/img/cache/200-square/...jpeg",
            "image300": "https://images.tokopedia.net/img/cache/300-square/...jpeg",
            "videoCustom": ""
        },
        "shop": {
            "id": "14767008",
            "name": "MOSSDOOM",
            "city": "Jakarta Utara",
            "tier": 2
        },
        "badge": {
            "id": "4",
            "title": "Jakarta Utara"
        },
        "price": {
            "text": "Rp29.000",
            "number": 29000,
            "discountPercentage": 0
        },
        "labelGroups": [
            { "title": "10rb+ terjual" },
            { "title": "Bisa COD" }
        ],
        "category": {
            "id": "54",
            "name": "Perlengkapan Pesta"
        },
        "rating": "4.8",
        "wishlist": false
    }
]

Directory Structure Tree

Tokopedia Product Scraper πŸ›οΈ/
β”œβ”€β”€ src/
β”‚   β”œβ”€β”€ index.js
β”‚   β”œβ”€β”€ scraper/
β”‚   β”‚   β”œβ”€β”€ pageHandler.js
β”‚   β”‚   β”œβ”€β”€ productExtractor.js
β”‚   β”‚   └── proxyManager.js
β”‚   β”œβ”€β”€ utils/
β”‚   β”‚   β”œβ”€β”€ parser.js
β”‚   β”‚   └── formatters.js
β”‚   └── config/
β”‚       └── settings.example.json
β”œβ”€β”€ data/
β”‚   β”œβ”€β”€ sample-input.json
β”‚   └── sample-output.json
β”œβ”€β”€ package.json
β”œβ”€β”€ requirements.txt
└── README.md

Use Cases

  • E-commerce analysts use it to collect competitive product data, enabling better pricing decisions and category insights.
  • Market research firms use it to track trending items so they can predict buying behavior.
  • Automation developers integrate it to power dashboards, alerts, or analytical pipelines.
  • Online sellers use it to discover high-performance competitors and improve product listings.
  • Lead generation teams pull product and shop data to identify potential partnerships or outreach targets.

FAQs

Q1: Can it scrape unlimited products? It supports large datasets, but the maxItems parameter allows you to control scraping volume, preventing unnecessary resource usage.

Q2: Do I need proxies? Proxies are optional but recommended for long, high-volume sessions to improve reliability and reduce request failures.

Q3: Does it work with custom search filters? Yes. Any valid Tokopedia search URL can be used, including filtered searches by category, price, or popularity.

Q4: What formats can the output be exported to? JSON, JSONL, CSV, Excel, or HTML depending on how you choose to handle the extracted dataset.


Performance Benchmarks and Results

Primary Metric: Processes approximately 300–500 product entries per minute under standard browser settings.

Reliability Metric: Maintains a 96–99% successful extraction rate across large search result pages.

Efficiency Metric: Optimized browser sessions minimize resource consumption while sustaining high throughput.

Quality Metric: Consistently extracts 95%+ of expected product fields with accurate category, shop, and pricing information.

Book a Call Watch on YouTube

Review 1

"Bitbash is a top-tier automation partner, innovative, reliable, and dedicated to delivering real results every time."

Nathan Pennington
Marketer
β˜…β˜…β˜…β˜…β˜…

Review 2

"Bitbash delivers outstanding quality, speed, and professionalism, truly a team you can rely on."

Eliza
SEO Affiliate Expert
β˜…β˜…β˜…β˜…β˜…

Review 3

"Exceptional results, clear communication, and flawless delivery.
Bitbash nailed it."

Syed
Digital Strategist
β˜…β˜…β˜…β˜…β˜