OmniScraper - E-Commerce Price & Review Scrape

Stop Wasting 15+ Hours Reading Competitor Reviews One by One.

Turn competitor complaints into your unfair product advantage in 3 clicks.

Every top-selling e-commerce merchant knows the secret to outranking competitors: Find what customers hate about their products, fix it in your own catalog, and win their market share.

OmniScraper is the first dual-engine competitor intelligence tool built specifically for e-commerce operators, dropshippers, and software engineers. Extract product reviews, pricing tiers, and stock volumes in seconds—then automatically categorize every 1–3 star complaint using an automated 6-Cluster NLP Defect Analyzer.

Dual-Engine Architecture: Two Production Tools in One Package

1. Chrome Extension (Manifest V3 Pro): A sleek, zero-bloat browser popup for store managers and non-technical teams. Just open any product page on Shopee, Tokopedia, TikTok Shop, or Amazon, click the OmniScraper icon, and download a styled Excel report in under 5 seconds.
2. Standalone Python Core Engine (CLI & Headless): A multi-threaded Python 3 scraper built for developers and data teams. Feed it a list of competitor URLs, set polite crawling jitter, and let it export structured datasets in headless background cronjobs.

Inside the 6-Cluster Defect & Complaint Analyzer

• 📦 Packaging & Transit Damage: Detects squashed cartons, leaking bottles, and broken seals.
• ⚠️ Item Defect & Dead On Arrival (DOA): Identifies non-functioning electronics, snapped hinges, and missing accessories.
• 📏 Inaccurate Sizing & Wrong Variant: Catches misleading size charts and wrong variant fulfillment.
• 🛑 Counterfeit & Authenticity Concerns: Flags customer complaints of fake products or sub-par materials.
• ⏱️ Logistics & Courier Delays: Highlights transit bottlenecks and sluggish delivery providers.
• 💬 Poor Customer Service: Isolates unresponsive seller chats, rejected return requests, and unhonored warranties.

Supported Marketplaces & Stores

• 🛒 Shopee: Indonesia, Malaysia, Singapore, Philippines, Thailand, Vietnam, Taiwan
• 🏬 Tokopedia: Official Store, Power Merchant Pro, Regular Merchant
• 📦 Amazon: Amazon.com, Amazon.co.uk, Amazon.de, Amazon.co.jp
• 📱 TikTok Shop & Lazada: Dynamic DOM review extraction
• 🌐 Universal Schema.org: Fallback parser for standard e-commerce metadata

What's Included in the Package:

• Full unminified Chrome Extension (Manifest V3) source code
• Standalone Python Core CLI scraper with polite jitter & UA rotation
• Offline HTML User & Developer Manual with searchable guides
• Automated test suite with 9/9 unit tests passing
• Commercial license documentation & third-party notices

Try It Before You Buy — Interactive Demo

Preview the exact Chrome extension popup, the 6-Cluster Defect Analyzer output, and real sample reports (Excel, CSV, JSON) on the official live demo page — open the Live Demo button on this item. No install needed.

Quickstart — From Zero to Competitor Report in 3 Minutes

1. Chrome Extension: open chrome://extensions → enable Developer mode → Load unpacked → select the omniscraper-chrome-extension folder.
2. Python Core: cd omniscraper-python-core → pip install -r requirements.txt → python scraper.py --test (verifies 9/9 tests pass).
3. First scrape: python scraper.py --url "https://shopee.co.id/product/..." --limit 200 --format xlsx
4. Read the report: open the styled .xlsx and check the Defect Summary sheet for the top 6 complaint clusters.

Full step-by-step instructions — CLI reference, Python API, troubleshooting — are included in the offline Quickstart Guide (PDF + HTML) and the searchable manual inside the package.

Technical Specifications

• Chrome Extension: Manifest V3 (Chrome 102+ on Windows 10/11, macOS 11+, Linux) — zero eval(), zero inline JS, strict CSP compliant.
• Python Core Engine: Python 3.10, 3.11, 3.12, or 3.13 (64-bit) — multi-threaded CLI with polite crawl jitter.
• Python Dependencies: requests, beautifulsoup4, openpyxl (all pinned in requirements.txt).
• Data Outputs: Styled Microsoft Excel (.xlsx), UTF-8 BOM CSV, and REST JSON — ready for Excel, Google Sheets, or BI tools.
• Resource Footprint: <15 MB disk, <80 MB RAM — no headless browser (Selenium/Puppeteer) required.
• Compatibility: Windows, macOS, and Linux. No server or database needed — runs 100% locally.

License — Regular vs Extended

• Regular License: Use by you or one client in a single end product which end users are not charged for. Covers internal tools, personal projects, and one commercial storefront you operate yourself.
• Extended License: Use in a single end product which end users can be charged for (e.g. a paid SaaS, a client-facing product, or a resold service).
• Not permitted: Redistribution, resale, or sub-licensing of the source code itself, in whole or in part, on any marketplace.
• Full license text is included in the package under licensing/LICENSE.txt. Third-party component notices are in licensing/THIRD-PARTY-NOTICES.txt.

Changelog

Version 1.0.1 — 2026-09-30

• Packaging cleanup: buyer package no longer references other marketplaces; all documentation, license, and manifest now point exclusively to this Codester item page.
• verify_release.py is now fully portable (relative paths) — runs on any machine.
• LICENSE.txt now documents Regular and Extended licence tiers explicitly.
• README.txt documents the optional self-verification step.

Version 1.0.0 — 2026-09-21

• First public release: dual-engine architecture (Chrome MV3 + Python Core CLI).
• 6-Cluster NLP defect analyzer, multi-format export (XLSX/CSV/JSON), 9/9 unit tests passing.

Frequently Asked Questions

Q: Do I need coding skills to use OmniScraper? No. The Chrome Extension works with a single click — open a product page, click the icon, export. The Python Core engine is for developers who want headless batch crawling.

Q: Does it work on my local marketplace? Out of the box: Shopee (ID/MY/SG/PH/TH/VN/TW), Tokopedia, Lazada, TikTok Shop, and Amazon (US/UK/DE/JP), plus a universal Schema.org fallback for most standard e-commerce stores.

Q: Is my data sent to any server? No. Everything runs locally in your browser and on your machine. No external servers, no telemetry, no account required.

Q: How do I get support or updates? Contact the author via this item page. Future updates are free for buyers — the changelog above tracks every release.

Q: What if I hit a bug? Report it through the item page. Bug-fix hotfixes are shipped within 24 hours to keep the product production-ready.

Features

• Dual-Engine Architecture: 1-Click Chrome MV3 Extension + Headless Python Core CLI
• Smart Negative Review Filter (1-3★) with automated complaint isolation
• 6-Cluster NLP Defect Categorizer (Packaging, Defects, Sizing, Authenticity, Shipping, Support)
• Multi-Format Export: Styled Microsoft Excel (.xlsx), UTF-8 BOM CSV, and REST JSON
• Multi-Marketplace Support: Shopee (7 regions), Tokopedia, Amazon (US/UK/DE/JP), TikTok Shop
• Polite Anti-Blocking Engine: Randomized jitter (1.5s - 4.5s) & desktop User-Agent rotation
• Strict Google Chrome MV3 & CSP Compliance: Zero eval(), zero remote code injection
• Full unminified source code included with offline HTML documentation
• Automated unit test suite (9/9 checks verified)

Requirements

• Google Chrome version 102+ (Windows 10/11, macOS 11+, Linux) for Chrome Extension
• Python 3.10, 3.11, 3.12, or 3.13 for Python Core Engine
• Python packages: requests, beautifulsoup4, openpyxl (pinned in requirements.txt)
• No headless browser (Selenium/Puppeteer) required — ultra-lightweight footprint (<15 MB disk, <80 MB RAM)

Instructions

1. Unpack the download: Extract the ZIP you downloaded. It contains the folder omniscraper-pro-package/ holding omniscraper-chrome-extension.zip, omniscraper-python-core.zip, README.txt, changelog.txt and the offline documentation/ folder.
2. Chrome Extension install: Unzip omniscraper-chrome-extension.zip, open chrome://extensions, enable "Developer mode" (top right), click "Load unpacked" and select the extracted omniscraper-chrome-extension folder.
3. Using the Chrome Extension: Open any product page on Shopee, Tokopedia, Amazon, Lazada or TikTok Shop. Click the OmniScraper icon, choose your review and price filters, then click "Export Excel (.XLSX)".
4. Python Core CLI setup: Unzip omniscraper-python-core.zip, open a terminal inside that folder and run pip install -r requirements.txt.
5. Running the Python engine: Run python scraper.py --test to execute the bundled test suite, or python scraper.py --mock --limit 100 --format xlsx,csv for an offline demo run with no network access, or python scraper.py --urls-file competitor_urls.txt --filter-defects for bulk batch crawling.
6. Offline manual: Open documentation/index.html in any browser for the full setup guide, configuration options, CLI reference and FAQ.