Cross-Marketplace Price Arbitrage Scraper

Overview

A price-arbitrage pipeline across Amazon, eBay and several other retail sites. Scrapers pull the same products from each marketplace — titles, descriptions, product IDs, prices, condition and images — and the prices are then compared against each other rather than viewed one site at a time.

That cross-comparison is the point: where the same item sells materially cheaper on one marketplace than another, there is a buy-low, sell-high opportunity, and the report surfaces exactly those gaps so the client can act on them for profit. Runs land every four hours, so a gap is caught while it is still open.

Outcome

Turned six price checks a day across several marketplaces into a standing list of profitable buy-low / sell-high gaps, replacing manual price tracking entirely.

Architecture & Pipeline

  1. 01

    Scheduler (4 h)

    Recurring runs

  2. 02

    Amazon · eBay · Other Sites

    Source marketplaces

    • Amazon
    • Ebay
  3. 03

    Selenium Scrape

    Titles · IDs · prices · condition · images

    • Selenium
  4. 04

    Rotating Proxies

    Bot-detection handling

  5. 05

    Cross-Site Comparison

    Same product, every marketplace

  6. 06

    Arbitrage Opportunities

    Buy low here, sell higher there

  7. 07

    JSON / CSV / Excel

    Structured report

    • CSV
    • Excel
    • JSON
  8. 08

    Email / Drive Delivery

    Report out

End-to-end flow, in order. Scroll sideways on a narrow screen.

Key Features

  • Same products tracked across Amazon, eBay and several other retail sites
  • Prices compared marketplace against marketplace to surface buy-low / sell-high gaps
  • Arbitrage opportunities reported as the actionable output, not just raw prices
  • Multi-field extraction: titles, descriptions, product IDs, prices, condition
  • Image extraction with PNG/JPG export
  • Scheduled execution every four hours with full logging
  • Structured JSON, CSV and Excel output for downstream analytics
  • Web UI for adding and removing product IDs and triggering runs
  • Rotating proxies and request throttling to handle bot detection
  • Automatic delivery via Google Drive and email
  • Deployed on an Ubuntu server for reliability