eBay Price Comparison Scraper
Overview
A Python scraper that pulls product listings from eBay (titles, descriptions, IDs, prices, conditions) and benchmarks them against client-supplied competitor prices. The script runs every four hours and produces a comparison spreadsheet that is shared automatically with the client. Outcome: Gave the client a continuously refreshed view of competitive pricing across eBay and partner sites without any manual collection effort.
Architecture & Pipeline
flowchart LR
n0["Scheduler (4 h)Recurring runs"]
n1["eBaySource listings"]
n2["Selenium ScrapeMulti-field extraction"]
n3["Compare PricesVs client sources"]
n4["CSV / ExcelComparison sheet"]
n5["Email / Drive DeliveryClient report"]
n0 --> n1
n1 --> n2
n2 --> n3
n3 --> n4
n4 --> n5
classDef step0 fill:#f1f5f9,stroke:#64748b,color:#1e293b,stroke-width:2px,rx:10,ry:10;
classDef step1 fill:#ecfeff,stroke:#06b6d4,color:#1e293b,stroke-width:2px,rx:10,ry:10;
classDef step2 fill:#f0fdfa,stroke:#0d9488,color:#1e293b,stroke-width:2px,rx:10,ry:10;
classDef step3 fill:#ecfdf5,stroke:#10b981,color:#1e293b,stroke-width:2px,rx:10,ry:10;
classDef step4 fill:#fffbeb,stroke:#f59e0b,color:#1e293b,stroke-width:2px,rx:10,ry:10;
class n0 step0;
class n1 step1;
class n2 step2;
class n3 step2;
class n4 step3;
class n5 step4;
End-to-end flow derived from this project's scope and tech stack. Tap View Fullscreen for a larger view, or scroll horizontally on small screens.
Key Features
- Multi-field extraction across product categories
- Side-by-side price comparison against external sources
- Scheduled four-hour runs with delivery via email and Google Drive
- Structured CSV/Excel output for analytics teams
- Anti-bot handling with rotating proxies and request throttling
- Tech Stack:** Python, Selenium, BeautifulSoup, Pandas, Linux