Web Scraping & High Scale eCommerce

A predictive analytics company wanted to do web scraping to aggregate fashion product data from hundreds of popular e-commerce stores in the US, and create an aggregator platform enabling consumers to stay on top of trends & buy from stores that offer competitive discounts. The client wanted customized software developed (scrapers written for various sources) that can perform at a high scale (involving hundreds of crores of products), get data in a secure way, clean the data and organize it for the platform to predict future trends.

User personas:
Fashion eCommerce buyers, sellers, platform admins

User journeys:

Highlights:
Python, Predictive modeling, Data analytics

Client

Project Date

Tags