Hello, How are you?I am a senior Web crawling expert with 5+ years of experience. Most of my works related to the sport.
Let me explain my previous work here
https://dailyfantasynerd.com/
This platform provides you the best sports team lineup, so you can choose the best one according to your condition. This platform bases on crawling data from several sites such as fantasycruncher, awesemo and rotogrinders.
Technical flow to implement is like this
Scrapy -> scrapinghub => cloud mongo -> celery(standardize bot) -> postgresql
We deploy scrapy to scrapinghub and crawled data is saving to cloud mongoAdditionally,
I have experience crawling data from eCommerce sites such as lazada.
For more detail, discuss over the interview.
Thanks