Web Scraping (4328397) - Freelancer on Guru

Programming & Development

Web Scraping

$25/hr Starting at $100

I have 6 years experience with Scraping using Python Scrapy Framework, Selenium and BeautifulSoup. I have developed lots of spiders for extracting the data from the websites and made them output as CSV, JSON and Excel SpreadSheet. And also I have stored in database such as MySQL, PostgreSQL and so on. Especially, I have crawled the websites such as target, amazon, walmart and etc. In addition to, I have solved captcha issue, bot detection, ip blocking, response header proven issue and familiar to javascript response and request. I have implemented daily crawling so when the site is updated then the scraped data is updated automatically. And I have implemented spider via cron job and managed the job on queueing job. In addition to, I have good experience with scrapy cloud and portia on ScrapingHub.

About

$25/hr Ongoing

Download Resume

I have 6 years experience with Scraping using Python Scrapy Framework, Selenium and BeautifulSoup. I have developed lots of spiders for extracting the data from the websites and made them output as CSV, JSON and Excel SpreadSheet. And also I have stored in database such as MySQL, PostgreSQL and so on. Especially, I have crawled the websites such as target, amazon, walmart and etc. In addition to, I have solved captcha issue, bot detection, ip blocking, response header proven issue and familiar to javascript response and request. I have implemented daily crawling so when the site is updated then the scraped data is updated automatically. And I have implemented spider via cron job and managed the job on queueing job. In addition to, I have good experience with scrapy cloud and portia on ScrapingHub.

Skills & Expertise

Amazon AWSBotCAPTCHACloud ComputingCronCSV (Comma Separated Values)Data ManagementDatabase DevelopmentFramework DesignHeader DesignJavaScriptJSONMicrosoft ExcelMySQLPostgreSQLPythonScrapy FrameworkSeleniumSpreadsheetsWeb CrawlingWeb DesignWeb DevelopmentWeb Scraping

3 Reviews

Guy 84 says,

Excellent performance as usual.

for AWS code/db deployment and maintenance on Dec 01, 2018
Guy 84 says,

Excellent programmer. Available day and night for work which provides me the flexibility I need when working in a different time zone.

for AWS code/db deployment and maintenance on Nov 12, 2018
Guy 84 says,

Very knowledgeable and helpful guru.

for AWS code/db deployment and maintenance on Nov 12, 2018