Experienced in Python, with knowledge of Scrapy framework
Maintaining the running web crawlers full-stack application
Design, build web crawlers to scrape data and URLs.
Integrate the data crawled and scraped into our databases
Create more/better ways to crawl relevant information
Strong knowledge of web technologies (HTML, CSS, Javascript, XPath, Regex)
Understanding of data privacy policies (esp. GDPR) and personally identifiable information