Web Scraping Data Engineer

Design, build web crawlers to scrape data and URLs. Integrate the data crawled and scraped into our databases Create more/better ways to crawl relevant information Strong knowledge of web technologies (HTML, CSS, Javascript, XPath, Regex) Understanding of data privacy policies (esp. GDPR) and personally identifiable information Develop automated and reusable routines for extracting information from various data sources Prepare requirement summary and re-confirm with Operation team Translate bus…