Web Data Extraction Engineer (Scraping & Automation)

External job listingat unosquare

About the Role We’re looking for a Web Data Extraction Engineer to build and maintain reliable, scalable web crawlers and scrapers for our clients in the tech i

External source - not verified17 hours agoOpen until: Dec 6, 2026

Salary

Not provided

Location

Remote

Employment type

Full time

Workplace

Remote

Web Data Extraction Engineer (Scraping & Automation)

Remote

Job description

About the Role We’re looking for a Web Data Extraction Engineer to build and maintain reliable, scalable web crawlers and scrapers for our clients in the tech industry. You’ll design extraction pipelines, handle dynamic and JavaScript-heavy sites, and keep data flowing as target sites change. All of this is done responsibly and in line with site terms and applicable law.What You’ll DoBuild and maintain crawlers and scrapers for static and dynamic (JavaScript-rendered) websites.Extract and normalize data from HTML and the DOM, and from APIs found through network inspection.Automate browser workflows with Playwright, Puppeteer or Selenium in headless environments.Manage proxy rotation, sessions, cookies, headers and request throttling.Handle anti-bot measures (rate limiting, fingerprinting, CAPTCHA challenges) responsibly and in line with site terms and applicable law.Monitor scrapers, spot breakages when sites change, and fix them quickly.Write clean, tested, maintainable code and document data sources and logic.Required Qualifications3+ years in software engineering, test automation or data extraction.A strong understanding of HTTP: methods, headers, status codes, cookies, sessions and authentication.Solid HTML/CSS/DOM knowledge: XPath, CSS selectors and parsing strategies.Hands-on experience with Playwright and/or Selenium, including headless browsers.Proficiency in Python (Scrapy, BeautifulSoup, httpx/requests) or Node.js.Experience with proxies (residential/datacenter, rotation) and browser dev tools for network inspection.Professional English for direct client communication.Preferred QualificationsDistributed crawling (queues, Scrapy Cluster, Celery, Kafka).Docker and cloud deployment (AWS/GCP).Data storage and pipelines (Postgres, MongoDB, S3).Familiarity with browser fingerprinting and stealth techniques.Awareness of scraping compliance (robots.txt, ToS, GDPR/CCPA).Technical Environment Python · Scrapy · BeautifulSoup · httpx / requests · Node.js · Playwright · Puppeteer · Selenium · HTML / CSS / DOM · XPath · JavaScript · Proxies · Celery · Kafka · Docker · AWS / GCP · Postgres · MongoDB · S3Core Competencies Problem solving · Attention to detail · Fast troubleshooting · Responsible, compliance-aware engineering · Clear client communication · Clean, documented codeWhy Join Us At Unosquare you’ll own data pipelines that clients depend on and solve a new technical puzzle every time a site changes, working with modern automation and crawling tools in a collaborative engineering team.

Similar jobs