Senior data engineer

Requisitos

• Degree in Computer Science, Software Engineering or related field
• Good programming skills in Python (requests, httpx, asyncio) or Node.js (axios, puppeteer, crawlee)
• Experience developing web scrapers/crawlers via API and HTML parsing
• Familiarity with inspecting network calls (Developer Tools / Network) for API analysis and reverse engineering
• Advanced SQL knowledge for data modeling and analysis

Desejáveis

• Hands-on experience with browser automation (Playwright, Selenium or similar)
• Experience with proxy rotation, rate-limit bypass and anti-blocking strategies
• Experience with advanced scraping tools (Scrapy, Crawlee, etc.)
• Experience reverse-engineering private APIs and deep network call analysis
• Experience maintaining and operating crawlers in production