Senior Data Engineer – Data Platform & Web Scraping

Requisitos

• Experience building production data platforms from zero to one, owning architecture, implementation, deployment, and operations
• Production experience with workflow orchestration tools such as Airflow, Dagster, Prefect, or Temporal (Airflow preferred)
• Hands-on production experience with dbt and Google Cloud Platform (GCP)
• Experience building event-driven systems using messaging or task queues, including asynchronous processing and failure recovery
• Strong Python skills, including asynchronous HTTP requests and concurrent processing (asyncio, aiohttp, or HTTPX)

Desejáveis

• Experience working in startups or small engineering teams, with strong ownership and adaptability
• Entity resolution experience, matching company and people records across multiple sources and reconciling duplicates
• Experience with LLM-based structured extraction or company and people data enrichment
• Familiarity with BigQuery and Dataform