Senior/Lead Data Engineer – Data Ingestion

External job listingat Jconnectinc

Tasks Architect and develop a modular, configuration-driven data ingestion framework in Python (full, incremental, and CDC patterns). Build reusable connectors for heterogeneous sources (...

External source - not verified15 hours agoOpen until: Feb 17, 2027

Salary

Not provided

Location

Boston, United States

Employment type

Full time

Workplace

Not provided

Senior/Lead Data Engineer – Data Ingestion

Boston, United States

Job description

Tasks

  • Architect and develop a modular, configuration-driven data ingestion framework in Python (full, incremental, and CDC patterns).
  • Build reusable connectors for heterogeneous sources (SQL Server, Oracle, PostgreSQL, REST APIs, SFTP, AWS S3).
  • Design lakehouse ingestion patterns on AWS S3 and build scalable transformations, macros, and tests in dbt for Snowflake.
  • Implement workflow orchestration using Dagster or Apache Airflow.
  • Partner with onshore architects and mentor offshore engineering teams on coding standards and best practices.

Requirements

  • 10–12+ years of experience
  • Must be a strong, hands-on Python coder with deep experience building reusable ingestion frameworks, custom connectors, and production-grade libraries.
  • Expert-level Python (OOP, reusable libraries, APIs, performance optimization)
  • Strong hands-on dbt (Core or Cloud) & Advanced SQL
  • Proven experience building enterprise data ingestion frameworks
  • Deep experience with Snowflake (Snowpipe, stages, tuning) & AWS S3
  • Bonus Points: Dagster, Apache Airflow, Apache Iceberg, and SnapLogic/ETL migration experience.

Schedule

  • Contract
  • Hybrid

How to apply

  • Send your resume by email

Location

  • Boston, MA

Similar jobs