J
Senior/Lead Data Engineer – Data Ingestion
External job listingat Jconnectinc
Tasks Architect and develop a modular, configuration-driven data ingestion framework in Python (full, incremental, and CDC patterns). Build reusable connectors for heterogeneous sources (...
External source - not verified15 hours agoOpen until: Feb 17, 2027
Salary
Not provided
Location
Boston, United States
Employment type
Full time
Workplace
Not provided
Senior/Lead Data Engineer – Data Ingestion
Boston, United States
Job description
Tasks
- Architect and develop a modular, configuration-driven data ingestion framework in Python (full, incremental, and CDC patterns).
- Build reusable connectors for heterogeneous sources (SQL Server, Oracle, PostgreSQL, REST APIs, SFTP, AWS S3).
- Design lakehouse ingestion patterns on AWS S3 and build scalable transformations, macros, and tests in dbt for Snowflake.
- Implement workflow orchestration using Dagster or Apache Airflow.
- Partner with onshore architects and mentor offshore engineering teams on coding standards and best practices.
Requirements
- 10–12+ years of experience
- Must be a strong, hands-on Python coder with deep experience building reusable ingestion frameworks, custom connectors, and production-grade libraries.
- Expert-level Python (OOP, reusable libraries, APIs, performance optimization)
- Strong hands-on dbt (Core or Cloud) & Advanced SQL
- Proven experience building enterprise data ingestion frameworks
- Deep experience with Snowflake (Snowpipe, stages, tuning) & AWS S3
- Bonus Points: Dagster, Apache Airflow, Apache Iceberg, and SnapLogic/ETL migration experience.
Schedule
- Contract
- Hybrid
How to apply
- Send your resume by email
Location
- Boston, MA