Python Data Engineer

About the role

Shennovators Pvt Ltd is hiring experienced Python Data Engineer for an exciting opportunity with a leading banking and financial services client.

Tasks

• Design and maintain data pipelines using Python and PySpark.
• Build ETL/ELT processes for extraction, transformation, validation and loading.
• Work extensively with Oracle and SQL for data processing and reconciliation.
• Develop data models and transformations for large datasets.
• Optimize PySpark jobs, SQL queries, joins and partitioning.
• Implement data-quality checks, error handling and production support.
• Collaborate with application, database, QA and DevOps teams.

Requirements

• Strong Python and PySpark experience.
• Strong SQL and Oracle database experience.
• Experience with ETL/ELT, data pipelines and data modeling.
• Knowledge of Spark DataFrames, joins, transformations, partitioning, caching and optimization.
• Experience troubleshooting production data issues.
• Banking/financial-services experience preferred.
• All visa types considered; H-1B transfers supported, subject to eligibility and applicable requirements.
• Person must be available in US
• No C2C

Schedule

• Hybrid – 3 days in-office per week (Mandatory)

How to apply

• Share your updated resume or refer suitable profiles.

Location

• Dallas, TX
• New Jersey