Senior/Lead Data Engineer

Tasks

• Design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies.
• Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions.
• Design and implement data warehousing solutions, ensuring scalability, performance, and reliability.
• Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform.
• Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development.

Requirements

• Minimum 10+ years of overall experience in IT Industry.
• 8+ years of experience in data engineering, with a strong background in building large-scale data solutions.
• 4+ years of hands-on experience developing and implementing data pipelines using Azure stack experience (Azure, ADF, Databricks, Functions)
• 1-2 years of experience in Microsoft Fabric
• Proven expertise in SQL for querying, manipulating, and analyzing large datasets.
• Strong knowledge of ETL processes and data warehousing fundamentals.
• Self-motivated and independent, with a “let’s get this done” mindset and the ability to thrive in a fast-paced and dynamic environment.
• Databricks Certification is a plus.
• Data Modeling, Azure Architect Certification

Schedule

• Contract – 12 Months
• Remote with travel to San Francisco Bay Area in the 1st week of every month for 3 Days

How to apply

• Email your resume.