Sr Data Engineer
External job listingat Sharp Decisions
Contract to Hire Hybrid · Phoenix, AZ W2 Only · No 3rd Parties Key Responsibilities Data Pipelines & ETL Design, develop, and maintain data pipelines and ETL/ELT processes from various so...
Salary
Not provided
Location
Scottsdale, United States
Employment type
Full time
Workplace
Not provided
Sr Data Engineer
Scottsdale, United States
Job description
Contract to Hire
Hybrid · Phoenix, AZ
W2 Only · No 3rd Parties
Key Responsibilities
Data Pipelines & ETL
Design, develop, and maintain data pipelines and ETL/ELT processes from various sources into the data warehouse. Deliver on-prem SQL Server reporting requirements using SSIS and integration processes. Implement batch and streaming ETL using Azure Data Factory, Spark, Python, and Scala on Databricks.
Azure & Cloud Infrastructure
Work with Azure Data Lake Storage, Azure SQL Databases, and Azure Data Factory. Implement Databricks Delta Lake, Medallion Architecture, and Unity Catalog. Optimize ingestion and transformation processes for efficient, scalable data flows.
Data Modeling & Quality
Develop and maintain data models, schemas, and data dictionaries. Perform data profiling, cleansing, validation, and quality checks. Monitor and optimize database performance including query tuning and index optimization.
Power BI & Reporting
Develop Power BI dashboards, reports, and visualizations. Implement data transformations, modeling, and integration processes in Power BI. Communicate data insights clearly to business stakeholders.
DevOps & Agile Delivery
Use Azure DevOps, GitHub, and Jenkins for build and deploy workflows. Deliver features incrementally on an Agile team using Jira and Confluence. Create and maintain technical documentation for databases, schemas, and reporting solutions.
Continuous Improvement
Stay current with industry trends in data engineering and Power BI. Proactively recommend and implement improvements to data infrastructure. Multi-task across priorities and adapt within a team environment.
Required & Preferred Skills
Required
Azure Data Factory Databricks Delta Lake Medallion Architecture Unity Catalog Python Scala Spark SQL Server SSIS Azure Data Lake Storage Azure SQL Power BI Data Warehousing ETL / ELT Azure DevOps GitHub Jenkins Jira / Confluence MS Office
Preferred
REST API / JSON Banking / Financial Domain Azure / GCP / AWS Cert. Java / JavaScript / C++ Docker / Kubernetes Bash / Shell Scripting Power Automate Power Apps Collibra Data Lineage Collibra Data Quality
Education
BS Computer Science BS Information Systems Equivalent Work Experience
Is this your job posting?
Claim it for free and receive video applications on CazVid.