S
Databricks Engineer
External job listingat Smartinfosolutions
Databricks Engineer in Chicago. Only on w2. Requires 10-12years of experience. Apply by email.
External source - not verified4 days agoOpen until: Feb 3, 2027
Salary
Not provided
Location
Chicago, United States
Employment type
Full time
Workplace
Not provided
Databricks Engineer
Chicago, United States
Job description
Tasks
- Design, develop, and maintain scalable data pipelines using Databricks.
- Work with Apache Spark, PySpark, and Spark SQL for large-scale data processing.
- Develop ETL/ELT workflows and optimize data transformation processes.
- Implement data lakehouse architecture using Delta Lake.
- Work with Databricks Workflows, Unity Catalog, and Delta Live Tables.
- Integrate data from multiple sources into cloud-based data platforms.
- Optimize Spark jobs and troubleshoot performance issues.
- Collaborate with data architects, analysts, and business teams.
Requirements
- Experience: 10-12years
- 12 years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Expertise in PySpark, Python, and Spark SQL.
- Experience with Delta Lake and Lakehouse Architecture.
- Knowledge of Azure Databricks / AWS Databricks.
- Experience with ETL/ELT pipelines and data warehousing.
- Good understanding of SQL, data modelling, and data integration.
- Experience with Git, CI/CD, and data pipeline orchestration.
Schedule
- Only on w2
How to apply
- Share your updated resume by email.
Location
- Chicago,IL