T
Data Engineer – Databricks
External job listingat Tpillars
Tasks Design, develop, and maintain scalable data pipelines using Databricks Build production-ready ETL/ELT pipelines using Spark and PySpark Create, manage, and optimize Delta tables Dev...
External source - not verified5 days agoOpen until: Feb 16, 2027
Salary
Not provided
CazVid estimate: $50 to $81 an hour. Not set by the employer.
Location
Los Angeles, United States
Employment type
Full time
Workplace
Not provided
Data Engineer – Databricks
Los Angeles, United States
Job description
Tasks
- Design, develop, and maintain scalable data pipelines using Databricks
- Build production-ready ETL/ELT pipelines using Spark and PySpark
- Create, manage, and optimize Delta tables
- Develop and schedule Databricks Jobs and Workflows
- Optimize Spark jobs for performance, scalability, and cost efficiency
- Implement data validation, error handling, and quality checks
- Monitor production pipelines and resolve data processing issues
- Collaborate with data architects, analysts, and engineering teams
Requirements
- 7+ Years
- Hands-on Databricks Production Experience
- Apache Spark and PySpark
- Delta Lake and Delta Tables
- Databricks Jobs and Workflows
- ETL/ELT Pipeline Development
- Data Ingestion and Transformation
- SQL and Data Processing
- Production Pipeline Monitoring and Troubleshooting
- 7+ years of overall IT experience
- Proven hands-on experience building and deploying pipelines on Databricks
- Production experience with Spark/PySpark and Delta Lake
- Experience developing and managing Databricks Jobs and Workflows
- Strong pipeline troubleshooting and performance optimization skills
- Candidates with general Apache Spark experience but without hands-on Databricks production experience will not be considered.
How to apply
- Share your updated resume by email
Location
- Los Angeles / Irvine, CA, USA