Data Engineer – Databricks

External job listingat Tpillars

Tasks Design, develop, and maintain scalable data pipelines using Databricks Build production-ready ETL/ELT pipelines using Spark and PySpark Create, manage, and optimize Delta tables Dev...

External source - not verified5 days agoOpen until: Feb 16, 2027

Salary

Not provided

CazVid estimate: $50 to $81 an hour. Not set by the employer.

Location

Los Angeles, United States

Employment type

Full time

Workplace

Not provided

Data Engineer – Databricks

Los Angeles, United States

Job description

Tasks

  • Design, develop, and maintain scalable data pipelines using Databricks
  • Build production-ready ETL/ELT pipelines using Spark and PySpark
  • Create, manage, and optimize Delta tables
  • Develop and schedule Databricks Jobs and Workflows
  • Optimize Spark jobs for performance, scalability, and cost efficiency
  • Implement data validation, error handling, and quality checks
  • Monitor production pipelines and resolve data processing issues
  • Collaborate with data architects, analysts, and engineering teams

Requirements

  • 7+ Years
  • Hands-on Databricks Production Experience
  • Apache Spark and PySpark
  • Delta Lake and Delta Tables
  • Databricks Jobs and Workflows
  • ETL/ELT Pipeline Development
  • Data Ingestion and Transformation
  • SQL and Data Processing
  • Production Pipeline Monitoring and Troubleshooting
  • 7+ years of overall IT experience
  • Proven hands-on experience building and deploying pipelines on Databricks
  • Production experience with Spark/PySpark and Delta Lake
  • Experience developing and managing Databricks Jobs and Workflows
  • Strong pipeline troubleshooting and performance optimization skills
  • Candidates with general Apache Spark experience but without hands-on Databricks production experience will not be considered.

How to apply

  • Share your updated resume by email

Location

  • Los Angeles / Irvine, CA, USA

Similar jobs