C
Data Engineer – Data Platforms (Databricks)
External job listingat Confidential
Data Engineer – Data Platforms (Databricks) in Atlanta, GA. Contract for 8–12 months. Share your updated resume by email.
External source - not verified5 weeks agoOpen until: Jan 14, 2027
Salary
Not provided
Location
Atlanta, United States
Employment type
Full time
Workplace
Not provided
Data Engineer – Data Platforms (Databricks)
Atlanta, United States
Job description
Tasks
- Design and develop scalable data pipelines using Databricks and Apache Spark.
- Implement Lakehouse and Medallion Architecture (Bronze, Silver, and Gold).
- Develop ETL/ELT workflows and batch and streaming data processing solutions.
- Work with PySpark, Databricks SQL, Delta Lake, and Delta Live Tables (DLT).
- Implement data integration using APIs, JSON, and cloud-based services.
- Optimize data pipelines for performance, scalability, and reliability.
- Ensure data quality, validation, and governance using Unity Catalog.
- Collaborate with cross-functional teams to implement Data and AI use cases.
Requirements
- Strong experience in Databricks and Data Engineering
- Expertise in Apache Spark, PySpark, SQL, and Delta Lake.
- Hands-on experience with Databricks Lakehouse and Medallion Architecture.
- Experience with Databricks Workflows, Jobs, Notebooks, and Unity Catalog.
- Knowledge of ETL/ELT, data pipelines, batch processing, and Structured Streaming.
- Experience with Azure, AWS, or GCP cloud platforms.
- Familiarity with Git, data modeling, data warehousing, and performance tuning.
Schedule
- Duration: 8–12 Months
- Contract
How to apply
- Share your updated resume by email.
Location
- Atlanta, GA