Senior Data Engineer

Senior Databricks Data Engineer - (Central America Only)
CompanySGS Analytics provides nearshore engineering and consulting services in cloud, data, software development, and AI. We work with clients across fintech, SaaS, e-commerce, and healthtech.
RoleWe are looking for a Senior Databricks Data Engineer to build and maintain production data pipelines using Databricks, Apache Spark, PySpark, SQL, and Delta Lake.This is a remote, contract role working directly with client engineering, analytics, and data teams.
ResponsibilitiesBuild and maintain batch and streaming pipelines in Databricks.Develop data transformations using PySpark and Spark SQL.Design and manage Delta tables.Implement incremental loads, CDC, and ETL/ELT processes.Optimize Spark jobs, SQL queries, clusters, and storage layouts.Troubleshoot pipeline failures, data quality issues, and performance problems.Implement monitoring, testing, logging, and documentation.Support datasets used by BI, analytics, applications, and machine learning.Apply Databricks governance and security practices, including Unity Catalog where applicable.
RequirementsDatabricks Certified Data Engineer Associate certification is required.Strong production experience with Databricks.Strong knowledge of Apache Spark, PySpark, and Spark SQL.Advanced SQL and Python skills.Experience with Delta Lake, including MERGE, schema evolution, partitioning, and table maintenance.Experience building scalable ETL or ELT pipelines.Understanding of Spark concepts such as partitioning, shuffles, skew, caching, and parallelism.Experience with Azure, AWS, or GCP and cloud object storage.Experience with data modeling and lakehouse or data warehouse architectures.Familiarity with Git, CI/CD, testing, and production support.Strong English communication skills and ability to work independently.
PreferredExperience with Unity Catalog, Auto Loader, Structured Streaming, Databricks SQL, or Databricks Workflows.Experience with Power BI, Tableau, dbt, Airflow, Kafka, or Azure Data Factory.Experience optimizing Databricks performance and cloud costs.