Data Engineer Lead
Aviso de fuente externaen ScotiaTech
ScotiaTech seeks a Data Engineer Lead to build Azure and Databricks data solutions, lead Data Engineers, and support International Banking.
Salario
No especificado
Ubicación
Bogotá, Colombia
Tipo de empleo
Tiempo completo
Modalidad
No especificado
Data Engineer Lead
Bogotá, Colombia
Descripción del empleo
About the role
ScotiaTech is seeking a Data Engineer Lead to modernize bank technology by delivering trustworthy, unique, and top-quality service. The role supports scalable data products for International Banking using Azure and Azure Databricks.
Responsibilities
- Design, build, test, and optimize data pipelines and lakehouse solutions using Delta Lake and medallion architecture.
- Lead assigned initiatives hands-on, owning end-to-end solution design, technical documentation, and production-grade code delivery.
- Lead, mentor, and develop Data Engineers through work assignment, coaching, performance feedback, and participation in hiring.
- Lead code and design reviews and promote engineering excellence, collaboration, and continuous improvement.
- Provide effort estimates, technical risks, and dependencies for delivery planning; allocate team work and keep the Director informed of progress and blockers.
- Collaborate with Data Scientists, Product Owners, Architecture, Platform Engineering, and Software Engineering to translate business requirements into data products aligned with international business goals.
Requirements
- 5+ years of progressive hands-on experience in data engineering, including at least 3 years delivering production data solutions on Microsoft Azure and/or Azure Databricks.
- Experience leading complex data initiatives, design and code reviews, and directly supervising, coaching, and developing Data Engineers.
- Expertise in data pipelines using Azure Databricks, including Spark, Delta Lake, Unity Catalog, and Workflows; Azure Data Factory; and Azure Data Lake Storage.
Datos clave
- Design and optimize Azure and Azure Databricks data pipelines and lakehouse solutions.
- Requires 5+ years of data engineering experience, including at least 3 years delivering production data solutions on Azure and/or Azure Databricks.
- The role includes leading, mentoring, and developing Data Engineers.
Preguntas frecuentes
What does the Data Engineer Lead do?
The role designs and optimizes data pipelines and lakehouse solutions on Azure and Azure Databricks. It also leads assigned initiatives and develops a team of Data Engineers.
What experience and technical expertise are required?
The listing requires 5+ years of progressive hands-on data engineering experience, including at least 3 years delivering production data solutions on Microsoft Azure and/or Azure Databricks. It also calls for expertise in Azure Databricks, Azure Data Factory, and Azure Data Lake Storage.
What leadership responsibilities does the role include?
The role includes assigning work, coaching, providing performance feedback, and participating in hiring. It also leads code and design reviews and keeps the Director informed of progress and blockers.