Data Engineer
Aviso de fuente externaen ScotiaTech
ScotiaTech seeks a Data Engineer to build Azure and Azure Databricks data pipelines and lakehouse solutions, and lead engineering initiatives.
Salario
No especificado
Ubicación
Bogotá, Colombia
Tipo de empleo
Tiempo completo
Modalidad
No especificado
Data Engineer
Bogotá, Colombia
Descripción del empleo
About the role
ScotiaTech is seeking a Data Engineer to modernize bank technology and deliver data products for International Banking. The role focuses on scalable data pipelines and lakehouse solutions on Azure and Azure Databricks.
Responsibilities
- Design, build, test, and optimize data pipelines and lakehouse solutions using Azure and Azure Databricks, including Delta Lake and medallion architecture.
- Lead assigned initiatives hands-on, owning solution design, technical documentation, and production-grade code.
- Lead, mentor, and develop Data Engineers through work assignment, coaching, performance feedback, and participation in hiring.
- Lead code and design reviews and promote engineering excellence, collaboration, and continuous improvement.
- Provide effort estimates, technical risks, and dependencies; allocate team work and keep the Director informed of progress and blockers.
- Collaborate with Data Scientists, Product Owners, Architecture, Platform Engineering, and Software Engineering to translate business requirements into data products aligned with international business goals.
Requirements
- 2+ years of progressive hands-on experience in data engineering, including at least 3 years delivering production data solutions on Microsoft Azure and/or Azure Databricks.
- Experience as a technical lead on complex data initiatives, including leading design and code reviews and directly supervising, coaching, and developing data engineers.
- Expertise designing and implementing data pipelines using Azure Databricks, including Spark, Delta Lake, Unity Catalog, and Workflows; Azure Data Factory; Azure Data Lake Storage Gen2; and Event...
Datos clave
- The role involves data pipelines and lakehouse solutions on Azure and Azure Databricks.
- The work supports scalable data products for International Banking.
- Requires hands-on data engineering experience and production data solutions on Microsoft Azure and/or Azure Databricks.
- The role includes leading, mentoring, and developing Data Engineers.
Preguntas frecuentes
What does the Data Engineer role involve?
It involves designing, building, testing, and optimizing data pipelines and lakehouse solutions on Azure and Azure Databricks for International Banking.
What experience is required?
The source specifies 2+ years of progressive hands-on data engineering experience, including at least 3 years delivering production data solutions on Microsoft Azure and/or Azure Databricks.
What team leadership responsibilities are included?
The role includes leading, mentoring, and developing Data Engineers, as well as leading code and design reviews.