Data Engineer - Databricks
Aviso de fuente externaen Evalueserve
Data Engineer - Databricks at Evalueserve: design scalable data pipelines, develop data architectures, and support analytics and AI/ML use cases.
Salario
No especificado
Ubicación
Bogotá, Colombia
Tipo de empleo
Tiempo completo
Modalidad
No especificado
Data Engineer - Databricks
Bogotá, Colombia
Descripción del empleo
About the role
Data Analytics is one of Evalueserve’s highest growth practices, providing rewarding career opportunities. Established in 2014, the global DA team includes data science professionals across data engineering, business intelligence, digital marketing, advanced analytics, technology, and product engineering. Some tenured teammates have been with Evalueserve since it started more than 20 years ago and have enjoyed leadership opportunities across its seven business lines.
Responsibilities
- Design, develop, and automate scalable ETL/ELT pipelines for data warehouse, data lake, and lakehouse environments using technologies such as Azure Databricks, Apache Spark, Python, and SQL.
- Modernize data integration processes and build cloud-native pipelines using Databricks, Delta Lake, Azure Data Factory, or similar technologies.
- Partner with business and technical stakeholders to translate business needs into data products, platforms, and engineering solutions.
- Develop scalable data architectures and reusable data models for enterprise applications, business intelligence, advanced analytics, and AI/ML use cases.
- Collaborate with BI and analytics teams to deliver analytics-ready datasets and enhance reporting environments using Power BI or similar platforms.
- Implement data quality, testing, documentation, metadata, lineage, security, and governance practices using Unity Catalog or equivalent frameworks.
- Work with DevOps teams on source control, CI/CD, and Test-Driven Development practices using GitHub, Azure DevOps, GitHub Actions, or comparable tools.
- Optimize platform performance, scalability, reliability, operational efficiency, and cloud costs.
Requirements
Bachelor’s degree in Engineering, Information Systems, Computer Science, or a related field.
Datos clave
- The role involves designing and automating scalable ETL/ELT pipelines.
- A bachelor’s degree in Engineering, Information Systems, Computer Science, or a related field is required.
- The role uses technologies such as Azure Databricks, Apache Spark, Python, and SQL.
Preguntas frecuentes
What does the role involve?
It involves designing, developing, and automating scalable ETL/ELT pipelines, as well as building data architectures and reusable data models.
What degree is required?
A bachelor’s degree in Engineering, Information Systems, Computer Science, or a related field is required.
Which technologies are mentioned?
The listing mentions Azure Databricks, Apache Spark, Python, SQL, Delta Lake, and Azure Data Factory, among other tools.