Data Engineer

About the role

Lingaro is seeking a Data Engineer to design and implement data processing systems on Azure, and to build, integrate, and optimize data pipelines and storage architectures.

Responsibilities

• Build pipelines to ingest data from databases, APIs, or streaming platforms.
• Integrate and transform data to match target data models or formats.
• Design and optimize data storage architectures, including data lakes, data warehouses, and distributed file systems.
• Use partitioning, compression, or indexing to optimize storage and retrieval.
• Identify and resolve bottlenecks, tune queries, and implement caching strategies to improve retrieval speed and system efficiency.
• Design and implement data models that support efficient storage, retrieval, and analysis.
• Collaborate with data scientists, analysts, and business stakeholders to understand requirements and provide technical solutions and well-structured data for analysis and modeling.
• Communicate complex technical concepts clearly to non-technical stakeholders.
• Take responsibility for delivering solutions and work under Agile and Scrum methodologies.
• Train and mentor junior data engineers, providing guidance and knowledge transfer.
• Write efficient, scalable code to process, transform, and clean large volumes of structured and unstructured data on Azure.

Requirements

• Ability to work independently and take responsibility for delivering a solution.
• Ability to work under Agile and Scrum development methodologies.

Datos clave

• The role involves building data pipelines from databases, APIs, or streaming platforms.
• Design and implement data processing systems on Azure.
• The work includes collaborating with data scientists, analysts, and business stakeholders.
• The role calls for independence and responsibility for delivering a solution.