Databricks Architect

Tasks

• Responsible for developing, capturing, and sharing solution architecture patterns and best-practice knowledge that can be applied across domains.
• Work with business stakeholders and users to assist in designing, developing, and delivering their data models or self-service models.
• Work with global data standards, structures, and processes to maintain global guidelines.

Requirements

• Overall 10+ years of experience and 3+ years of experience developing and deploying data solutions using AWS/Azure DataBricks in PySpark.
• Experience with AWS ecosystem and AWS S3.
• Ability to work on multiple areas like data pipeline ETL, data modelling and design, writing complex SQL queries, etc.
• Hands-on expertise with real-time data processing and analytics, data ingestion (batched and streamed), and data storage solutions.
• Hands-on knowledge of Python along with its main data libraries like Pandas, NumPy, Beautiful Soup, etc.
• Demonstrated strength in data management, orchestration, access control, etc.
• A proven expert in writing optimized SQL to deal with large data volumes.
• Desirable to have knowledge of SAP ECC.
• Required Skills: Databricks

How to apply

• Share your updated resume by email.

Location

• Houston, TX