Senior Python Developer – Big Data & AWS

Tasks

• Design, develop, and optimize scalable Big Data applications using Python.
• Build efficient data processing pipelines using Spark, Hadoop, Hive, and AWS EMR.
• Develop cloud-based solutions leveraging AWS Lambda, S3, Glue, Redshift, EventBridge, and Step Functions.
• Perform complex SQL queries, data transformation, and large-scale data analysis.
• Develop and integrate APIs for enterprise applications.
• Implement automated CI/CD pipelines using GitLab and Terraform.
• Troubleshoot performance issues and optimize data processing workflows.
• Collaborate with cross-functional teams to deliver scalable, high-performance solutions.

Requirements

• 10+ Years (Mandatory)
• Python: 10+ years of hands-on Python development for Big Data applications.
• AWS: 5+ years of experience with EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue.
• Big Data: Apache Spark, PySpark, Hadoop, Hive, ETL/ELT, Data Processing Pipelines.
• Data Engineering: SQL, Data Transformation, Data Manipulation, Data Analysis, Data Mining.
• API Development: REST APIs, API Integrations, API Calls.
• DevOps: GitLab, Terraform, CI/CD Pipelines.
• 5+ years of experience with Spark, SQL, API integration, and data transformation.

Schedule

• Onsite – 5 Days/Week
• Full-Time / Permanent

Location

• Atlanta, GA