Senior Data Engineer – Atlanta, Georgia
Published on CazVidat Spiceorb
Join Spiceorb as a Senior Data Engineer in Atlanta. Build GCP streaming pipelines with BigQuery and Cloud Spanner in a local contract-to-hire role.
Salary
Not provided
Location
Atlanta, Georgia, United States
Employment type
Contract
Workplace
Not provided
Senior Data Engineer – Atlanta, Georgia
Atlanta, Georgia, United States
Job description
Spiceorb is hiring on behalf of a confidential client for a Senior Data Engineer in Atlanta, Georgia. This is a local, contract-to-hire opportunity and is not remote eligible.
About the Role
Build and modernize cloud-native data platforms that power customer analytics, AI applications, and real-time experiences. You’ll develop streaming pipelines on Google Cloud Platform (GCP), optimize Cloud Spanner and BigQuery, and help migrate data workloads from Azure to GCP.
What You’ll Do
- Build real-time and near-real-time pipelines using Pub/Sub, Dataflow, and Apache Beam.
- Ingest and process customer, clickstream, care, store, and network data into Cloud Spanner and BigQuery.
- Optimize Cloud Spanner schemas, primary keys, indexes, batching, and hotspot handling for low-latency reads.
- Develop reusable change data capture (CDC), SCD Type 2, and late-arriving-data processing patterns.
- Migrate and modernize Azure data pipelines to GCP, working with Databricks, Snowflake, and Azure Data Factory.
- Build data feeds for Customer 360, knowledge graphs, GraphQL APIs, and MCP servers that support AI agents.
- Implement data quality, lineage, reconciliation, security, monitoring, and service-level objectives (SLOs).
- Use Terraform and CI/CD to deploy and manage cloud-native data services.
- Collaborate with product, analytics, and AI/ML teams, and mentor junior engineers.
Required Qualifications
- 15+ years of data engineering experience.
- FAANG background is mandatory.
- At least 3 years of production experience with GCP data platforms, real-time or near-real-time streaming pipelines, and BigQuery.
- At least 1 year of Cloud Spanner experience.
- At least 4 years of data modeling, ETL/ELT, SQL, and Python experience.
- At least 3 years of experience with Databricks, Spark, and Delta Lake.
- At least 2 years of experience with Azure and Snowflake.
- Hands-on experience with Pub/Sub, Dataflow, Apache Beam, and Kafka.
- Strong PySpark, CDC, SCD Type 2, and clickstream ingestion skills.
- Experience with Terraform, CI/CD, orchestration, and data quality.
- Must be a local candidate in the Atlanta area.
Employment Details
- Employment type: Contract-to-hire (C2H)
- Location: Atlanta, Georgia, United States
- Work arrangement: On-site/local; remote work is not available.
Explore other opportunities: Senior DevOps Engineer (Azure), Auditor semisenior, and Especialista SEO Senior.