Lead Data Engineer

External job listingat Diverselynx

Tasks Design and develop data pipelines for structured and unstructured data, including PDFs, documents, transcripts, and logs. Build and maintain vector embedding pipelines and integrate...

External source - not verified5 weeks agoOpen until: Jan 14, 2027

Salary

Not provided

Location

Scottsdale, United States

Employment type

Full time

Workplace

Not provided

Lead Data Engineer

Scottsdale, United States

Job description

Tasks

  • Design and develop data pipelines for structured and unstructured data, including PDFs, documents, transcripts, and logs.
  • Build and maintain vector embedding pipelines and integrate vector databases.
  • Develop feature pipelines and feature stores for ML training and inference.
  • Implement RAG data pipelines, including chunking strategies, embedding refresh cycles, and metadata tagging.
  • Collaborate with ML engineers and data scientists to support model training and evaluation.
  • Ensure data quality, lineage, governance, and compliance across AI data pipelines.
  • Optimize data pipelines for cost and performance, including Dynamic Tables and streaming ingestion.
  • Support MLOps/LLMOps workflows, dataset versioning, and reproducibility.
  • Implement data access controls and entitlement logic to ensure AI systems access only authorized data.

Requirements

  • 14+ Years

Schedule

  • Contract

Pay

  • $68/hr on C2C

How to apply

  • Share your updated resume by email.
  • DM your resume or connect on LinkedIn.

Location

  • Scottsdale, AZ
  • Omaha / La Vista, NE
  • Atlanta, GA

Similar jobs