D
Lead Data Engineer
External job listingat Diverselynx
Tasks Design and develop data pipelines for structured and unstructured data, including PDFs, documents, transcripts, and logs. Build and maintain vector embedding pipelines and integrate...
External source - not verified5 weeks agoOpen until: Jan 14, 2027
Salary
Not provided
Location
Scottsdale, United States
Employment type
Full time
Workplace
Not provided
Lead Data Engineer
Scottsdale, United States
Job description
Tasks
- Design and develop data pipelines for structured and unstructured data, including PDFs, documents, transcripts, and logs.
- Build and maintain vector embedding pipelines and integrate vector databases.
- Develop feature pipelines and feature stores for ML training and inference.
- Implement RAG data pipelines, including chunking strategies, embedding refresh cycles, and metadata tagging.
- Collaborate with ML engineers and data scientists to support model training and evaluation.
- Ensure data quality, lineage, governance, and compliance across AI data pipelines.
- Optimize data pipelines for cost and performance, including Dynamic Tables and streaming ingestion.
- Support MLOps/LLMOps workflows, dataset versioning, and reproducibility.
- Implement data access controls and entitlement logic to ensure AI systems access only authorized data.
Requirements
- 14+ Years
Schedule
- Contract
Pay
- $68/hr on C2C
How to apply
- Share your updated resume by email.
- DM your resume or connect on LinkedIn.
Location
- Scottsdale, AZ
- Omaha / La Vista, NE
- Atlanta, GA