Lead Data Engineer (US)

Productiv Team • Dallas, TX

19h • Remote

About The Position

This project is a high-impact business process engine designed to optimize customer pharmacy procurement. The system analyzes the purchase ratio between preferred and non preferred suppliers We need a Senior Solution Architect who can command a high-pressure environment, architect a robust technical roadmap, and provide immediate direction to a team of developers.

Requirements

• 7+ years of software development experience with 3+ years in a lead/senior role
• Expert-level proficiency in Python and PySpark for big data processing
• Strong experience with Azure Databricks and Azure cloud ecosystem (ADF, ADLS Gen2, Key Vault)
• Deep understanding of distributed computing concepts and Spark optimization technique.
• Hands-on experience with MongoDB and SQL databases.
• Proficiency in Git, CI/CD pipelines, and DevOps practices
• Experience with data modeling, ETL design patterns, and data warehousing concepts

Responsibilities

• Design and guide the implementation of new features.
• Be hands on with development, using the required technical skills listed above.
• Give clear coding guidance to offshore team, review code, and help unblock technical issues for the team.
• Choose the smart and quick path over over-engineering, balancing immediate business needs with long-term platform stability.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed