Lead Data Engineer

UKGSunrise, FL
1d

About The Position

We are seeking a Lead Data Engineer to design, build, and lead the delivery of scalable data solutions on our Cloud Data Platform (GCP/Azure). This role plays a critical hands-on leadership function, owning complex data pipelines and models while guiding a small team of data engineers through design, development, and best practices. The ideal candidate is a strong technical contributor who can translate architectural guidance into execution, partner closely with Product Owners and Architects, and ensure high-quality, reliable data solutions aligned to business needs.

Requirements

  • 7–9+ years of experience in data engineering and data warehousing, including cloud-based solutions.
  • Proven experience delivering complex data pipelines and warehouse solutions in Azure and/or GCP.
  • Strong hands-on experience with Python, SQL, Spark, and distributed data processing.
  • Azure: Data Factory, Databricks, Synapse, ADLS Gen2, Azure DevOps
  • GCP: Composer, Data Fusion, Dataform, DataProc, BigQuery, GCS, GitHub
  • Solid understanding of Dimensional Modeling, ELT, CDC, and modern data lakehouse concepts.
  • Demonstrated ability to lead technical delivery and influence design decisions within a team.
  • Experience mentoring engineers through code reviews, pairing, and design guidance.
  • Strong communication skills with the ability to explain technical concepts to non-technical stakeholders.

Nice To Haves

  • Experience integrating data from SaaS platforms (Salesforce, D365, Qualtrics, Pendo, etc.).
  • Familiarity with DataOps practices, orchestration, and monitoring tools.
  • Exposure to data quality and governance concepts.
  • Cloud certification (Azure or GCP) is a plus.

Responsibilities

  • Design, develop, and maintain end-to-end data pipelines and transformations using Azure (ADF, Databricks, ADLS Gen2, Synapse) and GCP (Composer, Data Fusion, Dataform, DataProc, BigQuery, GCS).
  • Implement Fact and Dimension models, CDC patterns, and cloud-native ELT pipelines following established architectural standards.
  • Optimize data pipelines for performance, scalability, and cost efficiency.
  • Serve as the technical lead for one or more data domains or initiatives.
  • Lead design discussions, perform code reviews, and ensure adherence to engineering standards and best practices.
  • Mentor and guide Senior and Mid-level Data Engineers through hands-on coaching and technical feedback.
  • Act as the first point of escalation for complex technical issues within owned initiatives.
  • Partner with Data Architects, Product Owners, Analysts, and Platform teams to translate business requirements into effective data solutions.
  • Contribute to data modeling decisions to ensure alignment with analytics and reporting use cases.
  • Support cross-team initiatives by implementing shared frameworks and reusable components defined at the platform level.
  • Ensure reliability and maintainability of data pipelines through monitoring, alerting, and automated testing.
  • Implement and maintain CI/CD pipelines using Azure DevOps and/or GitHub Actions.
  • Create and maintain technical documentation for pipelines, models, and processes.
  • Support data quality, governance, and metadata standards within owned solutions.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

No Education Listed

Number of Employees

5,001-10,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service