Remote Data Engineering Lead

JobgetherPrior Lake, MN
22hRemote

About The Position

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Principal Data Platform Engineer. In this role, you will spearhead critical data platform initiatives with full ownership over the data management lifecycle. This involves everything from data ingestion to processing, storage, and querying, ultimately contributing to enhanced product features for our internal and external customers. Your technical leadership will enable cross-functional collaboration and impact, ensuring our partner's Data Platform vision is realized through scalable and innovative solutions. You will work in a dynamic environment, tackling complex challenges and implementing best practices in data management.

Requirements

  • 8+ years of hands-on software engineering experience.
  • Backend programming skills, proficient in Python.
  • Strong fundamentals in data structures, algorithms, and distributed systems.
  • Experience in designing highly scalable software systems.
  • Familiarity with technologies such as Apache Kafka, Apache Spark, Airflow, Kubernetes.
  • Excellent troubleshooting skills with a record of implementing creative solutions.
  • Hands-on experience with Docker and Kubernetes.
  • Bachelor's in Computer Science or a related field; Master's preferred.
  • Excellent verbal and written communication skills.

Responsibilities

  • Define and plan the long-term strategy for the Data Platform.
  • Design and develop scalable distributed systems for data management.
  • Address fault-tolerance and high availability issues in data ingestion.
  • Improve and add features to the ETL framework while maintaining SLAs.
  • Collaborate with engineers to deliver cross-functional features.
  • Participate in all phases of the software development life cycle.

Benefits

  • Competitive salary based on experience and location.
  • Health, pharmacy, optical, and dental care benefits.
  • Paid time off and sick leave.
  • Short-term and long-term disability coverage.
  • Life insurance and 401k contribution.
  • Flexible working hours with remote options.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service