Sr Engineer ETL

Optimum•Town of Oyster Bay, NY
1d

About The Position

The ETL Engineer is responsible for building and operating reliable, scalable data pipelines that ingest, transform, and deliver data from diverse source systems into analytical, operational, and AI platforms. This role ensures data accuracy, timeliness, and consistency across the enterprise.

Requirements

  • 5+ years of experience building production ETL pipelines
  • Strong experience with Python, SQL, or similar data engineering languages
  • Familiarity with ETL frameworks and tools (Airflow, dbt, Spark, Flink, custom pipelines, tensorflow, talend)
  • Experience working with Kafka or event-driven ingestion
  • Strong understanding of data modeling and schema evolution
  • Experience working within an Agile or SAFE Agile work model

Nice To Haves

  • Experience with large-scale operational or network data
  • Exposure to data governance, metadata, and lineage tooling
  • Experience delivering data into cloud analytics platforms
  • Understanding of SLA-driven data delivery

Responsibilities

  • Design and implement ETL / ELT pipelines for structured and semi-structured data
  • Ingest data from APIs, message queues, databases, and files
  • Build transformation logic to normalize, enrich, and validate data
  • Implement data quality, reconciliation, and monitoring checks
  • Optimize pipelines for performance, reliability, and cost
  • Support near-real-time and batch processing use cases
  • Collaborate with OLAP, Observability, and AI Ops teams
  • Maintain documentation, lineage, and operational runbooks
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service