Sr. Director, Data Platform Engineering
About The Position
DOHMH is building its Enterprise Data Platform to increase its capacity to ingest, process, and analyze data as a valuable resource. This resource will help the agency make decisions based on the best available information, to lead public health policy, and make operational decisions that optimally support the health of New Yorkers, especially vulnerable populations. The work will be done collaboratively with agency programmatic and administrative divisions and bureaus in the agency. The primary goal of the Bureau of Data Technology and Strategy is to implement the agency’s Enterprise Data Platform, on Microsoft’s Azure Cloud, using Databricks. The person in this role will collaborate closely with the Bureau’s Senior Director of Product Management, and the Executive Director of Data Ecosystem and Strategy, to plan and execute the rollout of the Enterprise Data Platform. The Bureau of Data Technology and Strategy seeks a Senior Director of Data Engineering, to help lead its data engineering team. The Senior Director of Data Engineering will report to the Executive Director of Data Engineering and Management, and manage a diverse team of software, data, and cloud platform engineers. This person will also work closely with partners from the Division of Information Technology, who manage the agency’s technology and cloud infrastructure.
Requirements
- 5+ years of experience managing staff and consulting teams
- 5+ years of experience performing cloud-based software or data engineering
- 5+ years of experience designing and building reliable cloud production operations
- 10+ years of SQL or NoSQL database experience
- 10+ years of Python development experience
Responsibilities
- Lead and manage the data engineering team and its staff in the Bureau of Data Technology and Strategy
- Collaborate with agency software engineers to implement continuous integration/continuous deployment methodologies on Microsoft’s Azure Cloud Platform, using GitHub and Databricks
- Collaborate with agency engineers to implement DevSecOps methodologies, using JFrog Artifactory, Advanced Security, and Curation Security for the Enterprise Data Platform
- Ensure observability, alerting, and resolution of risks to the Enterprise Data Platform, with a focus on reliability, performance, and security
- Study, propose, and present potential zero trust models for cloud data storage and computation in Azure Databricks
- Optimize the Enterprise Data Platform to maximize user performance and minimize cloud cost
- Collaboratively plan data product development, testing, deployment, and operational support
- Ensure that Enterprise Data Platform provides an excellent user experience for agency research scientists
- Iteratively improve the Enterprise Data Platform
- Related data engineering and operational tasks, as assigned
Benefits
- Public Service Loan Forgiveness (PSLF) eligible employer
- Generous Paid Time Off (PTO) policy
- Medical, dental, and life insurance with low or no employee contribution
- A retirement savings plan with generous employer contribution
- Flexible spending medical and commuter benefits plan
- Meaningful work at an organization striving to advance health equity and social justice
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Manager
Education Level
No Education Listed
