Databricks Application Architect / Senior Data Architect
About The Position
We are seeking an experienced Databricks Application Architect to support the modernization of the State of Iowa’s eligibility systems for SNAP, FIP, and Refugee Cash Assistance (RCA) programs. This initiative will design and implement a modern, vendor-hosted eligibility platform that integrates with Iowa’s existing ELIAS Medicaid eligibility system and improves efficiency through automation of eligibility determination and benefits processing. The Databricks Architect will play a key role in designing and establishing the application data environment, defining architectural standards and best practices, and supporting data conversion and migration from legacy systems. This role is focused on application architecture and data engineering patterns within Databricks, rather than infrastructure provisioning. The ideal candidate will bring strong Databricks architecture expertise, hands-on experience with data migration and conversion efforts, and familiarity with health and human services eligibility programs such as SNAP, TANF, or Medicaid integrated eligibility systems.
Requirements
- 8+ years of experience in data engineering, data architecture, or enterprise application architecture
- Strong hands-on experience with Databricks and Apache Spark ecosystems
- Experience designing modern data architectures for enterprise platforms
- Experience supporting data conversion or large-scale data migration projects
- Proficiency in: Databricks Apache Spark / PySpark Python SQL Data Lake / Lakehouse architectures
- Experience building ETL/ELT data pipelines and transformation frameworks
- Experience designing scalable data integration and processing architectures
Nice To Haves
- Experience supporting Integrated Eligibility Systems (IES)
- Experience with SNAP, TANF, Medicaid eligibility, or other HHS benefit programs
- Experience working on state government modernization initiatives
- Familiarity with Medicaid Enterprise Systems (MES) or integrated eligibility platforms
- Experience integrating with eligibility determination or case management systems
- Experience working in large system integrator-led implementations
Responsibilities
- Databricks Architecture & Platform Design
- Design and establish the Databricks application architecture supporting the modern eligibility platform
- Define architectural standards, patterns, and best practices for the Databricks data environment
- Guide the initial setup and configuration of the project’s data platform and application data architecture
- Ensure architecture supports scalability, reliability, performance, and security requirements
- Provide technical leadership on Databricks development approaches and design patterns
- Data Conversion & Migration
- Architect and support data migration from legacy eligibility systems
- Define strategies for data transformation, cleansing, reconciliation, and validation
- Collaborate with development teams on data mapping and conversion frameworks
- Ensure high levels of data integrity and traceability throughout the conversion process
- Data Engineering & Integration
- Design and support the implementation of data pipelines and processing frameworks within Databricks
- Support ingestion and transformation of data from multiple legacy and external systems
- Collaborate with system architects and integration teams to support data exchange with the ELIAS Medicaid eligibility system
- Ensure efficient processing for both batch and near-real-time data workflows
- Technical Leadership & Collaboration
- Work closely with architects, developers, and data engineers to guide architectural decisions
- Provide mentorship and technical guidance to engineering teams implementing the solution
- Participate in architecture reviews, design sessions, and technical governance processes
- Support troubleshooting of complex data architecture and platform performance issues
- Governance, Security & Best Practices
- Ensure compliance with state security and data governance requirements
- Implement best practices for data access control, auditability, and lineage
- Support CI/CD and DevOps practices for data platform development and deployment
Benefits
- Medical / Dental / Vision Insurance – insurance premium assistance provided
- Additional Insurance (Life, Disability, etc.)
- Paid Time Off
- 401(k) Retirement Savings Plan & Health Savings Account
- Various training courses to promote continuous learning
- Corporate Wellness Program
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
