Databricks Engineer - Data Engineer III

Cencora

5d

About The Position

Our team members are at the heart of everything we do. At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on that purpose. If you want to make a difference at the center of health, come join our innovative company and help us improve the lives of people and animals everywhere. Apply today! Job Details We are seeking a Senior Data and AI engineer with expertise in cloud data engineering. You will work with large datasets, leverage AI technologies, and utilize Databricks for data processing and analytics to support business objectives. Key Responsibilities You will play a key role in transforming enterprise business data into insights. You will collaborate with other data and AI engineers and business stakeholders to create scalable data and AI solutions that align with business needs.

Requirements

• Bachelor’s degree in computer science, engineering, or related field
• 5-7 years proven experience as a Data Engineer with cloud-based data platforms like Databricks, Snowflake, BigQuery
• Expertise with Databricks SQL, Compute Warehouses, AI/BI Genie, AgentBricks, Unity Catalog and Vector indexes
• Experience with data modeling, Medallion architecture, ETL processes and data warehousing concepts.
• Strong programming skills in languages such as Python, SQL or Scala
• Experience with DevOps and DataOps process to deploy data objects and pipelines across environments using scripts and agile process
• Experience with AI/ML concepts and their application in data engineering.
• Excellent problem-solving skills and ability to work independently and as part of a team
• Familiarity with cloud platforms (e.g., AWS, Azure, GCP).
• Bachelor’s degree in Programming/Systems or Computer Science or other related field.
• Or equivalent work experience.
• 5-10 years of experience in technologies relevant to data/information management, such as SQL, Azure Databricks inculding Databricks Genie, AgentBricks, Mosaic AI, MLFlow, Unity Catalog and other Databricks components
• Has a broad level of understanding surrounding AI use cases supporting business needs.
• Experience in leading small project teams and streams.
• Demonstrated ability to analyze and interpret complex problems or processes that span multiple business areas, identify and understand requirements, and develop alternate solutions.
• Experience designing, developing and testing applications using proven or emerging technologies in a variety of technologies and environments.

Responsibilities

• Collaborate with business stakeholders to understand their data needs and provide tailored solutions that meet their business objectives
• Analyzing business requirements and translating them into technical specifications
• Design, develop and implement data engineering solutions using Azure Databricks Lakehouse platform.
• Build Data and AI solutions that leverage Databricks Genie, AgentBricks, Mosaic AI, MLFlow, Unity Catalog and other Databricks components
• Conduct detailed data analysis to identify existing data tables and if required designing new tables, views and other objects using Databricks platform.
• Apply AI and machine learning techniques to structured and unstructured data processing and analysis.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Collaborate with data scientists and analysts to meet data requirements.
• Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts
• Stay updated with the latest trends and technologies in data engineering, AI, LLMs and Agentic AI

Benefits

• In addition to traditional offerings like medical, dental, and vision care, we also provide a comprehensive suite of benefits that focus on the physical, emotional, financial, and social aspects of wellness.
• This encompasses support for working families, which may include backup dependent care, adoption assistance, infertility coverage, family building support, behavioral health solutions, paid parental leave, and paid caregiver leave.
• To encourage your personal growth, we also offer a variety of training programs, professional development resources, and opportunities to participate in mentorship programs, employee resource groups, volunteer activities, and much more.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees