Senior Databricks Engineer

CapgeminiBridgewater, NJ
23d

About The Position

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.About the role you're consideringCapgemini is looking for a senior Databricks engineer to join our team.Your role Data Architecture Design: Develop/Modify the architecture for the EDW, including data models, data quality standards, data integration strategies, data migration and data warehousing technologies to effectively store and access data from various sources as per the requirments. Business Requirements Gathering: Collaborate with business stakeholders to understand their data needs, identify key performance indicators (KPIs), and translate them into data warehouse requirements. Data Integration and ETL Development: Design and implementation of ETL processes to extract data from various source systems,transform it into a consistent format, and load it into the EDW through Databricks. Proven track record in implementing databricks for modernization projects. Performance Optimization: Monitor and optimize the performance of the EDW to ensure efficient data access and query response times. Overall Technical Leader: Provide technical guidance on data warehouse technologies, tools, and best practices to the relevant stakeholders. Collaboration with Stakeholders: Work closely with business users, data analysts, and application developers to understand their data needs and deliver data-driven insights.

Requirements

  • 10+years of expereince as Datawarehouse Data Engineer
  • Data Warehousing Expertise: Deep understanding of data warehousing concepts, architectures, and technologies like dimensional modeling, star schema, Databricks schema, and ETL processes.
  • Database Management Systems (DBMS): Proficient in SQL's and Databricks.
  • Data Integration Tools: Familiarity with data integration tools for ETL development and data cleansing.
  • Communication Skills: Excellent communication skills to effectively collaborate with stakeholders from various departments

Responsibilities

  • Data Architecture Design: Develop/Modify the architecture for the EDW, including data models, data quality standards, data integration strategies, data migration and data warehousing technologies to effectively store and access data from various sources as per the requirments.
  • Business Requirements Gathering: Collaborate with business stakeholders to understand their data needs, identify key performance indicators (KPIs), and translate them into data warehouse requirements.
  • Data Integration and ETL Development: Design and implementation of ETL processes to extract data from various source systems,transform it into a consistent format, and load it into the EDW through Databricks. Proven track record in implementing databricks for modernization projects.
  • Performance Optimization: Monitor and optimize the performance of the EDW to ensure efficient data access and query response times.
  • Overall Technical Leader: Provide technical guidance on data warehouse technologies, tools, and best practices to the relevant stakeholders.
  • Collaboration with Stakeholders: Work closely with business users, data analysts, and application developers to understand their data needs and deliver data-driven insights.

Benefits

  • Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
  • Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
  • Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
  • Life and disability insurance
  • Employee assistance programs
  • Other benefits as provided by local policy and eligibility
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service