Senior Databricks Engineer

CapgeminiNew York, NY
13dOnsite

About The Position

Capgemini is looking to hire a Databricks Data engineer for a role in New Jersey.Job Locationonsite role in Englawood ,New JerseyYour role Understanding of data modeling, data warehousing, and performance tuning. Develop and maintain data lakehouse architectures for structured and unstructured data. Optimize data workflows for performance, scalability, and cost efficiency. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions. Monitor and troubleshoot data pipelines, ensuring reliability and accuracy. Integrate Databricks with cloud services (AWS, Azure, or GCP) and other enterprise systems.

Requirements

  • 5+ Years of Design and implement ETL/ELT pipelines using Databricks and Apache Spark.
  • Strong proficiency in Python, SQL, and PySpark.
  • Knowledge of Delta Lake, data lakehouse concepts, and streaming data.
  • Familiarity with CI/CD pipelines, version control (Git), and DevOps practices.
  • Hands-on experience with cloud platforms (AWS, Azure, or GCP).

Responsibilities

  • Develop and maintain data lakehouse architectures for structured and unstructured data.
  • Optimize data workflows for performance, scalability, and cost efficiency.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
  • Monitor and troubleshoot data pipelines, ensuring reliability and accuracy.
  • Integrate Databricks with cloud services (AWS, Azure, or GCP) and other enterprise systems.

Benefits

  • Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
  • Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
  • Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
  • Life and disability insurance
  • Employee assistance programs
  • Other benefits as provided by local policy and eligibility
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service