Sr. Data Engineer
About The Position
Cadent ignites seamless connections between brands, publishers & consumers. Our predictive AI orchestrates outcomes on any platform customers are on, across any media they consume & at any stage of the journey. To learn more, please visit Cadent.com.Data Engineers at Cadent collaborate with business partner teams to design, build, and scale very large datasets and data pipelines that enable analytics, modeling, exploration, and reporting. The Senior Data Engineer position is ideal for an experienced data engineer with strong Python, Spark, and SQL experience who is looking to work with massive amounts of data in a cutting-edge, cloud-based environment. You will be responsible for building data solutions using tools from Apache, AWS, and GCP, including Redshift/BigQuery, Spark, S3/GCS, Clickhouse, and Airflow.
Requirements
- Must have 3+ years of experience in data engineering position
- Must have experience building Spark-based data pipelines using near/real-time data
- 2+ years of working experience with GCP, specifically BigQuery, GCS, Composer, and DataProc
- Strong ANSI SQL, NoSQL and SparkSQL query language skills
- Strong problem-solving skills; collaborator and data advocate
- Excellent written and oral communication skills & customer service skills
- Must be legally authorized to work in the United States without employer sponsorship now or in the future.
Nice To Haves
- Minimum 2 years demonstrated, hands-on experience with the GCP ecosystem of tools and technologies
- Experience with Apache open-source tools (Airflow)
- Experience functioning as a team lead - providing technical guidance and leadership
- Ability to build ETL pipelines from scratch, using streaming, near real-time, and micro-batch data
- Experience with system monitoring, log management, and error notification
- Experience in Ad-Tech industry a plus
Responsibilities
- Using a variety of open-source technologies (Python, Spark, Airflow), build data pipelines to extract, cleanse, and integrate data, from a variety of sources and formats
- Develop scalable and re-usable solutions that support real-time, batch, and event-based data processing
- Function as an SME/provide technical guidance and leadership to one or more engineers
- Team lead when one or more engineers are engaged on the same project/initiative
- Interact with business partners to lead technical solution discussions
- Experience with Agile/Scrum methodology framework for product development
Benefits
- Inclusive health, dental, and vision plans built to support diverse lifestyles
- Enhanced support for reproductive health, family planning, and new parents
- Employer contribution to HSA
- Voluntary Benefits: Pet Insurance, LegalEase Legal Assistance, Critical Illness, Hospital Indemnity, and Accident coverages
- Generous and inclusive paid parental leave
- Mental health support and Employee Assistance Program (EAP)
- Free access to the Calm App
- Monthly Wellness reimbursement
- Special discounts through LifeMart and Plum Benefits
- Flexible Time Off (FTO) policy and company breaks
- 11 observed Federal holidays
- Summer Fridays between Memorial Day and Labor Day
- Employee Resource Groups that foster connection and community
- DEI programming and initiatives
- Company-sponsored events to bring employees together
- Offices across the U.S., including Manhattan, Philadelphia, and San Jose
- 401(k) participation with discretionary employer match
- Life, Short-term, and Long-term Disability coverage
- Cell phone and WiFi stipend
- Pre-tax commuter benefits
- Access to certified financial coaches and planning tools
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
