Software Engineering & Development, VP

State Street • Watertown, MA

1d

About The Position

State Street Associates (SSA) is looking for a highly skilled and motivated Data Engineering with hands-on experience working with Oracle database and Databricks Spark on AWS.
This role will be responsible for managing and analyzing terabytes of data hosted in enterprise data warehouse and leveraging large-scale data platforms to advancing new research and product development in the form of thought leadership, market indicators, and analytical tools.
You'll work across both traditional and cloud-based platforms, using your expertise in big data processing, statistical analysis and machine learning to deliver scalable and meaningful outcomes.

Requirements

• Masters or B.S. degree in Computer Science, Data Science, Statistics Engineering or a related field.
• Expertise in Oracle database, with strong proficiency in SQL and PL/SQL, Oracle access control (roles, privileges, user management, and data security).
• Working knowledge of AWS core services, including S3, EC2/EMR, IAM, Athena, Glue or Redshift.
• Hands-on experience with Databricks Spark on large datasets, using PySpark, Scala, or SQL. Familiarity with Delta Lake, Unity Catalog or similar data Lakehouse technologies.
• Proficient in Linux environments, including experience with shell scripting, basic system operations, and navigating file systems.
• Deep understanding of data warehouse concepts and experience with data modeling, ETL/ELT pipelines, and performance tuning.
• Solid programming skills in Python for data transformation and machine learning (e.g., pandas, scikit-learn).
• Experience with BI tools such as Power BI and Tableau.
• Strong problem-solving and communication skills, with the ability to work across regions.
• 5+ years of experience in data engineering, with proven work managing large-scale datasets.

Responsibilities

• Promote data governance, security, and best practices in managing large volumes of sensitive business data, to compliance with company policies and regulatory requirements.
• Work with terabytes of structured and semi-structured data from our enterprise data warehouse, primarily stored in Oracle and integrated with Databricks Spark on AWS.
• Write efficient, production-quality SQL and PL/SQL queries for data extraction and transformation in Oracle.
• Leverage Databricks Spark and PySpark to process large datasets and build machine learning models in a distributed environment.
• Collaborate closed with business stakeholders to understand data requirements and translate them into technical solutions.
• Ensure deployment and operationalization of both traditional and cloud applications.
• Participate in scope definition, requirements analysis, functional and technical design, application build, product configuration, unit testing, and production deployment.
• Provide technical expertise and ownership in the diagnosis and resolution of issues, including the determination and provision of workaround solution or escalation to service owners.
• Conceptual POCs in new technologies or system integrations and scaling it to production grade.
• Document and interact with business and technology stake holders/team members as necessary.
• Experience in DevOPS is a plus with hands on experience in Jenkins, Git and any one artifactory tool.

Benefits

• Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level