Sr. Principal Software Engineer

About the position

The Platform Lead - Nucleus, based at Nomura's New York office, provides overall leadership to a team of data engineers and analysts, driving the implementation of data solutions that address a wide range of internal business objectives and requirements. This position is both client-facing within the organization and hands-on in terms of programming and development. Collaborating with internal clients' data engineers and architects, the Platform Lead will oversee efforts to modernize existing data infrastructure-such as data warehouses, data lakes, and data marts. Responsibilities include guiding and contributing to the team's architecture and development of data ingestion processes, optimizing performance and administration, and establishing best practices for database structures.

Responsibilities

• Oversee activities of the US team, including work scheduling, providing technical guidance, mentoring junior members, and ensuring adherence to standard development practices, while managing production support with cost awareness.
• Support the delivery of cloud-based solutions, including data warehouses, data lakes, and data marts.
• Gain a comprehensive understanding of the data environment-such as tools, technology stacks, and source systems-and collaborate with internal clients' technology teams to enhance data collection, reporting, and analytics functionality.
• Design, document, and implement strategies for data warehouses, including developing ETL, ELT, and data pipeline processes.
• Create processes to efficiently load and transform large volumes of both structured and semi-structured data.
• Contribute to defining system architecture, ensuring that solutions comply with firm-mandated standards related to security and risk control, while meeting software requirements around security, compliance, scalability, efficiency, and reliability.
• Undertake a range of project-related tasks, such as coordinating with external departments, maintaining detailed documentation (including user guides, on-boarding manuals, and system architecture), conducting integration testing, and serving as a subject matter expert (SME) for support.

Requirements

• 10 + years working experience as a Technical Lead/or Architect.
• 6+ years of delivery and implementation work experience in the Data and Analytics space.
• 6 + years of working experience with data management, data warehouse/data lake design, data modeling concepts, ETL Tools, advanced SQL, JAVA and Python programming.
• 3+ years of working experience in building and supporting Cloud Data solutions, preferably in AWS with hands-on experience with Cloud Data Lake/Data Warehousing technologies such as Snowflake, Databricks, AWS Redshift/Spectrum.
• Experience with data processing platforms - AWS EMR, Hadoop, Spark.
• Experience with Messaging Systems such as Kafka, Solace, Pulsar.
• Understanding of core AWS services, uses, and basic AWS architecture best practices.
• Proficiency in developing, deploying, and debugging cloud-based applications using AWS.
• Ability to use the AWS service APIs, AWS CLI, and SDKs to write applications.
• Design knowledge of Service oriented architecture, scalable micro services and data standards like JSON, Avro, Parquet, ORC, Iceberg, S3, Delta, HUDI.
• Ability to use a CI/CD pipeline to deploy applications on AWS.
• Excellent written and oral communication skills along with the ability to present clear and concise solutions to stakeholders and IT partners.
• Maintain and achieve technical cloud certifications (AWS or Snowflake).
• Ability to work and communicate with both business and technical experts.
• College or University degree in Computer Science, Mathematics, Data Science and/or relevant degree.

Nice-to-haves

• Passionate about data and analytics, analytical mind with a problem-solving aptitude.
• Ability to perform training and mentorship.
• Visualization tools like Power BI, Tableau.
• Proven abilities to take initiative and be innovative.

Benefits

• 401(k) eligibility
• various paid time off benefits, such as vacation, sick time, and parental leave
• sign-on bonus
• restricted stock units
• discretionary awards