Principal Software Engineer - AI Engineering

About the position

The Red Hat Ecosystems Engineering group is seeking a Principal Software Engineer in our Boston office. In this role, you will work with a diverse team of highly motivated engineers on designing and implementing AI/ML workflows for security solutions. You will also be working closely with the product management, other engineering groups within Red Hat, and with Red Hat partners and lighthouse customers.

Responsibilities

• Architect, lead, and contribute to the design and implementation of AI workflows
• Take ownership of small, cross-functional projects from inception to completion
• Implement, deploy, optimize, and otherwise improve Agentic Workflows running on OpenShift
• Work with upstream AI/ML communities to evaluate new AI/ML-related technologies from partners and the integrations between their technology and that of Red Hat
• Collaborate with partners to leverage our combined technologies in order to solve difficult technical and business problems

Requirements

• 7+ years of work experience as a Software Engineer
• Demonstrated experience as a technical leader/team leader, working with cross functional teams
• Experience in development in Python
• Experience with containers and OpenShift or Kubernetes
• Experience with vector databases and retrieval-augmented generation (RAG)
• Experience and knowledge of AI frameworks (LangChain) and libraries (e.g. TensorFlow, PyTorch, Kueue, KubeRay, KubeFlow, Feast etc)
• Experience with AI and MLOps tools and Concepts, including Automation, GitOps, pipelines, models, etc. for managing the AI/ML lifecycle in production environments
• Interest in learning new technologies; problem-solving skills

Nice-to-haves

• Familiarity with model parallelization, quantization, and memory optimization using vLLM, DeepSpeed, OpenVino and other inference libraries
• Cloud Computing experience using at least one of the following Cloud infrastructures AWS, GCP, Azure & IBM Cloud
• Previous code contributions to or participation in open source projects or code samples on GitHub

Benefits

• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!