Sr. Full Stack Software Engineer (AI Infrastructure)

Bitwise • Laurel, MD

22d • $250,000 - $315,000

About The Position

Join us in building the next generation of AI infrastructure that will power innovation across the customer organization. We’re seeking a senior full-stack software engineer to support our AI infrastructure team. In this role, you’ll lead the development and operation of critical AI platform components, with a focus on scalable inference services and the broader AI application ecosystem. This role includes project leadership responsibilities and people care for a small, integrated team within a larger AI platform organization.

Requirements

• Active TS/SCI with Polygraph.
• Extensive experience designing, building, and operating large-scale production systems.
• Deep expertise in systems integration across diverse technologies and platforms.
• Hands-on experience with cloud engineering in AWS.
• Advanced proficiency with Kubernetes administration and deployment patterns
• Strong Python programming skills.
• Experience implementing and scaling observability solutions (APM, OpenTelemetry, Grafana, Prometheus).
• Proven ability to lead technical initiatives and influence organizational change.
• Experience developing technical policies and governance frameworks.
• Excellent communication, stakeholder management, and leadership skills.
• Ability to balance hands-on engineering with leadership and coordination responsibilities.
• Twelve (12) years with a Bachelor’s or four (4) additional years without the degree.

Nice To Haves

• Experience with AI inference serving technologies (vLLM, LiteLLM, etc.).
• Previous experience with agentic frameworks (LangChain).
• Knowledge of vector databases and embedding systems.
• Experience with high-performance computing or distributed systems.
• Track record of successfully driving technical and cultural change.

Responsibilities

• Maintain an active TS/SCI with Polygraph. Candidates without a current clearance will not be considered.
• Design, implement, and optimize infrastructure for AI model inference at scale.
• Lead the development and maintenance of production AI services and applications, including retrieval augmented generation (RAG), autonomous agents, and emerging technologies.
• Serve as technical lead for AI infrastructure initiatives, coordinating work across integrated teams.
• Conduct regular one-on-ones and provide coaching, feedback, and support for assigned team members.
• Act as the team point of contact (POC) for contract administration functions.
• Navigate ambiguity and define solutions for complex, underspecified systems and requirements.
• Establish new technical policies, standards, and governance frameworks where gaps exist.
• Drive adoption of new technologies and practices across engineering teams.
• Implement and oversee monitoring, logging, and observability solutions for AI services.
• Ensure high availability, reliability, performance, and security of AI platform components.
• Communicate effectively with stakeholders at multiple organizational levels.

Benefits

• Top salaries because we're top performers
• Pick your PTO – Everyone values time and money differently, so we give you the flexibility to choose between 3 and 5 weeks of PTO with a corresponding adjustment to your pay. Your choice, your balance.
• All 11 federal holidays, paid!
• Up to 2 snow days, paid!
• We’ll quadruple (4x!) the first 6% you contribute to your 401(k), giving you up to a 24% company match. Contributing less than 6%? Unclaimed matches come right back to you as extra income, giving you a guaranteed 24% that goes to your retirement, to your paycheck, or both. C’mon now! 🚀
• 100% employer-paid medical, dental, vision, life, and disability insurances. That’s a lot. Already covered on health insurance? No problem – we’ll trade you this benefit for a boost to your salary instead.
• $5,250 annual education assistance for training, certifications, tuition, and even student loan repayments.
• Spot bonuses for obtained certifications, customer recognition, and just about anything else that makes us go "Hot damn!". We hope to say that many times about you. 🔥

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level