About the position
At AlertMedia, everything we do supports our mission: To save lives and minimize loss by identifying active threats globally and facilitating the timely communications when an emergency threatens personal safety and business continuity. Our core values drive us in our important mission of keeping people safe: We’re humans not robots, Customers always come first, We work better together, Simplicity is our strength, Our reputation is priceless, Hard work pays off. AlertMedia is looking for an innovative and hands-on AI/ML Software Engineer to lead the evaluation, training, and integration of advanced AI and machine learning models across our product suite. In this role, you will help shape our AI strategy by identifying the most appropriate models for our use cases, optimizing their performance through fine-tuning and prompt engineering, and ensuring their responsible deployment within our platforms. You will have the opportunity to show who you are throughout our interview process; we don’t ask any trick questions or expect you to perform a whiteboard exercise. We want to see you shine by showing us work you are most proud of!
Responsibilities
- Train and fine-tune supervised learning models (e.g., classification, ranking, embeddings) for internal tools and customer-facing product features.
- Lead prompt engineering and testing efforts to fine-tune LLM behavior for specific use cases across the product suite.
- Design and implement evaluation pipelines for both LLMs and traditional ML models.
- Develop tools and frameworks to support prompt iteration, model benchmarking, and performance tracking.
- Coordinate with security team to ensure adherence to AI compliance standards.
- Evaluate and compare commercial and open-source LLMs (e.g., OpenAI, Anthropic, Mistral, Meta, etc.) for performance, cost, alignment, and reliability.
- Collaborate with product and engineering teams to integrate AI features in a safe, scalable, and maintainable way.
- Monitor and improve the quality of models in production.
- Stay informed of emerging research in NLP, machine learning, and AI infrastructure, and evaluate potential applications for the business.
- Contribute to AlertMedia’s culture, values and vision for the future.
Requirements
- Bachelor’s degree in a technical field such as computer science, computer engineering or related field preferred.
- 2+ years of software engineering experience, Python preferred.
- 4–6+ years of experience in data science and/or software engineering, specifically in machine learning engineering, or applied AI.
- Strong understanding of LLMs and traditional machine learning methods.
- Experience with prompt engineering, model fine-tuning, and evaluation.
- Familiarity with model evaluation best practices, including offline metrics, cross-validation, and A/B testing.
- Proficiency in Python and ML libraries (e.g., scikit-learn, PyTorch, TensorFlow, Hugging Face).
- Experience with cloud-based ML tooling (e.g., SageMaker, Bedrock) and data workflows.
- Demonstrated experience training and deploying supervised learning models, ideally in production environments (a plus).
- Ability to work independently and collaboratively on cross-functional teams.
- Strong organizational skills and ability to manage working on multiple projects in parallel.
- The ability and desire to work in a fast-paced challenging environment.
- Outstanding communication skills and ability to effectively work cross-functionally in a fast-paced challenging environment.
- English proficiency (written and oral) is required.
Benefits
- Competitive base salary + Company-Wide Bonus program
- Generous and flexible time and parental leave policies
- Health benefits - Medical, Dental, Vision and Life Insurance 100% paid for employees!
- 401K with a generous company match
- Amazing rewards and incentives – we love celebrating each other!
- Commitment to community service with opportunities to give back
- A Best Places to Work company 9 years in a row and numerous other awards
- Access to brand new downtown office with 360 views of Austin, high-tech building gym, and nearby running trails
- Ongoing career development opportunities facilitated by our Learning & Development teams
