AI Context Engineer

CACI International • Chesapeake, VA

3d

About The Position

Make a difference and join an enthusiastic team looking to make a difference in the lives of today’s military! CACI is looking for an experienced senior-level developer with strong interpersonal and communication skills as well as a record of accomplishment in successful project execution. The Developer must have independent drive if working remote. Working for DHA and Naval Information Warfare Center Atlantic for a Navy Medicine Online Project. The project is within the Defense Health Readiness Engineering portfolio.

Requirements

• Secret Clearance or the ability to obtain a secret clearance
• Develop and maintain software requirements as it relates to user requirements and existing software defects
• Knowledge of DevSecOps, agile development and the context engineering lifecycle
• Knowledge and experience with JavaScript
• Knowledge of JSON
• Knowledge of source code versioning
• System Test and Evaluation, planning execution and management.
• Education: University degree (BA/BS) or 5+ years of experience.
• Experience: 3+ years of professional software engineering experience, with 1+ years working directly with large language models in production.
• Demonstrable hands-on experience building or shipping LLM-powered applications or features.
• Experience with at least one major LLM API platform: OpenAI, Anthropic, Google Gemini, Cohere, or equivalent.
• Familiarity with prompt engineering techniques: chain-of-thought, few-shot prompting, structured output, tool/function calling.

Nice To Haves

• Demonstrated writing/editing skills
• Ability to work under pressure and multitask in a fast-paced environment
• Able to work with highly technical IT personnel, understand technical tasking, and explain technical activities to non-technical individuals Excellent interpersonal and communication skills

Responsibilities

• Design and maintain context pipelines that retrieve, rank, compress, and assemble information for LLM inputs
• Define and enforce context schemas, prompt templates, and structured data contracts across AI features
• Develop strategies for dynamic context window management — balancing relevance, recency, and token budget
• Architect retrieval-augmented generation (RAG) systems, including chunking strategies, embedding selection, and reranking layers
• Craft, iterate on, and systematically test system prompts and few-shot examples that reliably elicit desired model behaviors
• Build evaluation frameworks to measure prompt quality, instruction-following accuracy, and output consistency
• Identify and mitigate failure modes such as hallucination, instruction drift, context confusion, and context stuffing
• Maintain a prompt library and versioning system to support reproducibility and regression testing
• Build internal tooling for context inspection, token counting, and prompt debugging
• Integrate with vector databases (e.g., Pinecone, Weaviate, pgvector) and semantic search infrastructure
• Implement memory systems, conversation state management, and session persistence for multi-turn AI applications
• Collaborate with DevOps/MLOps to deploy and monitor context pipelines in production environments
• Stay current with LLM research: context window advances, long-context models, sparse attention, and retrieval techniques
• Prototype and evaluate new approaches to context construction, summarization, and compression
• Document findings, failure analyses, and architectural decisions for the broader team
• Mentor junior engineers and contribute to internal knowledge sharing on prompt engineering

Benefits

• Our employees value the flexibility at CACI that allows them to balance quality work and their personal lives.
• We offer competitive compensation, benefits and learning and development opportunities.
• Our broad and competitive mix of benefits options is designed to support and protect employees and their families.
• At CACI, you will receive comprehensive benefits such as; healthcare, wellness, financial, retirement, family support, continuing education, and time off benefits.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level