Sr. AL/ML Engineer
Markon · Annapolis Junction, MD, US · United States · On-site
Posted Oct 9, 2026
Sign up free: we match you to jobs like this, tailor your application and fill the form. 2 free applications every day.
Description
PLEX Solutions, A Part of Markon is looking for a Sr. AI/ML Engineer to support a program in the Annapolis Junction, MD area.
Responsibilities
Design and integrate LLM/agent orchestration workflows using agentic frameworks such as LangGraph, Agno, and the NVIDIA NeMo Agent Toolkit.
Tune model gateway routing logic to select, evaluate, and optimize across multiple frontier and open-weight models for cost, performance, and mission fit.
Develop and integrate RAG pipelines, vector databases, and memory services to give agents access to mission knowledge and context.
Implement MCP (Model Context Protocol)-based tool-broker integrations so agents can safely and securely access enterprise tools and data.
Evaluate, benchmark, and tune models and agent behaviors; build automated evaluation pipelines to track quality, safety, and performance over time.
Partner with data scientists and mission analysts to translate research and prototypes into production-grade AI capabilities for the command.
Implement AI governance guardrails — content/safety filters, policy enforcement, and approval gates — for agentic workflows, and document model/agent architectures and evaluation results for reuse.
Research and evaluate emerging LLM, agent, and AI tooling to keep the command's AI capability current and adaptable.
Qualifications
Active TS/SCI w/ Polygraph
Bachelor’s degree from an accredited college or university in Computer Science, Data Science, or a related discipline
8+ years of experience in engineering related discipline
Advanced proficiency in Python for AI/ML application development
Demonstrated experience building or integrating LLM/agent-based systems in production
Experience with retrieval-augmented generation (RAG), vector databases, and prompt/context engineering
Ability to manage competing priorities in fast-paced mission environments and identify/escalate operational risks early
Desired Qualifications
Experience supporting DoD cyber operations, or related mission environments
Experience with frameworks such as LangGraph, Agno, or the NVIDIA NeMo Agent Toolkit
Experience with model inference/serving platforms (NVIDIA NIM, vLLM, Ollama, LiteLLM)
Experience with MCP (Model Context Protocol) or similar tool-broker/integration standards
Experience with AI evaluation frameworks, model benchmarking, and observability (logs/metrics/traces) for AI workloads
Experience supporting DoD AI/cyber mission environments
Salary Range
USD $120,000.00 - USD $200,000.00 /Yr.The Markon pay range for this position is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.
Overview
Eager to join a team where your…