Salary: $286,200 - 392,000 per year
Requirements:
- Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 10 years of experience developing AI or ML algorithms or technologies; or a relevant masters degree and at least 8 years of that experience.
- At least 10 years of programming experience with Python, Go, Scala, CUDA, or Java.
- Experience architecting AI platforms and making trade-offs involving cost, latency, throughput, and accuracy.
- At least 9 years of experience deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or an equivalent private cloud.
- Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
- Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders, including at the SVP level.
- Experience developing AI and ML technologies, such as LLM inference, similarity search, vector databases, guardrails, or memory, using languages such as Python, C++, C#, Java, CUDA, or Golang.
- Experience applying advanced training and inference optimization techniques to improve hardware utilization, latency, throughput, and cost.
- Experience building agentic AI systems and workflows.
- Strong interest in current AI research and systems, with the judgment to apply new techniques in production.
- Excellent communication and presentation skills, including the ability to explain complex AI concepts to peers.
- Industry recognition in applied AI or ML infrastructure through patents, publications, or open-source leadership.
- Experience developing long-term AI infrastructure strategies that balance cost, scale, ethics, and regulatory compliance.
- Experience advancing organization-wide AI safety, alignment, and governance standards in collaboration with policy, risk, and legal teams.
- Ability to shape R&D investment strategy by identifying AI capabilities with significant business impact.
- Experience selecting model sizes, instance counts, and hardware types based on requirements such as context length and token volumes.
Responsibilities:
- Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for our associates and customers.
- Design, develop, test, deploy, and support AI software components, including foundation-model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use a broad range of open-source and SaaS AI technologies, such as AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
- Develop advanced foundation-model optimization techniques to improve the scalability, cost, latency, and throughput of production AI systems.
- Help shape the technical vision and long-term roadmap for our foundational AI systems.
- Define and guide our AI architecture, bringing applied research advances into reliable, scalable production environments.
- Establish AI performance, safety, and transparency standards for model development and deployment across the company.
- Lead multi-year platform initiatives that unify data, compute, and model lifecycle management within an enterprise AI architecture.
- Mentor senior technical leaders across research, data, and engineering disciplines.
Technologies:
- Agentic AI
- AI
- AWS
- Azure
- C#
- Cloud
- CUDA
- Golang
- Hardware
- Support
- Java
- LLM
- Machine Learning
- Model Training
- PyTorch
- Python
- Scala
More:
We are hiring a Senior Staff AI Engineer for our Agentic AI Platform, with remote work available. At Capital One, we build responsible, reliable AI systems to improve banking, drawing on our experience in machine learning, technology infrastructure, and personalized customer experiences. Our Intelligent Foundations and Experiences team works with partners across the company to advance AI science and engineering and build proprietary, scalable solutions used across our business. The role offers annual base salary ranges of $286,200–$326,700 for remote work; $314,800–$359,300 in Cambridge, Massachusetts, and McLean, Virginia; and $343,400–$392,000 in New York, New York, San Francisco, and San Jose, California. The position is also eligible for performance-based incentives and our health, financial, and other benefits, with eligibility varying by role status and level. We will consider sponsoring a qualified new applicant for employment authorization.
last updated 47 week of 2026
You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.
