Salary: $286,200 - 392,000 per year
Requirements:
- We require a bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 10 years of experience developing AI and ML algorithms or technologies, or a masters degree in one of those fields plus at least 8 years of experience in that work
- We require at least 10 years of programming experience with Python, Go, Scala, CUDA, or Java
- Preferred experience includes architecting AI platforms with tradeoff decisions around cost, latency, throughput, and accuracy
- Preferred experience includes 9 years of deploying scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud
- Preferred experience includes architecting, designing, developing, integrating, delivering, and supporting complex AI systems
- Preferred experience includes leading and mentoring multiple engineering teams and influencing cross-functional stakeholders up to the SVP level
- Preferred experience includes developing AI and ML technologies such as LLM inference, similarity search, VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang
- Preferred experience includes applying advanced techniques to optimize training and inference software for better hardware utilization, latency, throughput, and cost
- Preferred experience includes building agentic AI systems and agentic workflows
- Preferred experience includes staying current with the latest AI research and systems and applying new techniques thoughtfully in production
- Preferred experience includes excellent communication and presentation skills with the ability to explain complex AI concepts to peers
- Preferred experience includes recognition as an industry leader in applied AI or machine learning infrastructure through patents, publications, or open-source leadership
- Preferred experience includes designing long-term AI infrastructure strategies while balancing cost, scale, ethics, and regulatory compliance
- Preferred experience includes driving organization-wide adoption of AI safety, alignment, and governance standards in partnership with policy, risk, and legal teams
- Preferred experience includes shaping R&D investment strategy by identifying breakthrough AI capabilities with meaningful business impact
- Preferred experience includes right-sizing models, instance counts, and hardware types based on requirements such as context length, token inputs, and token outputs
Responsibilities:
- We partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how customers interact with Capital One
- We design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents, multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability
- We use a broad stack of open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, and PyTorch
- We invent and implement advanced foundation model optimization methods to improve the scalability, cost, latency, and throughput of large-scale production AI systems
- We contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One
- We define and guide the technical AI architecture vision, bringing applied research breakthroughs into production systems with reliability and scale
- We lead the creation of AI performance, safety, and transparency standards that shape model development and deployment across the company
- We drive multi-year platform initiatives that unify data, compute, and model lifecycle management within a cohesive enterprise AI architecture
- We mentor senior technical leaders across research, data, and engineering disciplines and help develop the next generation of our AI technical leadership
Technologies:
- Agentic AI
- AI
- AWS
- Azure
- C#
- Cloud
- CUDA
- Golang
- Hardware
- Support
- Java
- LLM
- Machine Learning
- Model Training
- PyTorch
- Python
- Scala
More:
We are building responsible, reliable AI systems that are changing banking for good. Our Intelligent Foundations and Experiences (IFX) team sits at the center of our AI vision, working closely with partners across the company to advance science and AI engineering and deliver proprietary solutions that create value for millions of customers. We provide a supportive environment with competitive compensation, performance-based incentive opportunities, and a comprehensive benefits package focused on total well-being. This role includes location-based salary ranges for Cambridge, McLean, New York, Richmond, San Francisco, and San Jose, and we may consider sponsorship for a new qualified applicant for employment authorization. We are an equal opportunity employer committed to non-discrimination and a drug-free workplace.
last updated 47 week of 2026
You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.
