Salary: $161,800 - 201,400 per year
Requirements:
- Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 3 years of experience developing AI and ML algorithms or technologies, or a Masters degree in one of those fields plus at least 1 year of such experience
- At least 3 years of programming experience with Python, Go, Scala, CUDA, or Java
- Experience contributing to AI system components with tradeoff decisions involving cost, latency, throughput, and accuracy
- 4 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud
- Experience developing, delivering, and supporting AI services
- Experience building AI and ML algorithms or technologies such as LLM inference, similarity search and VectorDBs, guardrails, or memory using Python, C++, C#, Java, CUDA, or Golang
- Experience applying advanced techniques to optimize training and inference software for better hardware utilization, latency, throughput, and cost
- Experience building agentic AI systems and agent workflows
- Ability to evaluate and improve LLM performance using quantitative metrics such as accuracy, coherence, latency, and cost
- Hands-on experience with retrieval-augmented generation, vector database integrations, and fine-tuning workflows
- Experience applying prompt engineering, safety guardrails, and red-teaming methods to production AI systems
Responsibilities:
- Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how our customers interact with us
- Design, build, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability
- Use open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, and PyTorch
- Develop and introduce state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput in large-scale production AI systems
- Help shape the technical vision and long-term roadmap for foundational AI systems
- Lead development and benchmarking of multi-turn conversational and tool-using agent workflows, with measurable performance and safety metrics
- Implement scalable pipelines for training, fine-tuning, and deploying foundation or domain-specific models across multiple environments
- Work with research and data engineering teams to curate high-quality datasets and improve model evaluation approaches
- Contribute to governance and security efforts, including model traceability, lineage documentation, and version control of deployed AI assets
- Mentor junior AI engineers and promote engineering excellence, reproducibility, and responsible experimentation
Technologies:
- Agentic AI
- AI
- AWS
- Azure
- C#
- Cloud
- CUDA
- Fine-tuning
- Golang
- Hardware
- Support
- Java
- LLM
- Model Training
- PyTorch
- Python
- Scala
- Security
- Machine Learning
- RAG
More:
We are Capital One, building responsible and reliable AI systems to help change banking for good. Our Intelligent Foundations and Experiences (IFX) team is central to bringing our AI vision to life, partnering across the company to advance science and AI engineering and to deliver proprietary solutions that create value for millions of customers. We offer a comprehensive, competitive, and inclusive benefits package supporting total well-being, along with performance-based incentive compensation. This role includes salary ranges that vary by location, with positions listed in Cambridge, MA; McLean, VA; New York, NY; and San Jose, CA. We are an equal opportunity employer, committed to non-discrimination and a drug-free workplace.
last updated 46 week of 2026
You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.
