CO

AI Engineer (MLX, Agentic AI)

  • Capital One
  • Mc Lean, United States
  • On-site
  • Full-Time
  • $229,900 - 286,200 per year
  • Posted yesterday
Data & AI

Salary: $229,900 - 286,200 per year

Requirements:

  • We require a bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 6 years of experience developing AI and ML algorithms or technologies, or a masters degree in one of those fields plus at least 4 years of equivalent experience.
  • We require at least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.
  • We prefer experience leading AI system development with tradeoff decisions across cost, latency, throughput, and accuracy.
  • We prefer 7 years of experience delivering scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud environments.
  • We prefer experience designing, building, delivering, and supporting complex AI systems.
  • We prefer experience developing AI and ML technologies such as LLM inference, similarity search, VectorDBs, guardrails, or memory using Python, C++, C#, Java, CUDA, or Golang.
  • We prefer experience applying advanced techniques to optimize training and inference software for better hardware utilization, lower latency, higher throughput, and reduced cost.
  • We prefer experience building agentic AI systems and agentic workflows.
  • We prefer strong communication and presentation skills, with the ability to explain complex AI concepts clearly to peers.
  • We prefer experience architecting and integrating heterogeneous AI systems, including rule-based, retrieval-augmented, and generative components, into unified production pipelines.
  • We prefer experience setting and enforcing standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review.
  • We prefer demonstrated ability to balance model performance and operating cost through dynamic inference strategies and model compression.
  • We prefer experience right-sizing models, instance counts, and hardware types based on requirements such as context length, token inputs, and token outputs.

Responsibilities:

  • We partner with cross-functional teams of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how our associates work and how our customers interact with us.
  • We design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • We leverage open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, PyTorch, and similar tools.
  • We invent and introduce state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput in large-scale production AI systems.
  • We contribute to the technical vision and long-term roadmap for foundational AI systems.
  • We design, implement, and optimize multi-model orchestration pipelines that integrate LLMs, vector search, and domain-specific models into unified systems.
  • We establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency.
  • We lead team design councils or design review boards to maintain technical consistency and alignment with AI engineering standards.
  • We mentor Principal- and Manager-level AI engineers and help raise organizational technical maturity through cross-domain learning.

Technologies:

  • Agentic AI
  • AI
  • AWS
  • Azure
  • C#
  • Cloud
  • CUDA
  • Golang
  • Hardware
  • Support
  • Java
  • LLM
  • Machine Learning
  • Model Training
  • PyTorch
  • Python
  • Scala

More:

Capital One is building responsible and reliable AI systems to transform banking, drawing on deep machine learning expertise, strong technology infrastructure, and world-class talent. Our Intelligent Foundations and Experiences (IFX) team sits at the center of our AI strategy, partnering across the company to advance science and AI engineering and to deliver proprietary solutions that serve millions of customers. This AI Engineer 5 role offers the chance to help shape scalable, high-performance AI infrastructure and innovative product experiences. The position includes location-based salary ranges for McLean, Cambridge, New York, San Francisco, and San Jose, plus eligibility for performance-based incentive compensation and a comprehensive benefits package supporting overall well-being. We also consider sponsorship for a new qualified applicant for employment authorization for this position.

last updated 46 week of 2026

Apply on DevITjobs

You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.

Get new jobs like this by email

Data & AI · United States

Free. Confirm by email first; unsubscribe anytime in one click.

Similar jobs

AI Engineer (MLX, Agentic AI) at Capital One — Mc Lean, United States | Peter Nowak