CO

Director AI Engineering (Remote Eligible)

  • Capital One
  • Remote · New York, United States
  • Remote
  • Full-Time
  • $244,700 - 335,100 per year
  • Posted yesterday
Data & AI

Salary: $244,700 - 335,100 per year

Requirements:

  • Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 8 years of experience developing AI/ML algorithms or technologies; or a masters degree in one of these fields and at least 6 years of relevant experience.
  • At least 3 years of people leadership experience.
  • Preferred: 5 years of experience managing and leading an engineering team.
  • Preferred: 7 years of experience building and operating large-scale ML or GPU training infrastructure on a cloud platform, such as AWS, Google Cloud, Azure, or an equivalent private cloud.
  • Preferred: Hands-on experience with large-scale distributed training, including multi-node, multi-GPU jobs and parallelism strategies such as PyTorch FSDP, DeepSpeed, or Megatron; proficiency in Python, Go, C++, or CUDA.
  • Preferred: Experience with ML orchestration and scheduling tools such as Kubernetes, Kubeflow, Kueue, Slurm, Ray, KServe, or vLLM.
  • Preferred: Experience operating large GPU fleets, with a focus on reliability, fault tolerance, utilization, and cost efficiency.
  • Preferred: Experience sizing GPU clusters, instance types, interconnects, and quotas to meet training and experimentation workload requirements.
  • Preferred: Strong interest in current AI and ML systems research and the ability to apply new training and optimization techniques judiciously.
  • Preferred: Excellent communication and presentation skills, including the ability to explain complex AI and infrastructure topics to peers.
  • Preferred: Experience building and leading a multi-team AI organization delivering multiple enterprise capabilities concurrently.
  • Preferred: Demonstrated ability to develop and execute long-term AI platform strategies aligned with enterprise priorities and regulatory frameworks.
  • Preferred: Experience establishing cross-functional operating rhythms and review processes, such as OKRs, AI governance councils, and quarterly reviews.
  • We value strong engineering and mathematical foundations, technical depth across hardware, software, and AI, sound judgment, adaptability, curiosity, clear communication, and a commitment to responsible work.
  • We seek leaders who mentor and coach others, lead by example, encourage learning, and can bring clarity to ambiguous challenges.

Responsibilities:

  • Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for our associates and customers.
  • Oversee the design, development, testing, deployment, and operation of core platform systems for distributed training and fine-tuning, reinforcement learning, GPU scheduling, job resilience, utilization, and model experimentation and evaluation.
  • Make build-versus-buy decisions across open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
  • Develop and introduce techniques to improve the scalability, cost, throughput, and reliability of large-scale distributed training and fine-tuning.
  • Plan GPU capacity and govern costs by sizing clusters, instance types, and quotas to support training and experimentation across teams.
  • Shape the technical vision and long-term roadmap for our foundational AI systems.
  • Recruit and retain AI talent and support the personal and professional development of your team.
  • Foster a learning culture that keeps teams current with advances in AI.
  • Translate our enterprise AI strategy into portfolio-level execution plans across product areas, balancing innovation with disciplined delivery.
  • Scale AI engineering practices through shared infrastructure, reusable components, and consistent observability and governance frameworks.
  • Establish enterprise standards for Responsible AI, including fairness metrics, model evaluation protocols, documentation, and audit readiness.
  • Work with research, compliance, and enterprise risk teams to ensure deployed systems meet evolving ethical and regulatory standards.

Technologies:

  • AI
  • AWS
  • Azure
  • Cloud
  • CUDA
  • Fine-tuning
  • Hardware
  • Support
  • Kubeflow
  • Kubernetes
  • Machine Learning
  • PyTorch
  • Python
  • vLLM
  • NodeJS
  • REST

More:

At Capital One, we use technology and machine learning to create personalized customer experiences and make banking simpler. Our Generative AI Training team builds the platform our scientists and engineers use to train, fine-tune, and experiment with foundation models at scale, including GPU clusters, distributed training infrastructure, and self-service model environments. This Director, AI Engineering role is remote eligible. The position offers performance-based incentive compensation and a comprehensive package of health, financial, and other benefits; eligibility varies by employment status and management level. The posted full-time annual salary ranges are $244,700–$279,200 for remote roles; $269,100–$307,200 in Cambridge, Massachusetts, and McLean, Virginia; and $293,600–$335,100 in New York, New York; San Francisco, California; and San Jose, California. Pay for other locations depends on the applicable location range, and the final amount is stated in the offer. We will consider sponsoring a new qualified applicant for employment authorization. We are an equal opportunity employer and consider applicants in accordance with applicable laws.

last updated 47 week of 2026

Apply on DevITjobs

You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.

Get new jobs like this by email

Data & AI · United States

Free. Confirm by email first; unsubscribe anytime in one click.

Similar jobs

Director AI Engineering (Remote Eligible) at Capital One — Remote · New York, United States | Rivet Commerce job board