HUD builds the infrastructure for training and evaluating AI agents. Our platform lets teams create reinforcement learning (RL) environments, benchmarks and evaluations, and our marketplace connects data vendors with frontier AI labs.
You will run AI data and evaluation projects for frontier AI labs, from scoping to delivery.
Key responsibilities
- Own data and evaluation projects end to end: scoping, planning, QA, delivery and retrospectives
- Turn ambiguous customer requests into specifications with milestones, owners, dependencies and acceptance criteria
- Run data quality checks using quantitative metrics and qualitative review
- Manage external data vendors and improve delivery pipelines
- Work with research, platform and marketplace teams to turn customer feedback into product improvements
Requirements
- Degree in Computer Science, Engineering or a related field, or equivalent practical experience
- At least 1 year managing complex technical projects in AI/ML, data operations, support engineering or applied research
- Strong quantitative and qualitative judgement about data
- Ability to structure ambiguous problems and make trade-offs without a full specification
- Strong written and verbal communication
Good to have
- Experience with RLHF, RL environments, agent evaluations or annotation pipelines
- Experience supporting AI labs or enterprise customers
Work location: On-site at our Singapore office, 9 Battery Road (Raffles Place). Full-time, permanent. 21 days of annual leave; CPF contributions for eligible employees.
You apply on MyCareersFuture, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.