R

Intelligence Analyst – Remote (Worldwide)

  • RemoteJobsOne
  • Brazil
  • Remote
  • Contractor
  • $80–170 / hour
  • Posted today
Operations & AdminIntelligence AnalystIntelligence SpecialistAll Source Intelligence AnalysAI Evaluation Specialist

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If you do not see it, check your spam folder.

This is a fully remote position, open to candidates based in 55 countries, including Brazil, United States, United Kingdom, Canada, Germany, India, France, Netherlands.

Pay: $80–$170/hr

Role Title: Intelligence Analyst

Role Type: Contractor

Location: Remote

We are engaging Intelligence Analysts to contribute to a customer-facing project focused on evaluating and advancing artificial intelligence capabilities. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

  • Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
  • Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
  • Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
  • Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
  • Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.
  • Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
  • Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.

Preferred Qualifications

  • Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
  • Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
  • Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
  • Exceptional written and verbal communication skills, with a focus on clarity and precision.
  • Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
  • Familiarity with structured analytic techniques and intelligence tradecraft standards.
  • Previous participation in AI evaluation or model assessment initiatives is a plus.

Learn More About Our Government & Defense Work

with us, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.

Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.

Learn more: hiring platform/benchmark/mission-report

How to apply

Apply here with your profile. We will then email you a link to complete yourapplication on the hiring platform — your application is only considered oncethat final step is done.

Originally posted on Himalayas

Apply on Himalayas

You apply on Himalayas, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.

Get new jobs like this by email

Operations & Admin · Brazil

Free. Confirm by email first; unsubscribe anytime in one click.

Similar jobs

Intelligence Analyst – Remote (Worldwide) at RemoteJobsOne — Brazil | Rivet Commerce job board