Data Analyst – Remote (2‑Month Contract)

About the role

We are seeking a detail‑oriented Data Analyst to join our team on a two‑month contract. The role focuses on evaluating and annotating outputs from large language models, ensuring high quality, accuracy, and structured reasoning.

Key responsibilities

• Perform side‑by‑side (SxS) evaluations of model outputs, comparing results and assessing relevance.
• Conduct fact‑checking to validate information and flag inconsistencies.
• Provide clear, well‑structured justifications for evaluation decisions.
• Use browser‑based tools and extensions to support analysis and review tasks.
• Execute simple command‑line instructions when required.
• Document findings and communicate insights to stakeholders.

Required profile

• Prior experience with evaluation, annotation, quality assurance, or audit‑type work.
• Familiarity with data quality, content evaluation, or model/output assessments.
• Background in business analysis, operations, or process improvement is a plus.
• Comfortable working on a computer with browser extensions and online tools.
• Ability to run basic command‑line commands (no advanced programming needed).
• Available full‑time (40 hrs/week) with 4–5 hrs overlap with PST.

Required skills

• Command‑line interface basics
• Browser‑based analysis tools

What we offer

• Short‑term contract with immediate start
• Fully remote work environment
• Opportunity to contribute to cutting‑edge LLM evaluation projects