Senior Cybersecurity Engineer – AI Evaluation Projects

About the role

We are looking for seasoned cybersecurity professionals to design realistic evaluation tasks for advanced AI systems. This remote position focuses on creating enterprise‑grade security scenarios, reference solutions, and scoring rubrics that reflect senior‑level judgment.

Key responsibilities

• Develop realistic cybersecurity scenarios covering SOC operations, threat detection, incident response, vulnerability management, and security architecture.
• Produce reference incident reports, forensic analyses, security assessments, architecture designs, and compliance documentation.
• Integrate enterprise SIEM, EDR, cloud security, and GRC platforms into scenario design.
• Apply threat modeling, risk assessment, and security engineering methodologies to evaluate AI‑generated responses.
• Create scoring rubrics that differentiate senior expertise from generic answers.

Required profile

• 5+ years of professional experience in cybersecurity, security engineering, incident response, penetration testing, or GRC.
• Proven ownership of significant security programs, investigations, architecture decisions, or compliance initiatives.
• Strong understanding of enterprise security operations and real‑world threat response.
• Hands‑on experience with modern security tooling and frameworks.

Required skills

• SIEM
• EDR
• Vulnerability Management
• Cloud Security
• GRC platforms
• Threat Modeling
• Incident Response
• Risk Assessment
• Security Architecture
• Digital Forensics
• Malware Analysis
• Penetration Testing
• Security Operations
• Threat Hunting