Cybersecurity Engineer - AI Benchmarking Lead
Gramian Consulting Group
Job description
About the role
A boutique IT consultancy is looking for an experienced Lead Software Security Engineer to lead a team of trainers building training and evaluation tasks for frontier AI coding models. The project turns real-world open-source vulnerabilities (CVEs, security advisories, bug reports) into Harbor-format audit-and-patch tasks across several programming languages, testing whether AI systems can identify, understand, reproduce and remediate vulnerabilities. This is a 3-month, fully remote contractor assignment starting next week, at 40 hours per week, with a minimum of 4 hours of overlap with PST.
Key responsibilities
- Plan task deliveries by batch, assign work to pod members and track daily throughput against phase targets
- Monitor pod performance, resolve bottlenecks and ensure tasks move through production stages on schedule
- Lead weekly client reporting, communicate delivery status and escalate risks such as tooling issues, rate limits, safety blocks and resource constraints
- Clarify requirements and scope with the client, including volume, complexity and difficulty changes
- Review completed tasks for quality, security, reproducibility and evaluation standards
- Train and calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty and acceptance criteria
- Forecast staffing needs from throughput and quality data, and run hiring and onboarding waves about three weeks ahead of capacity needs
- Contribute hands-on: research vulnerabilities, reproduce issues, write proof-of-vulnerability tests and create or review benchmark tasks during peak load
- Maintain documentation of delivery plans, risks, quality findings, throughput metrics, staffing forecasts and project decisions
Required profile
- 6+ years of professional software engineering experience
- Proven track record on this project or equivalent software security dataset, benchmark development or security evaluation work
- Ability to work independently in a fully remote, research-oriented environment
- Experience reviewing technical work and mentoring engineers, trainers or contributors
Required skills
- Expert-level proficiency in Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, Swift or another listed language
- Understanding of CWE, CVE and OWASP Top 10
- Hands-on experience with sanitizers, fuzzers and static analysis tools such as CodeQL or Semgrep
- Strong Git, Linux, Bash and Docker skills
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in India.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 hour ago
Expires 1 month from now
6 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Gramian Consulting Group
Related job offers
-
Software Engineer - Backend Distributed Systems
salesforce -
Mainframe Software Development and Quality Engineer
hcmportal IN - TDC 1 (IN110) -
SOC Analyst (3-6 Years)
tbc Hyderabad India -
Senior Software Engineer - AI (Machine Learning Engineer)
tbc Hyderabad India -
Senior Software Engineer II (.NET/C# Microservices)
tbc Hyderabad India