Cybersecurity Engineer - AI Benchmarking
Gramian Consulting Group
Job description
About the role
A boutique IT consultancy is looking for an experienced Senior Software Security Engineer to build high-quality training and evaluation tasks for advanced AI coding models. Real-world software vulnerabilities, including CVEs, security advisories and open-source bug reports, are turned into realistic Harbor-format audit-and-patch tasks across several programming languages. The engagement is a 3-month, fully remote contractor assignment starting next week, at 40 hours per week.
Key responsibilities
- Source and investigate real-world vulnerabilities from CVEs, advisories, bug reports and open-source repositories
- Classify vulnerabilities by the most specific applicable CWE and map them to relevant OWASP Top 10 categories
- Reproduce security issues and build proof-of-vulnerability tests
- Build Harbor-format audit-and-patch tasks and write task instructions that hide vulnerable code, exploits and expected fixes
- Create reproducible Docker-based environments with pinned dependencies and clear setup instructions
- Design automated verifiers that prevent gaming, test manipulation, hardcoded solutions and overfitting
- Review and score AI-generated patches and reasoning using structured rubrics
- Identify tasks solvable by superficial pattern matching or copying known patches
- Document vulnerability context, reproduction steps, expected behavior, patch requirements, test methodology and review decisions
Required profile
- 5+ years of professional software engineering experience
- Expert-level proficiency in at least one of Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP or Kotlin
- Ability to independently reproduce vulnerabilities and build reproducible testing environments
- Excellent technical writing skills and ability to work independently in a fully remote, research-oriented setting
Required skills
- Software security principles, CWE, CVE and OWASP Top 10
- Security testing tools: sanitizers, fuzzers, CodeQL or Semgrep
- Git, Linux, Bash and Docker
- Creating automated tests and reproducible evaluation environments
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in India.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 hour ago
Expires 1 month from now
5 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Gramian Consulting Group
Related job offers
-
Software Engineer - Backend Distributed Systems
salesforce -
Mainframe Software Development and Quality Engineer
hcmportal IN - TDC 1 (IN110) -
SOC Analyst (3-6 Years)
tbc Hyderabad India -
Senior Software Engineer - AI (Machine Learning Engineer)
tbc Hyderabad India -
Senior Software Engineer II (.NET/C# Microservices)
tbc Hyderabad India