Cybersecurity Analyst jobs

MTS - Research (Cybersecurity)

Collinear AISunnyvale, CA +2 placesFull-timeHybrid

Pay not listed

Key facts

Where
Sunnyvale, CA · San Francisco, CA · Bengaluru, India · hybrid
Degree
PhD

Looks real. 2 things to check before you apply.

On Collinear AI’s own careers site (Ashby), checked open today.

  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • To check: Posted by the employer 2 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Checked open todayAshby board
  • Checked: No reposts foundAshby board
  • Trust score 85 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Build isolated, reproducible cybersecurity environments and define tasks for agents to investigate and resolve security problems.
  • Reproduce vulnerabilities, develop reference fixes, and create verifiers that confirm remediation without breaking legitimate functionality.
  • Test graders against shortcuts and flawed fixes, and keep hidden solutions and test data separate from agent environments.
  • Run and analyze AI agents, then use findings to improve task coverage, difficulty, benchmarks, and training data.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Practical depth in at least one cybersecurity area, such as application security, vulnerability research, penetration testing, systems security, cloud security, or incident response
  • Disclosed vulnerabilities, accepted security patches, strong CTF results, or useful security tools and write-ups (preferred)
  • Experience with fuzzing, static or dynamic analysis, reverse engineering, or building security labs (preferred)
  • Experience building agent evaluations, adversarial tests, prompt-injection defenses, or reinforcement-learning environments (preferred)

Skills

  • Ability to read unfamiliar code, reproduce a security issue, understand its root cause, and implement or assess a fix
  • Strong programming skills in Python and at least one language used in the systems investigated, such as C/C++, Go, Java, JavaScript/TypeScript, or Rust
  • Comfort with Linux, Git, containers, debugging, and automated testing
  • Clear technical writing and careful judgment about what an evaluation does and does not demonstrate
  • Familiarity with CWE and OWASP classifications and how they relate to concrete software failures (preferred)

Other requirements

  • Curiosity about applying cybersecurity expertise to AI and willingness to learn how to evaluate tool-using agents

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Collinear AI’s careers site

Collinear AI builds environments, tasks, and evaluations that help frontier AI models improve at real work. We are growing our cybersecurity team and looking for someone who can turn practical security problems into environments where AI agents can investigate, act, and learn.

Show full descriptionShow less

We recently released CWE-bench https://cwe-bench.com/, a defensive cybersecurity benchmark with 100 held-out audit-and-patch tasks across 54 weakness types. Agents must find and fix vulnerabilities in real codebases, with checks that confirm the vulnerability is resolved and existing functionality still works. You will help build what comes next: richer cybersecurity environments, realistic tasks, and reliable ways to measure whether agents succeed.

You will own work from the initial security scenario through the runnable environment, task instructions, reference solution, and verifier. We are looking for hands-on security knowledge, strong programming skills, and curiosity about how AI agents fail.

Deep cybersecurity expertise is enough to get started—you do not need prior AI or machine-learning experience. If you know how to investigate vulnerabilities, reason about security failures, and verify that a fix works, we want to hear from you. We will teach you our AI tooling and evaluation workflows.

WHAT YOU WILL DO

  • Build cybersecurity environments. Create isolated, reproducible environments with real repositories, applications, services, logs, and access controls. Make them straightforward to launch, reset, and evaluate at scale.
  • Turn security work into tasks. Design scenarios around vulnerability discovery and remediation, application and API security, authentication and authorization, incident investigation, and system hardening. Define what the agent knows, which tools it can use, and what it must accomplish.
  • Develop reference solutions and verifiers. Reproduce the underlying issue, implement a valid solution, and write checks that distinguish a real fix from a superficial workaround. Verify that attacks fail after remediation while legitimate behavior continues to work.
  • Test the tests. Challenge graders with incomplete fixes, disabled features, hard-coded answers, and other shortcuts. Keep hidden solutions and test data out of the agent's environment, and separate genuine model failures from broken infrastructure.
  • Run and analyze agents. Evaluate frontier models, inspect their tool calls and code changes, and explain where their security reasoning or execution breaks down. Use those findings to improve task coverage and difficulty.
  • Contribute to benchmarks and research. Work with researchers and engineers to turn strong environments into evaluation suites and training data. Review other contributors' tasks and help document results for future releases.

WHO WE ARE LOOKING FOR

  • Practical depth in at least one area of cybersecurity, such as application security, vulnerability research, penetration testing, systems security, cloud security, or incident response. Evidence can come from internships, research, open-source work, bug bounties, CTFs, or independent projects.
  • The ability to read unfamiliar code, reproduce a security issue, understand its root cause, and implement or assess a fix.
  • Strong programming skills in Python and at least one language used in the systems you investigate, such as C/C++, Go, Java, JavaScript/TypeScript, or Rust.
  • Comfort with Linux, Git, containers, debugging, and automated testing.
  • Clear technical writing and careful judgment about what an evaluation does and does not demonstrate. You can explain why a task is realistic and why its grading is trustworthy.
  • Curiosity about applying your cybersecurity expertise to AI, and a willingness to learn how to evaluate tool-using agents. Prior experience with LLMs is not expected.

Recent graduates and early-career engineers or researchers are encouraged to apply. A PhD, professional certification, or previous role at an AI lab is not required. We value demonstrated ability and the quality of your work.

NICE TO HAVE

  • Disclosed vulnerabilities, accepted security patches, strong CTF results, or useful security tools and write-ups.
  • Experience with fuzzing, static or dynamic analysis, reverse engineering, or building security labs.
  • Familiarity with CWE and OWASP classifications and how they relate to concrete software failures.
  • Experience building agent evaluations, adversarial tests, prompt-injection defenses, or reinforcement-learning environments.

*EXAMPLES OF WHAT YOU MIGHT BUILD

  • A repository audit where an agent must discover and repair an authorization flaw without being told where it is.
  • A small service environment where an agent investigates suspicious activity from logs and configuration, then applies and verifies a remediation.
  • An LLM application where an agent must repair a prompt-injection or tool-permission weakness while preserving legitimate functionality.

*When applying, include a project, code sample, security write-up, or research artifact that shows how you investigate a problem and establish that your solution works.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Vulnerabilty Analyst

SpaceXSI · Austin, TX +3 places

$100k–$198k/yr

StrongChecked open todayPosted 1 month ago

IT Security Specialist

SK hynix America · San Jose, CA

$95k–$135k/yrOn-site

StrongChecked open todayPosted 12 days ago

See more like this