Software Engineering jobs

Engineering & Software Domain Expert

Weekday AICalifornia City, CAContractHybridPosted 2 months ago

$65–$105/hr listed by the employer

Key facts

Pay per year
≈ $135k–$218kEstimate for full-time hours.
Schedule
40 hours a week
Experience
4+ years
Degree
Bachelor's degree

This job is closed.

The employer took it down 19 days ago, after 2 days open. Here are similar open jobs.

  • Checked: On the company's own careers siteWorkable board
  • Checked: Pay range listedJob posting
  • Checked: No reposts foundWorkable board
  • Trust score 89 / 100 · Looks good
See all 4 checksShow fewer
How we check

Similar open jobs

Software Engineer

talentpluto · San Francisco, CA

$165k–$250k/yrFull-timeOn-site

StrongChecked open todayPosted yesterday

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

See more like this

What you’ll do

  • Review engineering tasks and model outputs for correctness, reasoning quality, missing behaviors, and edge cases.
  • Write instruction specifications, golden solutions, and realistic engineering tasks.
  • Design engineering benchmarks and evaluation sets, and help develop engineering-specific skills and tools.
  • Calibrate evaluation standards with researchers and specialists, translating engineering judgment into explicit criteria.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 4+ years of substantive professional engineering practice building and shipping production software or engineered systems
  • Specialization in at least one engineering area
  • Progression to a senior level, such as Senior, Staff, Principal, Architect, or Engineering Lead, with ownership of systems and design decisions
  • Hands-on professional use of large language models
  • Visible record of engineering output, such as shipped systems, granted patents, open source contributions, or published technical work (preferred)

Education

  • Bachelor's degree or higher in computer science, software engineering, or a closely related engineering discipline
  • MS or PhD (preferred)

Other requirements

  • Availability for 40 hours per week for an initial 6-month engagement
  • Live in the Bay Area, California, and work on-site multiple days each week when required; candidates outside the area must relocate at their own cost before the engagement starts

Full job description

From Weekday AI’s careers site

This role is for one of our clients

Compensation: $65-$105 per hour

We are hiring a senior engineering and software domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models reason about real engineering and software development work.

Your engineering expertise is the substance of this role. You will review the quality of engineering knowledge work tasks, write the instruction specs and golden solutions that define what "correct" looks like, and build the benchmarks that show whether the model is genuinely improving. We are looking for a practicing specialist rather than a generalist.

Show full descriptionShow less

Location: This is a hybrid role based in the Bay Area, California. You must live in the Bay Area and work on-site with the client's team multiple days each week, when required. This is not a remote role. If you do not currently live in the Bay Area, you must be willing to relocate there at your own cost before the engagement starts. Relocation assistance is not provided.

Requirements

Key Responsibilities

  • Data QA and reviews: Vet the quality of engineering knowledge work tasks and model outputs, spotting missing behaviors, thin reasoning, code that runs but is subtly wrong, unhandled edge cases, and answers that read well but would not survive a real code review.
  • Instruction specs and golden datasets: Write high-quality instruction specs, produce golden solutions to engineering problems, and define new engineering tasks that reflect how the work is actually done in practice.
  • Benchmarks and domain depth: Design challenging engineering tasks and evaluation sets, and help build engineering-specific skills and tools together with the research team.
  • Calibration: Work with client researchers and specialists in adjacent fields to keep standards consistent, translating tacit engineering judgment into explicit, teachable criteria.

Core Qualifications

  • Education: Bachelor's degree or higher in computer science, software engineering, or a closely related engineering discipline. An MS or PhD is strongly preferred.
  • Experience: 4+ years of substantive professional engineering practice, building and shipping production software or engineered systems at a reputable organization. Internships and academic coursework alone do not count.
  • Domain depth: Genuine specialization in at least one area, for example distributed systems and backend infrastructure, security and cryptography, embedded and firmware, machine learning systems, developer tooling and platform engineering, or quality and test engineering.
  • Seniority: Clear progression to a senior level, for example Senior, Staff, Principal, Architect, or Engineering Lead, with real ownership of systems and design decisions.
  • Technical evidence: A visible record of engineering output such as shipped systems, granted patents, open source contributions, or published technical work. Preferred.
  • AI fluency: Hands-on working use of large language models in your professional work, and the judgment to tell a well-reasoned answer from a plausible-sounding wrong one.
  • Availability: Able to commit reliably to 40 hours per week for an initial engagement of 6 months.
  • Location: Living in the Bay Area, California, and able to work on-site with the client's team multiple days each week, when required. Candidates not currently based in the Bay Area must be willing to relocate there at their own cost. Relocation assistance is not provided.
  • Excellent written communication, and the ability to give precise, well-structured written feedback.

Something wrong with this job? Report it · This flag looks wrong