Data & AI jobs

Professionals: Designing Challenging AI Prompts

TeracRemote · US onlyContract

$20/hr listed by the employer

Key facts

Pay per year
≈ $42kEstimate for full-time hours.

This job is closed.

The employer took it down 18 days ago, after 3 days open. Here are similar open jobs.

  • To check: Mentions a talent pool or pipelineWhy: “We're running a paid study to build a bench of people who are exceptionally good at designing tasks that expose AI model limitations.”Some postings collect applications for later. Ask if there is an opening now.
  • To check: Posted by the employer 2 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • Checked: On the company's own careers siteAshby board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundAshby board
  • Trust score 75 / 100 · Looks good
See all 6 checksShow fewer
How we check

Similar jobs

TEMPLATE

Terac · Remote · US only +1 place

Pay not listedContract

Looks good2 to checkChecked open todayPosted 3 months ago

See more like this

What you’ll do

  • Translate a familiar professional or personal workflow into a demanding AI prompt.
  • Test the prompt in ChatGPT, identify failure points, and refine it if the model succeeds.
  • Write a comprehensive rubric for evaluating AI responses.
  • Complete the task while sharing your screen, camera, and microphone, then submit the prompt, failure notes, rubric, and generated output file.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Deep familiarity with a specific professional or personal workflow

Skills

  • Ability to quickly evaluate the accuracy and quality of AI outputs

Other requirements

  • Access to a laptop or desktop computer
  • An active ChatGPT account
  • Comfortable being screen-recorded while thinking through complex tasks

Benefits

Other
$20 one-time compensation

Full job description

From Terac’s careers site

WHAT WE'RE RESEARCHING

We're running a paid study to build a bench of people who are exceptionally good at designing tasks that expose AI model limitations. By turning real-world workflows into demanding requests, we can better evaluate where current models break down. This initial trial helps us identify individuals suited for ongoing prompt engineering and evaluation work.

HOW IT WORKS

Show full descriptionShow less

You will spend about an hour translating a complex workflow from your job or personal life into a demanding prompt that requires reasoning and real-world lookup. After running it in ChatGPT to identify where the model fails, you will refine the prompt until it breaks the system. Finally, you will write a clear grading rubric that a stranger could use to evaluate any AI's attempt at your task. This entire process is screen-recorded, as we are assessing your thought process just as much as the final submitted files.

WHO THIS IS FOR

We welcome professionals, domain experts, and power users who have deep knowledge of specific workflows. You need to be capable of evaluating an AI's output within seconds and comfortable working on a laptop or desktop with a ChatGPT account. Candidates who excel at this trial will be considered for a long-term bench of evaluators.

WHAT YOU'LL DO

  • Pick a familiar workflow and convert it into a demanding AI prompt
  • Test your prompt in ChatGPT to find failure points, making it harder if the AI succeeds
  • Write a comprehensive rubric for grading the AI's performance
  • Share your screen, camera, and microphone while completing the task
  • Submit your prompt, failure notes, rubric, and the generated output file

WHO SHOULD APPLY

  • Deep familiarity with a specific professional or personal workflow
  • Ability to quickly evaluate the accuracy and quality of AI outputs
  • Access to a laptop or desktop computer
  • An active ChatGPT account
  • Comfortable being screen-recorded while thinking through complex tasks

COMPENSATION

$20 one-time

READY TO PARTICIPATE?

Start your paid interview now https://terac.com/interview/start/r/bac94240-9ba4-477a-bb8d-9b3b2af686d2?utm_source=ashby_listing_description

ABOUT TERAC

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Learn more at terac.com https://terac.com or on YouTube at @jointerac https://www.youtube.com/@jointerac.

Something wrong with this job? Report it · This flag looks wrong