Indiana jobs

AI Prompt Engineer

AuthenticxIndianapolis, INHybridNo US visa sponsorshipPosted 24 days ago

Pay not listed

Looks real. 1 thing to check before you apply.

On Authenticx’s own careers site (Greenhouse), checked open today.

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: No reposts foundGreenhouse board
  • Trust score 89 / 100 · Looks good
See all 5 checksShow fewer
How we check

What you’ll do

  • Design and implement LLM prompts based on internal scoring rubrics and customer needs.
  • Test and evaluate prompts using labeled datasets to measure accuracy.
  • Work with engineering to improve tooling and infrastructure for LLM scoring workflows.
  • Maintain a reusable prompt library and document prompt strategies, tests, and outcomes.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Ability to collaborate effectively with both technical and non-technical teams
  • Experience in structured data labeling or QA workflows (preferred)

Education

  • Background in linguistics, cognitive science, or HCI (preferred)

Skills

  • Strong understanding of LLMs, NLP systems, and prompt engineering concepts
  • Ability to structure and document complex logic in a scalable and repeatable manner
  • Familiarity with LangChain, OpenAI/GPT APIs, or vector databases (preferred)
  • Proficiency in Python or scripting tools for evaluation or automation (preferred)

Other requirements

  • Analytical mindset with an interest in experimentation, iteration, and data-driven decision-making
  • Authorized to work in the U.S. without current or future visa sponsorship

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Free health insurance options; medical, life, and disability insurance, HSA and FSA plans
Dental & vision
Dental and vision insurance
Retirement plan
401(k)
Paid time off
Unlimited vacation time, generous paid holidays, and sick leave
Parental leave
Paid parental leave
Other
Hybrid working flexibility, Perks at Work membership with discounts on shopping, travel, and more

Full job description

From Authenticx’s careers site

Who is Authenticx?

Authenticx is on a mission to help humans understand humans. Our software platform is the new standard for humanizing customer interaction data at scale. We do this by channeling our passion and talent into helping health care leaders listen to their conversational data in a way that delivers value to the enterprise.

What do we offer our team members?

  • A culture based on our core values of Authenticity, Courage and Having Fun
  • A collaborative environment that supports your personal and professional development
  • Hybrid working flexibility
  • Free health insurance options
  • Comprehensive benefits - medical, vision, dental, life, and disability insurance
  • HSA and FSA plans
  • 401(K)
Show full descriptionShow less
  • Unlimited vacation time
  • Generous paid holidays, sick leave, and parental leave
  • Perks at Work membership for discounts on shopping, travel and much more

Position Summary

The AI Prompt Engineer will lead the design, development, and optimization of large language model (LLM) prompts used for scalable conversation scoring at Authenticx. This role is critical in translating objective scoring rubrics into reusable, testable prompt logic that supports our enterprise healthcare clients. The engineer will collaborate across teams including engineering, implementation, product, and data labeling to deliver reliable and high-quality prompt workflows. This is a hands-on role suited for someone who thrives in an experimental, iterative environment and has an interest in scaling natural language solutions.

Key Responsibilities

  • Design and implement sophisticated LLM prompts aligned to internal scoring rubrics and customer-specific needs.
  • Conduct prompt testing and evaluation using labeled datasets to ensure performance accuracy.
  • Collaborate with engineering to improve tooling and infrastructure for managing LLM scoring workflows.
  • Maintain a centralized prompt library to ensure reuse and standardization across use cases.
  • Document prompt strategies, testing approaches, and outcomes for internal learning.
  • Identify and resolve inefficiencies in the prompt development and deployment process.
  • Partner with product and data labeling teams to improve the quality and consistency of scoring outputs.

Required Qualifications

  • Strong understanding of LLMs, NLP systems, and prompt engineering concepts.
  • Ability to structure and document complex logic in a scalable and repeatable manner.
  • Demonstrated ability to collaborate effectively with both technical and non-technical teams.
  • Analytical mindset with an interest in experimentation, iteration, and data-driven decision-making.

Preferred Qualifications

  • Experience in structured data labeling or QA workflows.
  • Familiarity with tools like LangChain, OpenAI/GPT APIs, or vector databases.
  • Background in linguistics, cognitive science, or HCI.
  • Proficiency in Python or scripting tools for evaluation or automation.

Additional Information

  • May include occasional travel for team meetings or planning sessions
  • Must be authorized to work in the U.S. without current or future visa sponsorship.
  • This role will be hybrid based out of our Indianapolis office,

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Account Executive

Authenticx · Indianapolis, IN

Hybrid

StrongPay not listedChecked open todayPosted 1 month ago

Insights Storyteller

Authenticx · Remote · US only

Looks goodPay not listedChecked open todayPosted 1 month ago

AI Engineer

Foundation Medicine · Boston, MA

$111k–$139k/yrHybrid

StrongChecked open todayPosted 19 days ago

AI Engineer

M9 Solutions (agency) · Washington, DC

$60k–$180k/yr · see postingFull-timeHybrid

Wide pay rangeChecked open todayPosted 1 month ago

Lead AI Engineer

Perficient · Dallas, TX

$134k–$171k/yrHybrid

StrongChecked open todayPosted 5 days ago

See more like this