Data & AI jobs

Project Lion - Senior Prompt Engineer - Italy (Remote, Part-Time)

Welo GlobalRemote · Italy onlyPart-timePosted 8 months ago

Pay not listed

Key facts

Experience
4+ years
Degree
Bachelor's degree

Looks real. 1 thing to check before you apply.

On Welo Global’s own careers site (Lever), checked open today.

  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteLever board
  • Checked: Checked open todayLever board
  • Checked: No reposts foundLever board
  • Trust score 89 / 100 · Looks good

This job is outside the US, so these US-only checks are not applied: pay-transparency law, pay likely required by state law, US visa sponsorship wording.

See all 5 checksShow fewer
How we check

Summary, requirements and match are for US jobs for now.

Full job description

From Welo Global’s careers site

We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to leverage prompt engineering techniques to maximize model performance.

Show full descriptionShow less

Responsibilities: Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.   Run and supervise Automated Prompt Optimization (APO) tool, review the outputs, and flag when the APO reaches deadlocks or plateaus.   Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts.   Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.   Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.   Draft technical launch readiness justifications (Launch Certification Documentation) for final.  

Requirement: Language Skills : Native fluency in Italian and fluent in English.  Location:   Must be based in Italy. Education : Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.   Prompt Engineering & AI Expertise : At least 4 years' experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning.   Data Analysis : Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.   Technical Agility : Ability to quickly learn and master proprietary tools with minimal supervision.   Communication : Excellent verbal and written communication skills.  

Optional / Preferred Skills:   Familiarity with enterprise-grade LLM interfaces like the Goose API.   Experience in AI model evaluation, data science, computational linguistics, or software engineering.   Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.   Linguistic expertise, including an understanding of semantics and logic.  

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Data Engineer

Mindex · Remote · US only

$90k–$140k/yrFull-time

StrongChecked open todayPosted 8 days ago

Senior DataOps Engineer

Voyager Technologies, Inc. · Remote · US only

$140k–$180k/yr

StrongChecked open todayPosted 9 days ago

Senior Data Scientist

Figure Lending · Remote · location not stated

$132k–$198k/yr

StrongChecked open todayPosted 9 days ago

See more like this