Machine Learning Engineer jobs

AI Modeling Engineer

Palona AILos Altos, CA +1 placeFull-time

Pay not listed

Key facts

Where
Los Altos, CA · New York, NY
Experience
3+ years

Looks real. 2 things to check before you apply.

On Palona AI’s own careers site (Workable), checked open today.

  • To check: Posted by the employer 3 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listed, though one is likely required in CA, NYAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteWorkable board
  • Checked: Checked open todayWorkable board
  • Checked: No reposts foundWorkable board
  • Trust score 80 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Develop modeling strategies and evaluate models for voice, language, reasoning, ordering, multilingual, and multimodal agent tasks.
  • Build datasets, evaluation methods, and analysis tools to measure performance and diagnose failures.
  • Improve prompting, context, memory, tool use, model routing, fallback behavior, and post-training where useful.
  • Partner with speech and real-time engineers to improve speech quality, turn-taking, and latency.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 3+ years of industrial experience in a relevant technical domain
  • Strong machine learning foundations and hands-on experience developing or evaluating production AI systems
  • Practical experience with LLMs, speech models, multimodal models, or agentic systems
  • Experience building datasets, evaluation harnesses, model services, or training and inference pipelines

Skills

  • Strong Python skills and experience with modern ML tooling such as PyTorch, JAX, Hugging Face, or equivalent systems
  • Strong software engineering judgment; work is reproducible, tested, observable, and usable by other engineers
  • Ability to connect modeling choices to product constraints including latency, cost, privacy, safety, and user experience

Other requirements

  • AI-native working habits and genuine curiosity about new model capabilities and limitations

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Medical benefits, as applicable
Dental & vision
Dental and vision benefits, as applicable
Retirement plan
Retirement benefits, as applicable
Paid time off
Paid time off and company holidays
Parental leave
Family leave
Equity
Stock option plan
Learning & tuition
Learning and development support
Life & disability insurance
Short-term and long-term disability benefits

Full job description

From Palona AI’s careers site

Palona’s AI agents operate in real restaurant environments: noisy phone lines, varied accents, complex menus, interruptions, incomplete information, strict business rules, and customers who expect an immediate, natural response. Improving these systems requires more than selecting the newest model. It requires disciplined evaluation, high-quality data, modeling judgment, experimentation, and production feedback loops.

Show full descriptionShow less

We are looking for an applied AI Modeling Engineer to improve the intelligence, accuracy, safety, latency, and cost of Palona’s voice and multimodal agents. You will own problems across model selection and routing, prompting and context, fine-tuning or post-training when justified, speech and language quality, evaluation methodology, dataset development, and model behavior in production.

This is a product-facing modeling role. Research depth matters, but success is measured by improvements that survive contact with production and create better guest, restaurant, and business outcomes. You will work closely with product, full-stack, infrastructure, and customer-facing engineers to move from hypothesis to experiment to reliable deployment.

What you’ll own

  • Develop modeling and experimentation strategies for high-impact agent problems in voice, language, reasoning, ordering, multilingual behavior, and multimodal understanding.
  • Build rigorous offline and online evaluations that measure task completion, accuracy, safety, latency, cost, conversational quality, and business outcomes.
  • Create and maintain representative datasets from simulations, human annotation, production feedback, and difficult edge cases while protecting sensitive data.
  • Evaluate frontier and open-source models and make clear build, buy, route, prompt, fine-tune, or distill decisions.
  • Improve prompting, context construction, memory, tool-use policies, structured outputs, model routing, and fallback behavior.
  • Design fine-tuning, preference optimization, distillation, or other post-training work when it offers a measurable advantage over simpler methods.
  • Partner with speech and real-time engineers to improve ASR, TTS, turn-taking, interruption handling, pronunciation, multilingual behavior, and end-to-end latency.
  • Develop analysis tools that explain model failures, slice performance by scenario, detect regressions, and accelerate iteration.
  • Ship model changes with production guardrails, staged rollouts, monitoring, rollback paths, and clear quality gates.
  • Translate new research and model releases into concrete product opportunities and communicate tradeoffs to technical and non-technical partners.
  • Raise scientific and engineering standards through reproducible experiments, thoughtful reviews, and clear documentation.

Requirements

  • 3+ years of industrial experience in relevant technical domain.
  • Strong machine learning foundations and hands-on experience developing or evaluating production AI systems.
  • Strong Python skills and experience with modern ML tooling such as PyTorch, JAX, Hugging Face, or equivalent systems.
  • Practical experience with LLMs, speech models, multimodal models, or agentic systems.
  • Ability to design reliable experiments, define useful metrics, analyze noisy results, and avoid optimizing against weak proxies.
  • Experience building datasets, evaluation harnesses, model services, or training and inference pipelines.
  • Strong software engineering judgment; your work is reproducible, tested, observable, and usable by other engineers.
  • Ability to connect modeling choices to product constraints including latency, cost, privacy, safety, and user experience.
  • Comfort operating in ambiguity and collaborating across research, engineering, product, and customer contexts.
  • AI-native working habits and genuine curiosity about new model capabilities and limitations.

Benefits

  • Competitive Salary and Stock Option Plan.
  • Medical, dental, vision, retirement, leave, and disability benefits as applicable.
  • Family Leave
  • Short Term & Long Term Disability
  • Paid time off and company holidays.
  • Learning and development support.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

See more like this