Data & AI jobs

Member of Technical Staff, Multimodal Pretraining Data

HarkSan Jose +1 placeFull-timeSan Jose · San Jose, CAPosted 12 days ago

$180k–$450k/yr listed by the employer

Looks real. 1 thing to check before you apply.

On Hark’s own careers site (Greenhouse), checked open today.

  • To check: Wide pay range: top of the range is 2.5× the bottomAsk what the job pays at your level before you interview.
  • Checked: On the company's own careers siteGreenhouse board
  • Checked: Checked open todayGreenhouse board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundGreenhouse board
  • Trust score 100 / 100 · Strong
See all 6 checksShow fewer
How we check

What you’ll do

  • Select, filter, deduplicate, and prepare text, code, image, and video datasets at scale.
  • Build paired and interleaved image-text and video-text datasets while preserving document structure and visual-text alignment.
  • Develop quality classifiers, sampling methods, synthetic captions, and other supervision for image and video data; evaluate their accuracy, coverage, and biases.
  • Design data mixtures and curricula, and run controlled experiments to assess data quality, model quality, and training efficiency.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • Experience developing training data for language or vision-language models, with depth in one or more areas such as text and code curation, image-text datasets, or video data
  • Experience designing controlled data experiments, measuring model improvements, and assessing whether results transfer across training scales
  • A record of improving training data or model performance through research, datasets, systems, open-source contributions, or production work
  • Experience with image-text alignment, interleaved document construction, video frame sampling, or temporal grounding (preferred)
  • Experience with synthetic captioning, model-based filtering, or embedding-based data selection (preferred)
  • Experience with data mixtures, curricula, or scaling laws for data (preferred)
  • Experience with provenance, privacy filtering, licensing metadata, or multimodal benchmark decontamination (preferred)

Skills

  • Strong Python engineering skills
  • Familiarity with distributed processing frameworks such as Spark, Ray, Beam, or similar systems
  • Understanding of data quality issues such as duplication, noisy supervision, source imbalance, and benchmark contamination
  • Familiarity with tokenizer design, visual representations, or training language and vision-language models (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Hark’s careers site

About Hark

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory.

We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world.

Show full descriptionShow less

To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.

About the Role

The Omni team at Hark is building the next generation of AI experiences beyond text, enabling models to understand and generate content across multiple modalities, including text, audio, and beyond. Our goal is to create seamless, real-time multimodal intelligence that powers intuitive and immersive user experiences.

As part of the Omni team, you'll develop the text, code, image, and video datasets used to pretrain Hark's models, with a focus on language and visual understanding. You'll identify useful sources, build filtering and synthetic supervision methods, and design training mixtures. You'll measure the effect of data choices through controlled experiments and work with infrastructure engineers to scale successful methods.

Responsibilities

  • Develop methods to select, filter, deduplicate, and prepare text, code, image, and video datasets at scale.
  • Build paired and interleaved datasets, including image-text documents and video-text data. Preserve document structure and the alignment between visual content and text.
  • Build quality classifiers and sampling methods, and measure their impact through controlled training experiments.
  • Develop synthetic captioning and other supervision methods for image and video data, and assess their accuracy, coverage, and biases.
  • Design mixtures and curricula across sources, domains, and modalities. Evaluate how sampling, sequence construction, and media resolution affect model quality and training efficiency.
  • Measure corpus quality and coverage, check for benchmark contamination with evaluation researchers, and track source provenance and dataset versions.
  • Work with infrastructure engineers to scale data processing and deliver datasets that training systems can load efficiently and reproducibly.

Requirements

  • Experience developing training data for language or vision-language models, with depth in one or more areas such as text and code curation, image-text datasets, or video data.
  • Experience designing controlled data experiments, measuring model improvements, and assessing whether results transfer across training scales.
  • Strong Python engineering skills and familiarity with distributed processing frameworks such as Spark, Ray, Beam, or similar systems.
  • Understanding of data quality issues such as duplication, noisy supervision, source imbalance, and benchmark contamination.
  • A record of improving training data or model performance through research, datasets, systems, open-source contributions, or production work.

Bonus Qualifications

  • Experience with image-text alignment, interleaved document construction, video frame sampling, or temporal grounding.
  • Experience with synthetic captioning, model-based filtering, or embedding-based data selection.
  • Experience with data mixtures, curricula, or scaling laws for data.
  • Familiarity with tokenizer design, visual representations, or training language and vision-language models.
  • Experience with provenance, privacy filtering, licensing metadata, or multimodal benchmark decontamination.

Compensation

The US base salary range for this full-time position is between $180,000 - $450,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended.

Something wrong with this job? Report it

Similar jobs

Data Steward

Esri · Redlands, CA

$71k–$110k/yrOn-site

StrongChecked open todayPosted 9 days ago

Senior Data Engineer

Gatik AI · Santa Clara, CA

$180k–$260k/yrHybrid

StrongChecked open todayPosted 8 days ago

Applied Data Researcher

Figma · San Francisco, CA

$235k–$376k/yrFull-time

StrongChecked open todayPosted 9 days ago

See more like this