Weekday AIRemote · US onlyPart-time1+ years experiencePosted 2 months ago
$100–$150/hr listed by the employer
Hours vary, so we don't estimate a year.
This job is closed.
The employer took it down 19 days ago, after 2 days open. Here are similar open jobs.
To check: Mentions a talent pool or pipelineWhy: “Data Scientist Talent Network”Some postings collect applications for later. Ask if there is an opening now.
Checked: On the company's own careers siteWorkable board
Design task-specific grading criteria for data science deliverables, including analyses, models, machine learning pipelines, experiments, and technical reports or notebooks.
Evaluate AI-generated or human-created work against established criteria and provide written justifications for scores.
Apply consistent, evidence-based judgment so assessments are reproducible and defensible.
Incorporate feedback from senior reviewers and iterate on submitted work.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Experience
1+ years of professional data science experience (preferred)
Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent) (preferred)
Skills
Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference (preferred)
Ability to translate messy real-world data into rigorous analyses (preferred)
Other requirements
Comfort receiving feedback and calibrating judgment against established standards (preferred)
Full job description
From Weekday AI’s careers site
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Requirements
Potential Responsibilities
Future projects may involve:
Show full descriptionShow less
Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
Evaluating AI-generated or human-created work against established criteria
Providing detailed written justifications for evaluations and scores
Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
1+ years of professional data science experience
Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
Exceptional written communication skills, including the ability to convey technical findings clearly
A detail-oriented and consistent approach to evaluating complex work
Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.