Set technical strategy and oversee development of a scalable, reliable platform to manage, visualize, and serve datasets for ML training and validation.
Build a lakehouse for autonomous driving scene, sensor, calibration, and annotation data.
Develop the Autonomous Driving Data SDK for scene search, dataset preparation, and data loading.
Identify performance bottlenecks across data processing, data search, and test procedure coverage.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Experience
Minimum 7 years of experience in Data Engineering or ML Platform roles
Hands-on experience with data pipeline job orchestration using Databricks Workflows or Apache Airflow, and integrating data pipelines with machine learning models
Extensive experience with data technologies and architectures such as Data Warehouse or Lakehouse
Experience with Apache Spark or other big data computing engines
Excellent leadership and communication skills, with demonstrated ability to lead technical projects
Experience with autonomous vehicle sensor data such as LiDAR, camera, or radar (preferred)
Experience with the ML model training lifecycle, including data preparation, model training, validation, and deployment (preferred)
Understanding of data governance principles and data privacy regulations, and experience implementing data security measures (preferred)
Education
Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field
Skills
Expert-level proficiency in Python and solid experience in Python SDK development
Solid working experience with databases such as MongoDB or PostgreSQL
Strong understanding of modern AI frameworks, especially distributed data loader principles for model training
Understanding of large models such as VLM (preferred)
Your match
Sign in and add your resume to see which of this job's requirements it shows.
Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
Full job description
From 42dot’s careers site
WE ARE LOOKING FOR THE BEST
ABOUT US
42dot is a mobility AI company committed to solving mobility challenges with software and AI. As the Global Software Center of Hyundai Motor Group, 42dot pioneers the future of mobility by advancing the development of software-defined vehicles.
We develop safety-first, user-centric software-defined vehicle technologies that deliver the latest performance through continuous updates like smartphones. By advancing software and AI technology, 42dot envisions a world where everything is connected and moves autonomously through a self-managing urban transportation operating system.
Show full descriptionShow less
At 42dot, our AD ML Platform Engineers build the core data platform and ML training / eval platform for the cutting edge algorithms in autonomous driving. We develop the distributed system of a scalable data platform for large-scale dataset (millions of scenes), as well as high-performance data serving SDKs for ML model training / evaluation. The platforms we deliver could highly improve the efficiency of ML model development lifecycle, including training, evaluation, deployment, as well as monitoring in the cloud environment.
Responsibilities
Set technical strategy and oversee development of high scale, reliable data platform to manage, visualize and serve large-scale datasets for ML model training and validation.
Build up the data lakehouse for autonomous driving scene datasets, including the sensor data, calibration data, as well as annotation data
Drive the Autonomous Driving Data SDK development, including scene data search, datasets preparation, dataset loading, etc.
Dig into performance bottlenecks all along the data processing pipelines, from data processing latency, data search latency to Test Procedure (TP) coverage.
Bootstrap and maintain infrastructure for Data Platform components—Data Processing Pipeline, Database, Data Lakehouse and Data Serving.
Collaborate with cross-functional teams, including ML algorithm, ML application, and Cloud Infra to align ML Platforms with overall Autonomous Driving System Architecture.
Qualifications
Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field.
Minimum of 7 years of experience in Data Engineering or ML Platform roles
Expert-level proficiency in Python and solid experience in Python SDK development
Solid working experience in Databases (e.g., MongoDB, PostgreSQL, etc)
Strong understanding of modern AI frameworks (e.g., PyTorch, TensorFlow etc.), especially the principle of distributed data loader for model training
Hands-on experience with data pipeline job orchestration with Databricks Workflows or Apache Airflow, as well as integrating data pipelines with machine learning models
Extensive experience with data technologies and architectures such as Data Warehouse (e.g., Hive) or Lakehouse (e.g., Delta Lake)
Experience with Apache Spark or other big data computing engines
Excellent leadership and communication skills, with a demonstrated ability to lead technical projects
Preferred Qualifications
Experience with autonomous vehicle sensor data (e.g., LiDAR, camera, radar)
Experience with ML model training lifecycle (e.g., data preparation, model training / validation / deployment, etc)
Understanding data governance principles, data privacy regulations, and experience implementing security measures to protect data
The screening procedures may vary depending on the position, schedule, or other circumstances.
You will be individually notified of the screening schedule and results via the email address provided in your application.
Compensation
$133,000 - $254,0000
Additional Information
In accordance with fair hiring practices, do not include any personal information unrelated to your job qualifications (e.g., Social Security Number, family relations, marital status, age, photo, physical condition, place of birth, etc.) in your resume.
All documents must be submitted in PDF format and under 30MB in size.
If you experience issues uploading your resume, please send it along with the job posting URL to recruit@42dot.ai.
We strongly encourage applications from U.S. veterans and candidates eligible for employment preference under applicable laws.
Qualified individuals with disabilities are encouraged to apply and will receive consideration under the Americans with Disabilities Act (ADA).
※ Please review the following information before applying.
How to work in 42dot, About 42dot Way → https://42dot.ai/careers/way
42dot does not accept unsolicited resumes and will not pay fees for any such submissions. Equal Opportunity Statement
42dot is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees, regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or veteran status.