Senior Data Engineer
Vericast · Remote · US only
$130k–$150k/yrFull-time
Metabit Technology LLCSingapore +1 place
Pay not listed
On Metabit Technology LLC’s own careers site (Greenhouse), checked open today.
This job is outside the US, so these US-only checks are not applied: pay-transparency law, pay likely required by state law, US visa sponsorship wording.
Summary, requirements and match are for US jobs for now.
From Metabit Technology LLC’s careers site
Job Responsibilities
-
Market Data Delivery & Full Lifecycle Management: Own the end-to-end delivery of high-frequency market data for one or more core market lines. Lead the entire pipeline construction, including real-time feed handler connectivity, full-scale historical data backfilling, and incremental data patching to ensure high efficiency for quantitative research and trading execution.
-
Exchange Data Guarding: Leverage a profound understanding of market microstructure and raw exchange data to accurately identify and conquer structural anomalies (e.g., CME Implied Orders, dynamic symbol mapping, sequence number gaps, timestamp/price precision alignments) during the design and validation phases. Ensure early convergence of data defects across both realtime and historical stages.
-
New Market Connectivity & Protocol Adaptation: Spearhead the MBO level market data connectivity, micro-protocol parsing, and standardized adaptation for global new markets and new trading systems.
-
High-Standard Validation & Data Patching: Construct multi-dimensional, multi-granular cross-validation frameworks (e.g., MBO vs. TAQ/Snapshot, Raw Pcap vs. Normalized Data). Lead the process from raw Pcap to MBO order book reconstruction, gap/packet drop identification, and high-quality incremental recovery.
-
Team Empowerment & Standards Setting: Guide junior engineers and drive team talent development (Mentorship). Distill and establish team-level sanity check rules, high-frequency data engineering best practices, and standardized delivery whitepapers.
Job Requirements:
-
5+ years of engineering experience in global exchange market/tick data. We are looking for an expert in exchange market data who possesses deep practical experience in either of the following tracks:
-
(a) Real-Time Connectivity Track: Proficient in multi-exchange real-time feed handler connectivity; deeply familiar with multicast, snapshot recovery, and A-B arbitrage data alignment/low-latency processing techniques.
-
(b) Historical Data Track: Proficient in the full historical MBO data lifecycle; hands-on experience in high-performance Pcap parser development, underlying order book reconstruction, full historical data backfilling, and high-standard data cleaning/validation.
-
Core Tech Stack: Expert-level C++ with exceptional capabilities in native Pcap and raw data processing; highly proficient in order book reconstruction mechanisms.
-
Domain Knowledge: Deeply understand the underlying market data architectures of major global exchanges; familiar with market data characteristics across different asset classes (especially global derivatives/futures); hands-on experience solving critical traps like implied order matching, contract symbol mapping, and sequence number continuity.
Preferred Qualifications
-
Complementary Market Experience: Deep experience in global derivatives/futures MBO data, or hands-on experience in market data processing and protocol connectivity for core APAC markets such as HKEX and JPX/TSE.
-
Collaborative Vendor Evaluation: Experience in evaluating data samples from international market data vendors (e.g., Pico, Databento, Maystreet, Refinitiv, Quanthouse, etc.) to assist the team with technical admission and identifying underlying data gaps/pain points.
-
Engineering Toolchain: Experience in building in-house high-standard sanity check or data quality monitoring frameworks; proficient in using Python for efficient data analysis and auxiliary processing.
Something wrong with this job? Report it · This flag looks wrong

Vericast · Remote · US only
$130k–$150k/yrFull-time
StrongChecked open todayPosted yesterday
AIR Communities · Denver, CO
$125k–$145k/yrFull-timeOn-site
StrongChecked open todayPosted 2 days ago

Gatik AI · Santa Clara, CA
$180k–$260k/yrHybrid
StrongChecked open todayPosted 8 days ago

BuildOps · Toronto, CA +2 places
$120k–$197k/yrHybrid
StrongChecked open todayPosted 11 days ago

OpenDataJobs · Washington, DC
$150k–$170k/yrFull-timeHybrid
StrongLast seen open yesterdayPosted 9 days ago

Zipline · South San Francisco, CA
$155k–$210k/yrHybrid
StrongChecked open todayPosted 8 days ago