Software Engineer jobs

Principal Staff Software Engineer - Data Lake Infrastructure

LinkedInMountain View, CAFull-timeHybridPosted 26 days ago

$231k–$378k/yr listed by the employer

Above the typical $275k a year for principal-level Software Engineer jobs in CaliforniaHow we compare

How we compare. Typical is the median yearly pay of 167 principal-level Software Engineer jobs in California that list pay, from the employers' own postings. About means within 5%.

Key facts

Experience
10+ years
Degree
Bachelor's degree or equivalent

Strong: looks real and checked open today.

On LinkedIn’s own careers site (SmartRecruiters).

  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: Checked open todaySmartRecruiters board
  • Checked: Pay listedJob posting
  • Checked: No reposts foundSmartRecruiters board
  • Trust score 100 / 100 · Strong
See all 5 checksShow fewer
How we check

What you’ll do

  • Own the technical roadmap and architecture for OpenHouse and core data lake services.
  • Lead design and implementation of highly available distributed systems for petabyte-scale Iceberg tables.
  • Drive open-source contributions and collaborate with Apache Iceberg and related ecosystem projects.
  • Partner across teams to set platform requirements and strategy; mentor engineers and lead technical reviews.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 10+ years of industry experience in software design, development, and algorithm-related solutions
  • 10+ years of technical leadership experience in architecture ownership, mentoring, and cross-team influence
  • 8+ years of experience with table formats (Iceberg/Delta/Hudi), data lake/lakehouse architectures, and query engines (Spark, Trino, Presto)
  • 8+ years building large-scale distributed data systems
  • 10+ years of systems programming experience in Java, Scala, or Go
  • Experience architecting, building, and running large-scale distributed systems (preferred)
  • Experience communicating with and influencing cross-functional teams (preferred)
  • Background in industry thought leadership (preferred)
  • Ability to align technical decisions with business outcomes and drive customer-centric innovation (preferred)
  • Production experience operating Iceberg or similar table-format infrastructure at multi-petabyte, multi-tenant scale (preferred)
  • Open-source contribution experience, especially in Apache Iceberg, Trino, Spark, or related projects (preferred)
  • Experience with catalog/metadata services, compaction, retention, and data governance (preferred)
  • Background in storage cost optimization, including tiering, compaction, and format evolution (preferred)
  • Track record leading cross-organizational technical initiatives as a technical lead or architect (preferred)

Education

  • BS in Computer Science or equivalent
  • MS/PhD in Computer Science or related field (preferred)

Skills

  • Understanding of distributed systems fundamentals, including consistency, replication, and metadata management

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Health insurance
Generous health programs
Paid time off
Time away for employees; amount not specified
Equity
May include stock
Bonus
May include an annual performance bonus
Wellness & mental health
Wellness programs

Full job description

From LinkedIn’s careers site

Company Description

LinkedIn is the world's largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. We're also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture that's built on trust, care, inclusion, and fun – where everyone can succeed.

Join us to transform the way the world works.

Job Description

This role will be based in Mountain View or Bellevue.

Show full descriptionShow less

At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the evolving needs of our business. The work location of this role is hybrid, meaning it will be performed both from home and from a LinkedIn office on select days, as determined by the business needs of the team.

The Data Lake Infrastructure team builds and operates the foundational storage and table-management technologies powering LinkedIn's data platform at massive scale. We own OpenHouse, LinkedIn's open-source control plane for Apache Iceberg tables, along with the broader data lake stack (storage engines, table formats, metadata/catalog services, and compaction/retention systems) that serves thousands of internal teams, petabyte-scale datasets, and mission-critical analytics, ML, and AI workloads. We collaborate closely with open-source communities (Apache Iceberg, Trino, Spark) and partner teams across Data Infrastructure, Analytics, and AI Platform to ensure reliable, cost-efficient, and governable data access company-wide.

We are seeking a Principal Technical Lead to drive the technical vision and execution for OpenHouse and LinkedIn's data lake technologies. You will set architectural direction, lead complex cross-team initiatives, and mentor engineers building the next generation of table-management and lakehouse infrastructure. This role combines deep hands-on engineering with technical leadership — you'll design for scale, reliability, and openness while representing LinkedIn in the broader open-source data lake ecosystem.

Come join our infrastructure teams and share the knowledge with a broader community while making a real impact within our company.

Core Responsibilities:

  • Own the technical roadmap and architecture for OpenHouse and core data lake services (catalog, table format, compaction, retention, replication, governance).
  • Lead design and implementation of large-scale, highly available distributed systems handling petabyte-scale Iceberg tables.
  • Drive open-source contributions and engagement with Apache Iceberg and related ecosystem projects.
  • Partner with Analytics, AI Platform, and Data Infra teams to align on requirements, integration points, and long-term platform strategy.
  • Provide technical mentorship and code/design review leadership across the team; raise the engineering bar.
  • Evaluate and adopt emerging lakehouse technologies, driving build-vs-adopt decisions.
  • Ensure system reliability, performance, and cost efficiency through sound SLOs, monitoring, and capacity planning.
  • Lead technical design reviews, write RFCs/design docs, and drive consensus across stakeholders.
  • Guide incident response and root-cause analysis for critical data lake infrastructure issues.
  • Guide incident response and root-cause analysis for critical data lake infrastructure issues.

Qualifications

Basic Qualifications

  • BS in Computer Science or equivalent.
  • 10+ years of industry experience in software design, development, and algorithm related solutions.
  • 10+ years of experience in technical leadership: architecture ownership, mentoring, cross-team influence.
  • 8+ years of experience in table formats (Iceberg/Delta/Hudi), data lake/lakehouse architectures, and query engines (Spark, Trino, Presto).
  • 8+ years building large-scale distributed data systems (storage, databases, data lakes, or data infrastructure)
  • 10+ years of experience in systems programming (Java/Scala/Go) and understanding of distributed systems fundamentals (consistency, replication, metadata management.
  • 8+ years of experience with Open-source contribution experience preferred, especially in Apache Iceberg or similar projects.

Preferred Qualifications

  • MS/PhD in Computer Science or related field.
  • Experience in architecting, building, and running large-scale distributed systems.
  • Experience with communication and ability to influence cross-functional teams.
  • Background in industry thought leadership.
  • Demonstrated ability to align technical decisions with business outcomes and drive customer-centric innovation.
  • Production experience operating Iceberg (or similar table format) infrastructure at multi-petabyte, multi-tenant scale.
  • Open-source contribution experience strongly preferred, especially in Apache Iceberg, Trino, Spark, or related lakehouse/OSS projects, or similar projects.
  • Experience with catalog/metadata services, compaction, retention, and data governance.
  • Background in storage cost optimization (tiering, compaction, format evolution).
  • Track record leading cross-org technical initiatives as a technical lead or architect.

Suggested Skills:

  • Distributed Systems
  • Data Infrastructure
  • Data Lake, Apache Iceberg, Trino, Spark
  • Deep understanding of concurrency, distributed algorithms, and data structures.
  • Large scale technical leadership

Additional Information:

You will Benefit from our Culture

We strongly believe in the well-being of our employees and their families. That is why we offer generous health and wellness programs and time away for employees of all levels.

LinkedIn is committed to fair and equitable compensation practices.

The pay range for this role is $231,000 to $378,000. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to skill set, depth of experience, certifications, and specific work location. This may be different in other locations due to differences in the cost of labor.

The total compensation package for this position may also include annual performance bonus, stock, benefits and/or other applicable incentive compensation plans. For more information, visit https://careers.linkedin.com/benefits.

Additional Information

LinkedIn is committed to offering an inclusive and accessible experience for all job seekers, including individuals with disabilities. Our goal is to foster an inclusive and accessible workplace where everyone has the opportunity to be successful.

Fill out an Accommodation request here: https://app.smartsheet.com/b/form/b660a0327d044969abfd7a4e73d15c36

  • Documents in alternate formats or read aloud to you
  • Having interviews in an accessible location
  • Being accompanied by a service dog
  • Having a sign language interpreter present for the interview

A request for an accommodation will be responded to within three business days. However, non-disability related requests, such as following up on an application, will not receive a response.

LinkedIn will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by LinkedIn, or (c) consistent with LinkedIn's legal duty to furnish information.

Pay Transparency Policy Statement ​

As a federal contractor, LinkedIn follows the Pay Transparency and non-discrimination provisions described at this link: https://lnkd.in/paytransparency.

Equal Opportunity Statement

We seek candidates with a wide range of perspectives and backgrounds and we are proud to be an equal opportunity employer. LinkedIn considers qualified applicants without regard to race, color, religion, creed, gender, national origin, age, disability, veteran status, marital status, pregnancy, sex, gender expression or identity, sexual orientation, citizenship, or any other legally protected class.

If you need a Reasonable Accommodation to search for a job opening, apply for a position, or participate in the interview process, connect with us and describe the specific Accommodation requested for a disability-related limitation.

Reasonable accommodations are modifications or adjustments to the application or hiring process that would enable you to fully participate in that process. Examples of reasonable accommodations include but are not limited to:

San Francisco Fair Chance Ordinance ​

Pursuant to the San Francisco Fair Chance Ordinance, LinkedIn will consider for employment qualified applicants with arrest and conviction records.

Global Data Privacy Notice and Compliance Posters for Job Candidates

Please use this link to access documents that provide information about how LinkedIn handles the personal data of employees and job applicants, as well as the E-Verify Participation Notice and the Department of Justice Immigrant and Employee Rights Section Right to Work posters: https://www.linkedin.com/legal/candidate-portal.

Something wrong with this job? Report it

Similar jobs nearby

Staff Software Engineer

LinkedIn · Mountain View, CA

$156k–$255k/yrFull-timeHybrid

StrongChecked open todayPosted 5 days ago

Software Engineer

ServiceNow · Santa Clara, CA

$126k–$195k/yrFull-time

StrongChecked open todayPosted 3 days ago

See more like this