Data Engineer jobs

Databricks Architect - R01573990

BrillioSan Francisco, CAFull-timeHybridPosted 4 days ago

Pay not listed

Key facts

Experience
7+ years
Degree
Bachelor's degree
US visa
No US visa sponsorship

Looks real. 1 thing to check before you apply.

On Brillio’s own careers site (Lever), checked open today.

  • To check: No pay range listed, though one is likely required in CAAsk for the pay range before you interview. The law here likely requires one.
  • Checked: On the company's own careers siteLever board
  • Checked: Checked open todayLever board
  • Trust score 89 / 100 · Looks good
See all 4 checksShow fewer
How we check

What you’ll do

  • Design scalable data solutions using Databricks and cloud data platforms.
  • Build, optimize, and maintain ETL pipelines and automate data workflows.
  • Develop data models and data warehousing solutions for analytics, reporting, and business intelligence.
  • Monitor and troubleshoot data pipeline performance; ensure data quality, consistency, and security.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Licenses and certifications

  • Databricks Certified Data Engineer Associate or Professional certification (preferred)
  • Certification in a cloud data platform, such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer (preferred)

Experience

  • At least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms
  • Experience with data modeling techniques and best practices
  • Hands-on experience with PL/SQL and T-SQL
  • Experience with performance tuning and troubleshooting in distributed data environments
  • Experience with Azure Data Lake, AWS S3, or Google BigQuery (preferred)
  • Working experience with Scala or Java in data engineering contexts (preferred)
  • Exposure to data governance, cataloging, and lineage tools (preferred)

Education

  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline (preferred)

Skills

  • Advanced proficiency with the Databricks platform and ecosystem
  • Expertise designing and developing ETL pipelines using SQL and Python
  • Expert-level SQL, including advanced query optimization
  • Proficiency in Python for data engineering and automation
  • Comprehensive knowledge of data warehousing concepts and design patterns
  • Ability to develop and maintain stored procedures for data transformation
  • Familiarity with Delta Lake and lakehouse architecture concepts (preferred)
  • Knowledge of CI/CD practices for data engineering pipelines (preferred)

Other requirements

  • Local to California
  • Work authorization that does not require sponsorship

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Brillio’s careers site

Data Architect

Primary Skills

  • ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures

Specialization

  • Databricks Engineering: Data Architect

Job requirements

Show full descriptionShow less
  •   - Location: San Jose, CA - Looking for candidate local to CA  - Full-time role, does not open for a sponsorship. - Experience Range: With at least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms Key Responsibilities:   1. Design and architect scalable, high-performance data solutions utilizing Databricks and leading cloud data platforms   2. Develop, optimize, and maintain ETL pipelines with SQL, Python, and Databricks to ensure efficient data ingestion, transformation, and loading   3. Implement robust data models and data warehousing solutions to drive analytics, reporting, and business intelligence outcomes   4. Automate and streamline data workflows to enhance system efficiency and minimize processing times   5. Monitor, troubleshoot, and resolve performance bottlenecks in data pipelines and platform components   6. Ensure data quality, consistency, and security across all data assets and platforms   7. Collaborate with cross-functional teams to translate business requirements into technical data architecture solutions   8. Document architecture designs, data flows, and best practices to support operational excellence and knowledge sharing Required Skills:   1. Advanced proficiency with Databricks platform and ecosystem   2. Expertise in designing and developing ETL pipelines using SQL and Python   3. Expert-level SQL, including advanced query optimization   4. Proficiency in Python for data engineering and automation   5. Comprehensive knowledge of data warehousing concepts and design patterns   6. Experience with data modeling techniques and best practices   7. Hands-on experience with PLSQL and T-SQL   8. Ability to develop and maintain stored procedures for data transformation   9. Experience with performance tuning and troubleshooting in distributed data environments Preferred Skills:   1. Experience with Azure Data Lake, AWS S3, or Google BigQuery   2. Familiarity with Delta Lake and lakehouse architecture concepts   3. Knowledge of CI/CD practices for data engineering pipelines   4. Working experience with Scala or Java in data engineering contexts   5. Exposure to data governance, cataloging, and lineage tools Desired Qualifications:   1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline   2. Databricks Certified Data Engineer Associate or Professional certification   3. Certification in cloud data platforms such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer

Something wrong with this job? Report it · This flag looks wrong

Similar jobs nearby

Data Engineer II

Knit Health · San Francisco, CA

$150k–$175k/yrFull-timeHybrid

StrongLast seen open yesterdayPosted 23 days ago

Senior Data Engineer

BuildOps · Toronto, CA +2 places

$120k–$197k/yrHybrid

StrongChecked open todayPosted 11 days ago

Data Engineer II, JVM

PlayStation Global · San Mateo, CA

$164k–$246k/yrHybrid

StrongChecked open todayPosted 16 days ago

Senior Analytics Engineer

BetterUp · Austin, TX +3 places

$158k–$220k/yrFull-timeHybrid

StrongChecked open todayPosted 1 month ago

Data Engineer, Product

Anthropic · San Francisco, CA +2 places

$320k–$405k/yrHybrid

StrongChecked open todayPosted 1 month ago

Data Platform Engineer

Hubble Network · San Francisco, CA

$153k–$250k/yrFull-timeHybrid

StrongOpen 2 monthsChecked open todayPosted 2 months ago

See more like this