Data Engineer jobs

Databricks Architect

Tiger Analytics Inc.Remote · US onlyFull-time12+ years experience

Pay not listed

Looks real. 2 things to check before you apply.

On Tiger Analytics Inc.’s own careers site (Workable), checked open today.

  • To check: Posted by the employer 7 months agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteWorkable board
  • Checked: Checked open todayWorkable board
  • Checked: No reposts foundWorkable board
  • Trust score 75 / 100 · Looks good
See all 6 checksShow fewer
How we check

What you’ll do

  • Design and implement scalable data solutions for ETL, real-time streaming, and machine learning workloads on Databricks.
  • Provide technical guidance on Databricks adoption, reference architectures, and best practices.
  • Tune Spark jobs and data pipelines, resolve technical issues, and recommend performance improvements.
  • Develop and debug PySpark jobs and data models integrated with AWS services.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • 12+ years of experience in architecture, design, and data engineering development of large-scale data ecosystems
  • Experience designing and architecting scalable, secure Databricks solutions, optimizing performance, cost, and reliability
  • Hands-on Databricks/DataOps architecture experience, including reducing consumption, improving performance, and building monitoring tools
  • Good exposure to AWS
  • Experience with performance initiatives, identifying tuning opportunities, and creating performance environments
  • Experience with a Hadoop environment
  • Unity Catalog migration implementation exposure
  • Spark Streaming pipeline design exposure

Skills

  • Databricks platform knowledge

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Benefits

Learning & tuition
Significant career development opportunities

Full job description

From Tiger Analytics Inc.’s careers site

Tiger Analytics is pioneering what AI and analytics can do to solve some of the toughest problems faced by organizations globally. We develop bespoke solutions powered by data and technology for several Fortune 100 companies. We have offices in multiple cities across the US, UK, India, and Singapore, and a substantial remote global workforce.

If you have a passion for tackling business challenges through the use of both structured and unstructured data at scale, Tiger Analytics wants to connect with you. We are looking for a skilled and proactive Databricks Architect to take a pivotal role in designing and deploying resilient data solutions that address our clients' complex business issues.

Show full descriptionShow less

Responsibilities

  • Design and implement scalable, end-to-end data solutions for ETL, real-time streaming, and machine learning workloads on the Databricks platform
  • Provide technical leadership and strategic guidance on Databricks adoption, including developing reference architectures and best practices.
  • Ensure optimal performance by tuning Spark jobs, optimizing data pipelines, and resolving complex technical issues.
  • Architect, develop, and debug PySpark jobs and data models, integrating Databricks with cloud services such as AWS S3, EMR, and Lambda
  • Implement and enforce data governance, security, and access control policies (e.g., encryption, auditing) on the Databricks environment

Requirements

  • 12+ years of experience in Architecture, design and data engineering development of large-scale data ecosystems.
  • Databricks Design and Architecture: Design and architect scalable and secure Databricks solutions platform, optimizing performance, cost, and reliability.
  • Hands on Databricks/Dataops Architect that can help reduce consumption, and improve performance issues. Can help build monitoring tools.
  • Good exposure to AWS. Strong comm and leadership skills and Self driven and work independently.
  • Experience in Performance initiatives and drive recommendations (identify tuning opportunities, creation of performance environment etc.
  • Experience with hadoop environment.
  • Core Skills:- Databricks platform knowledge, Unity Catalog migration implementation exposure, Spark Streaming pipeline design exposure

Benefits

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, fast-growing, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.

Something wrong with this job? Report it · This flag looks wrong

Similar remote jobs

Data and AI Architect

Ascend Technologies · Remote · US only

$140k/yrFull-time

StrongChecked open todayPosted 18 days ago

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Senior Data Engineers

Movement Labs · Remote · US only

$120k–$150k/yrFull-time

StrongChecked open todayPosted 7 days ago

Data Engineer

Mindex · Remote · US only

$90k–$140k/yrFull-time

StrongChecked open todayPosted 8 days ago

Senior DataOps Engineer

Voyager Technologies, Inc. · Remote · US only

$140k–$180k/yr

StrongChecked open todayPosted 9 days ago

Data Integration Engineer

D.A. Davidson · Remote · US only

$74k–$106k/yrFull-time

StrongChecked open todayPosted 10 days ago

See more like this