Design scalable data solutions using Databricks and cloud data platforms.
Build, optimize, and maintain ETL pipelines and automate data workflows.
Develop data models and data warehousing solutions for analytics, reporting, and business intelligence.
Monitor and troubleshoot data pipeline performance; ensure data quality, consistency, and security.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Licenses and certifications
Databricks Certified Data Engineer Associate or Professional certification (preferred)
Certification in a cloud data platform, such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer (preferred)
Experience
At least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms
Experience with data modeling techniques and best practices
Hands-on experience with PL/SQL and T-SQL
Experience with performance tuning and troubleshooting in distributed data environments
Experience with Azure Data Lake, AWS S3, or Google BigQuery (preferred)
Working experience with Scala or Java in data engineering contexts (preferred)
Exposure to data governance, cataloging, and lineage tools (preferred)
Education
Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline (preferred)
Skills
Advanced proficiency with the Databricks platform and ecosystem
Expertise designing and developing ETL pipelines using SQL and Python
Expert-level SQL, including advanced query optimization
Proficiency in Python for data engineering and automation
Comprehensive knowledge of data warehousing concepts and design patterns
Ability to develop and maintain stored procedures for data transformation
Familiarity with Delta Lake and lakehouse architecture concepts (preferred)
Knowledge of CI/CD practices for data engineering pipelines (preferred)
Other requirements
Local to California
Work authorization that does not require sponsorship
Your match
Sign in and add your resume to see which of this job's requirements it shows.
Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
Full job description
From Brillio’s careers site
Data Architect
Primary Skills
ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
Specialization
Databricks Engineering: Data Architect
Job requirements
Show full descriptionShow less
- Location: San Jose, CA - Looking for candidate local to CA - Full-time role, does not open for a sponsorship. - Experience Range: With at least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms Key Responsibilities: 1. Design and architect scalable, high-performance data solutions utilizing Databricks and leading cloud data platforms 2. Develop, optimize, and maintain ETL pipelines with SQL, Python, and Databricks to ensure efficient data ingestion, transformation, and loading 3. Implement robust data models and data warehousing solutions to drive analytics, reporting, and business intelligence outcomes 4. Automate and streamline data workflows to enhance system efficiency and minimize processing times 5. Monitor, troubleshoot, and resolve performance bottlenecks in data pipelines and platform components 6. Ensure data quality, consistency, and security across all data assets and platforms 7. Collaborate with cross-functional teams to translate business requirements into technical data architecture solutions 8. Document architecture designs, data flows, and best practices to support operational excellence and knowledge sharing Required Skills: 1. Advanced proficiency with Databricks platform and ecosystem 2. Expertise in designing and developing ETL pipelines using SQL and Python 3. Expert-level SQL, including advanced query optimization 4. Proficiency in Python for data engineering and automation 5. Comprehensive knowledge of data warehousing concepts and design patterns 6. Experience with data modeling techniques and best practices 7. Hands-on experience with PLSQL and T-SQL 8. Ability to develop and maintain stored procedures for data transformation 9. Experience with performance tuning and troubleshooting in distributed data environments Preferred Skills: 1. Experience with Azure Data Lake, AWS S3, or Google BigQuery 2. Familiarity with Delta Lake and lakehouse architecture concepts 3. Knowledge of CI/CD practices for data engineering pipelines 4. Working experience with Scala or Java in data engineering contexts 5. Exposure to data governance, cataloging, and lineage tools Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline 2. Databricks Certified Data Engineer Associate or Professional certification 3. Certification in cloud data platforms such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer