Data Engineer jobs

Big Data Consultant (Durham, NC, Westlake, TX)

Sonsoft Inc (agency)Durham, NCFull-time

Pay not listed

Key facts

Experience
7+ years
Degree
Bachelor's degree
US visa
No US visa sponsorship

2 things to check before you apply.

On Sonsoft Inc’s own careers site (SmartRecruiters), checked open today.

  • To check: Posted by the employer 9 years agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: Checked open todaySmartRecruiters board
  • Checked: No reposts foundSmartRecruiters board
  • Trust score 60 / 100 · Check details
See all 6 checksShow fewer
How we check

What you’ll do

  • Work with HDFS architecture and big data technologies to develop data-processing solutions.
  • Process structured data using warehousing techniques such as cleansing, deduplication, transformation, and versioning.
  • Develop and execute Oozie workflows and work with Hive, Sqoop, and Spark.
  • Translate functional and non-functional requirements into system requirements and analyze business data with business users.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Licenses and certifications

  • Cloudera certification

Experience

  • At least 7 years of overall experience
  • Experience processing structured data and applying warehousing concepts such as deduplication, cleansing, lookups, transformation, and data versioning
  • At least 4 years of experience translating functional and non-functional requirements into system requirements
  • Experience working with business users to analyze and understand business data and scenarios
  • Experience leading medium- to large-sized teams
  • At least 4 years of experience in Information Technology

Education

  • Bachelor’s degree or foreign equivalent from an accredited institution, or three years of progressive specialty experience in lieu of each year of education

Skills

  • HDFS architecture, including node types and interactions, YARN, ZooKeeper, and MapReduce
  • Hands-on experience with Hive, Hive queries, UDFs, and ORC, Avro, and Parquet file formats
  • Hands-on experience developing with Sqoop and Spark
  • Hands-on experience developing and executing Oozie workflow definitions
  • Knowledge of an HDFS distribution and its monitoring and operational capabilities
  • Hands-on experience with programming languages such as Java, Python, or Perl
  • Knowledge of PL/SQL
  • Knowledge of Flume (preferred)
  • Knowledge of Kafka (preferred)
  • Knowledge of Cloudera as an HDFS distribution (preferred)

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Sonsoft Inc’s careers site

Company Description

Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

Job Description

Green Card and USC

Job Description:-

  • At least 7+ years of overall experience
  • HDFS architecture and understanding of all critical architectural concepts including type of nodes, node interaction, YARN, Zoo Keeper, and Map reduce etc.
  • Hand on experience in Hive: All concepts including Hive queries, UDF, Different file formats like ORC, AVRO, and Parquet etc.
  • Hand on experience in developing Sqoop, Spark.
Show full descriptionShow less
  • Experience in processing structured data - Warehousing Concepts like de-duplication, cleansing, look ups, transformation, data versioning etc.
  • Hand on experience in developing Oozie workflow definition and execution
  • Knowledge of a HDFS distribution preferably Cloudera. Understanding of Monitoring and operational capabilities of the distribution
  • Knowledge of Flume, Kafka is a plus
  • Hand on experience in programming languages like Java, Python, Perl.
  • At least 4 years of experience in translating functional/non-functional requirements to system requirements.
  • Experience in working with business users to analyze and understand business data and scenarios.
  • Ability to work in a team environment with client interfacing skills.
  • Experience and desire to work in a Global delivery environment.
  • Experience leading medium to large sized teams.
  • CloudEra Certification
  • Knowledge of PLSQL.

Job Description:-

  • At least 7+ years of overall experience
  • HDFS architecture and understanding of all critical architectural concepts including type of nodes, node interaction, YARN, Zoo Keeper, and Map reduce etc.
  • Hand on experience in Hive: All concepts including Hive queries, UDF, Different file formats like ORC, AVRO, and Parquet etc.
  • Hand on experience in developing Sqoop, Spark.
  • Experience in processing structured data - Warehousing Concepts like de-duplication, cleansing, look ups, transformation, data versioning etc.
  • Hand on experience in developing Oozie workflow definition and execution
  • Knowledge of a HDFS distribution preferably Cloudera. Understanding of Monitoring and operational capabilities of the distribution
  • Knowledge of Flume, Kafka is a plus
  • Hand on experience in programming languages like Java, Python, Perl.
  • At least 4 years of experience in translating functional/non-functional requirements to system requirements.
  • Experience in working with business users to analyze and understand business data and scenarios.
  • Ability to work in a team environment with client interfacing skills.
  • Experience and desire to work in a Global delivery environment.
  • Experience leading medium to large sized teams.
  • CloudEra Certification
  • Knowledge of PLSQL.

Qualifications

Basic Qualifications :-

  • Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
  • At least 4 years of experience within the Information Technologies.

Additional Information

Note:- This is a Full-Time & Permanent job opportunity for you. Only US Citizen, Green Card Holder, GC-EAD, H4-EAD & L2-EAD can apply. No OPT-EAD, H1B & TN candidates please. Please mention your Visa Status in your email or resume.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Medicaid Data Lead

Abt Global · Rockville, MD +3 places

$110k–$155k/yr

StrongChecked open todayPosted 9 days ago

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Senior Data Engineer

AIR Communities · Denver, CO

$125k–$145k/yrFull-timeOn-site

StrongChecked open todayPosted 2 days ago

Lead Data Engineer

AIR Communities · Denver, CO

$135k–$160k/yrFull-timeOn-site

StrongChecked open todayPosted 2 days ago

Sr. Data Engineer

NBCUniversal · New York, NY

$115k–$145k/yrFull-timeHybrid

StrongChecked open todayPosted 2 days ago

See more like this