Data Engineer jobs

Big Data ( USC & GC )

Sonsoft Inc (agency)Durham, NCFull-time

Pay not listed

Key facts

Experience
7+ years
Degree
Bachelor's degree
US visa
No US visa sponsorship

2 things to check before you apply.

On Sonsoft Inc’s own careers site (SmartRecruiters), checked open today.

  • To check: Posted by the employer 9 years agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
  • To check: No pay range listedAsk for the pay range before you interview.
  • Checked: On the company's own careers siteSmartRecruiters board
  • Checked: Checked open todaySmartRecruiters board
  • Checked: No reposts foundSmartRecruiters board
  • Trust score 60 / 100 · Check details
See all 6 checksShow fewer
How we check

What you’ll do

  • Work with HDFS architecture and related components, including YARN, ZooKeeper, and MapReduce.
  • Develop Hive queries and UDFs and work with ORC, Avro, and Parquet data formats.
  • Develop with Sqoop and Spark and process structured data using warehousing techniques.
  • Develop and execute Oozie workflows.

Summarised from the posting by AI and can be wrong. The full description is the source.

Requirements

Experience

  • At least 7 years of overall experience
  • At least 4 years of experience in Information Technologies
  • Experience processing structured data using warehousing concepts such as de-duplication, cleansing, lookups, transformation, and data versioning

Education

  • Bachelor’s degree or foreign equivalent from an accredited institution, or three years of progressive specialty experience in lieu of each year of education

Skills

  • HDFS architecture, including node types and interactions, YARN, ZooKeeper, and MapReduce
  • Hands-on experience with Hive concepts, queries, UDFs, and ORC, Avro, and Parquet file formats
  • Hands-on experience developing with Sqoop and Spark
  • Hands-on experience developing and executing Oozie workflow definitions
  • Hands-on experience programming in Java, Python, or Perl
  • Knowledge of an HDFS distribution, preferably Cloudera, including its monitoring and operational capabilities (preferred)
  • Knowledge of Flume or Kafka (preferred)

Other requirements

  • Must be a U.S. citizen, Green Card holder, GC-EAD holder, or TN visa holder; candidates requiring sponsorship are not eligible

Your match

Sign in and add your resume to see which of this job's requirements it shows.

Sign in to check your match

Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.

Full job description

From Sonsoft Inc’s careers site

Company Description

Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

Job Description

  • At least 7+ years of overall experience
  • HDFS architecture and understanding of all critical architectural concepts including type of nodes, node interaction, YARN, Zoo Keeper, and Map reduce etc.
  • Hand on experience in Hive: All concepts including Hive queries, UDF, Different file formats like ORC, AVRO, and Parquet etc.
  • Hand on experience in developing Sqoop, Spark.
Show full descriptionShow less
  • Experience in processing structured data - Warehousing Concepts like de-duplication, cleansing, look ups, transformation, data versioning etc.
  • Hand on experience in developing Oozie workflow definition and execution
  • Knowledge of a HDFS distribution preferably Cloudera. Understanding of Monitoring and operational capabilities of the distribution
  • Knowledge of Flume, Kafka is a plus
  • Hand on experience in programming languages like Java, Python, Perl.

Qualifications

  • Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
  • At least 4 years of experience within the Information Technologies.

Additional Information

** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.

Note:- 1.This is a Full-Time & Permanent job opportunity for you. 2.Only US Citizen Green Card Holder GC-EAD,& TN can apply. 3.No H4-EAD L2-EAD OPT-EAD, H1B candidates please. 4.Please mention your Visa Status in your email or resume.

Something wrong with this job? Report it · This flag looks wrong

Similar jobs

Medicaid Data Lead

Abt Global · Rockville, MD +3 places

$110k–$155k/yr

StrongChecked open todayPosted 9 days ago

Senior Data Engineer

Vericast · Remote · US only

$130k–$150k/yrFull-time

StrongChecked open todayPosted yesterday

Senior Data Engineer

AIR Communities · Denver, CO

$125k–$145k/yrFull-timeOn-site

StrongChecked open todayPosted 2 days ago

Lead Data Engineer

AIR Communities · Denver, CO

$135k–$160k/yrFull-timeOn-site

StrongChecked open todayPosted 2 days ago

Sr. Data Engineer

NBCUniversal · New York, NY

$115k–$145k/yrFull-timeHybrid

StrongChecked open todayPosted 3 days ago

See more like this