Develop with Hive, Sqoop, and Spark to process structured data.
Apply data warehousing techniques, including deduplication, cleansing, lookups, transformation, and versioning.
Develop and execute Oozie workflows.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Experience
At least 7 years of overall experience
Experience processing structured data and applying warehousing concepts such as deduplication, cleansing, lookups, transformation, and data versioning
At least 4 years of experience in Information Technologies
Education
Bachelor’s degree or foreign equivalent from an accredited institution, or progressive specialty experience in lieu of education at three years per year of education
Skills
HDFS architecture knowledge, including node types and interaction, YARN, ZooKeeper, and MapReduce
Hands-on experience with Hive, including queries, UDFs, and ORC, Avro, and Parquet file formats
Hands-on experience developing with Sqoop and Spark
Hands-on experience developing and executing Oozie workflow definitions
Knowledge of a HDFS distribution and its monitoring and operational capabilities
Hands-on experience with Java, Python, or Perl
Knowledge of Cloudera (preferred)
Knowledge of Flume or Kafka (preferred)
Other requirements
U.S. citizen, Green Card holder, GC-EAD, H4-EAD, or L2-EAD; the employer is unable to sponsor. OPT-EAD, TN visa, and H1B consultants are not eligible.
Your match
Sign in and add your resume to see which of this job's requirements it shows.
Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
Full job description
From Sonsoft Inc’s careers site
Company Description
Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.
Job Description
At least 7+ years of overall experience
HDFS architecture and understanding of all critical architectural concepts including type of nodes, node interaction, YARN, Zoo Keeper, and Map reduce etc.
Hand on experience in Hive: All concepts including Hive queries, UDF, Different file formats like ORC, AVRO, and Parquet etc.
Hand on experience in developing Sqoop, Spark.
Show full descriptionShow less
Experience in processing structured data - Warehousing Concepts like de-duplication, cleansing, look ups, transformation, data versioning etc.
Hand on experience in developing Oozie workflow definition and execution
Knowledge of a HDFS distribution preferably Cloudera. Understanding of Monitoring and operational capabilities of the distribution
Knowledge of Flume, Kafka is a plus
Hand on experience in programming languages like Java, Python, Perl.
Qualifications
Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
At least 4 years of experience within the Information Technologies.
Additional Information
** U.S. citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.
Note:-
This is a Full-Time Permanent job opportunity for you.
Only US Citizen, Green Card Holder, GC-EAD, H4-EAD & L2-EAD can apply.
No OPT-EAD, TN Visa & H1B Consultants please.
Please mention your Visa Status in your email or resume.