Develop with Sqoop and Spark and create and execute Oozie workflows.
Use Hive queries, UDFs, and file formats to work with data.
Process structured data, including deduplication, cleansing, lookups, transformation, and data versioning.
Translate functional and non-functional requirements into system requirements.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Licenses and certifications
Cloudera certification
Experience
At least 7 years of overall experience
Experience processing structured data, including de-duplication, cleansing, lookups, transformation, and data versioning
At least 4 years of experience translating functional and non-functional requirements into system requirements
Experience working with business users to analyze and understand business data and scenarios
Experience leading medium- to large-sized teams
At least 4 years of experience in Information Technologies
Education
Bachelor’s degree or foreign equivalent from an accredited institution, or three years of progressive specialty experience in lieu of each year of education
Skills
HDFS architecture and understanding of node types, node interaction, YARN, ZooKeeper, and MapReduce
Hands-on experience with Hive queries, UDFs, and file formats including ORC, Avro, and Parquet
Hands-on experience developing with Sqoop and Spark
Hands-on experience developing Oozie workflow definitions and executing workflows
Knowledge of an HDFS distribution and its monitoring and operational capabilities
Hands-on experience with Java, Python, or Perl
Knowledge of PL/SQL
Knowledge of Flume and Kafka (preferred)
Knowledge of the Cloudera HDFS distribution (preferred)
Your match
Sign in and add your resume to see which of this job's requirements it shows.
Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
Full job description
From Sonsoft Inc’s careers site
Company Description
Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.
Job Description
Job Description:-
At least 7+ years of overall experience
HDFS architecture and understanding of all critical architectural concepts including type of nodes, node interaction, YARN, Zoo Keeper, and Map reduce etc.
Hand on experience in Hive: All concepts including Hive queries, UDF, Different file formats like ORC, AVRO, and Parquet etc.
Hand on experience in developing Sqoop, Spark.
Show full descriptionShow less
Experience in processing structured data - Warehousing Concepts like de-duplication, cleansing, look ups, transformation, data versioning etc.
Hand on experience in developing Oozie workflow definition and execution
Knowledge of a HDFS distribution preferably Cloudera. Understanding of Monitoring and operational capabilities of the distribution
Knowledge of Flume, Kafka is a plus
Hand on experience in programming languages like Java, Python, Perl.
At least 4 years of experience in translating functional/non-functional requirements to system requirements.
Experience in working with business users to analyze and understand business data and scenarios.
Ability to work in a team environment with client interfacing skills.
Experience and desire to work in a Global delivery environment.
Experience leading medium to large sized teams.
CloudEra Certification
Knowledge of PLSQL.
Qualifications
Basic Qualifications :-
Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
At least 4 years of experience within the Information Technologies.
Additional Information
Note:- This is a Full-Time & Permanent job opportunity for you. Only US Citizen, Green Card Holder, GC-EAD, H4-EAD & L2-EAD can apply. No OPT-EAD, H1B & TN candidates please. Please mention your Visa Status in your email or resume.