Work with HDFS architecture and related components, including YARN, ZooKeeper, and MapReduce.
Develop with Hive, Sqoop, and Spark, and use Hive queries, UDFs, and common file formats.
Process structured data using warehousing techniques such as cleansing, deduplication, lookups, transformation, and versioning.
Develop and execute Oozie workflows.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Experience
At least 7 years of overall experience
At least 4 years of experience in Information Technologies
Experience processing structured data and warehousing concepts, including deduplication, cleansing, lookups, transformation, and data versioning
Education
Bachelor’s degree or foreign equivalent from an accredited institution; may be substituted with three years of progressive specialty experience for each year of education
Skills
HDFS architecture, including node types and interaction, YARN, ZooKeeper, and MapReduce
Hands-on experience with Hive queries, UDFs, and ORC, Avro, and Parquet file formats
Hands-on experience developing with Sqoop and Spark
Hands-on experience developing and executing Oozie workflows
Hands-on experience with Java, Python, and Perl
Knowledge of a HDFS distribution, preferably Cloudera, including its monitoring and operational capabilities (preferred)
Knowledge of Flume and Kafka (preferred)
Other requirements
Must be a U.S. citizen, Green Card holder, GC-EAD holder, or TN visa holder; the employer cannot sponsor. H4-EAD, L2-EAD, OPT-EAD, and H1B candidates are not accepted
Your match
Sign in and add your resume to see which of this job's requirements it shows.
Saved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
Full job description
From Sonsoft Inc’s careers site
Company Description
Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.
Job Description
At least 7+ years of overall experience
HDFS architecture and understanding of all critical architectural concepts including type of nodes, node interaction, YARN, Zoo Keeper, and Map reduce etc.
Hand on experience in Hive: All concepts including Hive queries, UDF, Different file formats like ORC, AVRO, and Parquet etc.
Hand on experience in developing Sqoop, Spark.
Show full descriptionShow less
Experience in processing structured data - Warehousing Concepts like de-duplication, cleansing, look ups, transformation, data versioning etc.
Hand on experience in developing Oozie workflow definition and execution
Knowledge of a HDFS distribution preferably Cloudera. Understanding of Monitoring and operational capabilities of the distribution
Knowledge of Flume, Kafka is a plus
Hand on experience in programming languages like Java, Python, Perl.
Qualifications
Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
At least 4 years of experience within the Information Technologies.
Additional Information
** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.
Note:- 1.This is a Full-Time & Permanent job opportunity for you. 2.Only US Citizen Green Card Holder GC-EAD,& TN can apply. 3.No H4-EAD L2-EAD OPT-EAD, H1B candidates please. 4.Please mention your Visa Status in your email or resume.