Hadoop Administration ( Lead )
Sonsoft Inc (agency)Austin, TXFull-time
Pay not listed
Key facts
- Experience
- 2+ years
- Degree
- Bachelor's degree
- US visa
- No US visa sponsorship
2 things to check before you apply.
On Sonsoft Inc’s own careers site (SmartRecruiters), checked open today.
- To check: Posted by the employer 9 years agoLong-open jobs are sometimes already filled. Ask when they plan to hire.
- To check: No pay range listedAsk for the pay range before you interview.
- Checked: On the company's own careers siteSmartRecruiters board
- Checked: Checked open todaySmartRecruiters board
- Checked: No reposts foundSmartRecruiters board
- Trust score 60 / 100 · Check details
See all 6 checksShow fewer
What you’ll do
- Maintain, upgrade, and administer Hadoop clusters, including creating and removing nodes and managing configurations.
- Monitor cluster availability, connectivity, security, performance, logs, file systems, and disk space; troubleshoot and tune clusters and MapReduce routines.
- Set up and maintain Hive, Pig, and MapReduce infrastructure and Hadoop application development environments.
- Manage Linux users, groups, Kerberos principals and keys, software installations, patches, and upgrades.
Summarised from the posting by AI and can be wrong. The full description is the source.
Requirements
Experience
- At least 2 years of experience implementing and administering Hadoop infrastructure
- At least 2 years of experience in project life cycle activities on development and maintenance projects
- Experience with Cloudera Manager or Ambari, Ganglia, and Nagios
- Experience using Hadoop schedulers: FIFO, Fair Scheduler, and Capacity Scheduler
- Experience with job schedule management using Oozie or enterprise schedulers such as Control-M or Tivoli
- Exposure to setting up AD/LDAP/Kerberos authentication models
- Experience in Shell and Perl scripting and exposure to Python
- Exposure to real-time execution engines such as Spark, Storm, and Kafka
- Experience with version control tools such as Subversion, ClearCase, CVS, or GitHub
- Experience with service management ticketing tools such as ServiceNow, Service Manager, or Remedy
Education
- Bachelor’s degree or foreign equivalent from an accredited institution, or three years of progressive specialty experience in lieu of each year of education
Skills
- Operational expertise in troubleshooting and understanding system capacity, bottlenecks, memory, CPU, OS, storage, and networks
- Experience with Hadoop, MapReduce, HBase, Hive, Pig, and Mahout
- Good knowledge of Linux
- Familiarity with configuration management and deployment tools such as Puppet or Chef, Linux scripting, and Autosys
- Knowledge of troubleshooting Core Java applications (preferred)
Your match
Sign in and add your resume to see which of this job's requirements it shows.
Sign in to check your matchSaved to your account, encrypted. The AI that reads it doesn't keep it or train on it.
Full job description
From Sonsoft Inc’s careers site
Company Description
Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.
Job Description
Show full descriptionShow less
- At least 2 years of experience in Implementation and Administration of Hadoop infrastructure
- At least 2 years of experience in Project life cycle activities on development and maintenance projects.
- Operational expertise in troubleshooting , understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
- Hadoop, MapReduce, HBase, Hive, Pig, Mahout
- Hadoop Administration skills: Experience working in Cloudera Manager or Ambari, Ganglia, Nagios
- Experience in using Hadoop Schedulers - FIFO, Fair Scheduler, Capacity Scheduler
- Experience in Job Schedule Management - Oozie or Enterprise Schedulers like Control-M, Tivoli
- Good knowledge of Linux
- Exposure to setting up Ad/LDAP/Kerberos Authentication models
- Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting, Autosys
- Experience in Shell and Perl scripting and exposure to Python
- Knowledge of Troubleshooting Core Java Applications is a plus
- Exposure to Real-time Execution engines like Spark, Storm, Kafka
- Version control Management tools : Subversion or Clearcase or CVS, Github
- Experience in Service Management Ticketing tools - ServiceNow, Service Manager, Remedy
Responsibilities Upgrades Hadoop Ecosystem and Clusters maintenance as well as creation and removal of nodes Perform administrative activities with Cloudera Manager/Ambari and tools like Ganglia, Nagios Setting up and maintaining Infrastructure and configuration for Hive, Pig and MapReduce Monitor Hadoop Cluster Availability, Connectivity and Security
- Setting up Linux users, groups, Kerberos principals and keys
- Aligning with the Systems engineering team in maintaining hardware and software environments required for Hadoop
- Software installation, configuration, patches and upgrades
- Working with data delivery teams to setup Hadoop application development environments
- Performance tuning of Hadoop clusters and Hadoop MapReduce routines
- Screen Hadoop cluster job performances
- Data modelling, Database backup and recovery
- Manage and review Hadoop log files
- File system management, Disk space management and monitoring (Nagios, Splunk etc)
- HDFS support and maintenance
- Planning of Back-up, High Availability and Disaster Recovery Infrastructure
- Diligently teaming with Infrastructure, Network, Database, Application and Business Intelligence teams to guarantee high data quality and availability
- Collaborating with application teams to install operating system and Hadoop updates, patches and version upgrades
- Ability to work in team in diverse/ multiple stakeholder environment
- Experience to XXdomain
- Experience and desire to work in a Global delivery environment
Qualifications
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 4 years of overall IT experience
Additional Information
** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.
Note:- 1.This is a Full-Time & Permanent job opportunity for you. 2.Only US Citizen Green Card Holder GC-EAD,& TN can apply. 3.No H4-EAD L2-EAD OPT-EAD, H1B candidates please. 4.Please mention your Visa Status in your email or resume.
Something wrong with this job? Report it · This flag looks wrong