Job Description

• OS loading & configuration of name nodes, data nodes and edge nodes in Hadoop cluster

• Configure NFS shares on Data Lake storage nodes & mount across Hadoop cluster nodes

• Installing and upgrading Java on Hadoop nodes

• Installing Hadoop packages

• Performance management (CPU, Memory & disk performance issues)

• Kernel parameter tuning

• Disk management (configuring filesystem, extending filesystem)

• RAID configuration (redundancy for OS drives)

• Hardware issues (add and remove drives, memory)

• Network management (configure IP address, network bonding)

• Upgrade BIOS & network card drivers

• Vendor management (support for hardware & OS)

Day to day Hadoop support

• Monitoring Hadoop Services (HDFS, Yarn, Hive, Impala, Hue, Solr, Zookeeper, Kafka, Spark,

Sqoop, Sentry etc). using Cloudera manager.

• Monitoring the jobs and informed to Onsite team to failed jobs as well log information.

• Identify the failed jobs and gathering log data and fixed the issues.

• Handling the tickets with Hadoop related issues to resolve the with in SLA and priority wise.

Responsibility\'s:

• Hadoop cluster setup, installation, configuration of multi-node cluster using Cloudera

distributions of Hadoop framework services.

• Cluster level security implementation using Kerberos authentication and ACL\'s as well.

• Hive databases, tables, column level security implementation using Sentry authorization.

• Hadoop cluster upgradation

• Commission/decommission the nodes into Hadoop cluster.

• Implementing High availability with Name node and Resource manager.

• Integrate AD with Hadoop cluster.

• Hadoop cluster troubleshooting and improve the cluster performance.

• Prepared technical documentation.

• Helping with our support team members to create the schemas, partitions in hive and impala and remove/add the files into HDFS directory.

• Migrating the hive databases & tables and HDFS files from HDPPDEV cluster to HDPPRD2

cluster.Should take care of issues like below.

• Integrating AD with SVN.

• Data content must be given by the CLIENT.

• Third-party dependency their response/ resolution etc.

• Defects due to hardware failures.

• Wrong data input provide already by customer.

Important Notice: Recruitment ScamsPlease be aware that HARMAN recruiters will always communicate with you from an \'@harman.com\' email address. We will never ask for payments, banking, credit card, personal financial information or access to your LinkedIn/email account during the screening, interview, or recruitment process. If you are asked for such information or receive communication from an email address not ending in \'@harman.com\' about a job with HARMAN, please cease communication immediately and report the incident to us through:HARMAN is proud to be an Equal Opportunity / Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.\xc2\xa9 2024 HARMAN International. All Rights Reserved. If you are using a screen reader and are having problems using this website, please call (800) 645-7484 for assistance.

Harman