Bigdata/Hadoop Administrator

Over all 13 years of IT experience and which includes 4.5 yrs of Hadoop administration activities such as implement and configuration of multi node cluster support and maintenance activities using Cloudera distribution.

• Maintained Hadoop clusters health through Cloudera Managers.         
• Extensively involved in Installation and configuration of Cloudera distribution Hadoop, Name Node, Job Tracker, Task Tracker and Data Nodes. 
• Monitored workload, job performance and capacity planning using the Cloudera ManagerInterface.          
• Configured MySQL Database to store Hive metadata.                                                                          
• Responsible for loading unstructured data into Hadoop File System (HDFS).                                                                           
• Used Sqoop tool to load data from RDBMS into HDFS , HIVE.                                                                            
• Installed and configured Hadoop ecosystem like HBase, Flume, Pig and Sqoop, Hive.                                                                      
• Involved in Hadoop cluster task like Adding and Removing Nodes without any effect to running jobs and data.                                                           
• Implemented Fair scheduler on the job tracker to allocate fair amount of resources to small jobs.                                                                        
• Configured Oozie for workflow automation and coordination.  
• Working knowledge on hive and its components and troubleshooting if any issues with hive and query tuning in hive to improve the performancequery.                                                                           Configured SSL Certificate for new node.                     
• Performed performance tuning for spark, sparksql jobs .     
• Migrating Hive database from HDPDEV to HDPPRD1.                     
• Backup Configuration and recovery from namenode failure.    
• Excellent Experience in Hadoop architecture and various components such as Job tracker, Task tracker , Namenode, Datanode, MapReduce, YARN, and tools including hive for data analysis, Sqoop for data migration, Flume for data ingestion, Oozie for scheduling, and Zookeeper for coordinating cluster resources.