Hadoop Developer and Hadoop Administrator

Ikya Human Capital Solutions Pvt Ltd
  • Chennai
  • 10-15 lakh
  • 4-9 years
  • 342 Views
  • 15 Sep 2016
dfdf

  • Project/ Program Management IT

  • IT/ Technology - Software/ Services
Job Description

Hadoop Developer: 4 to 7 years.

Very strong experience in core java.
Deep understanding of Hadoop architecture, HDFS, MapReduce and other components in the Cloudera - Hadoop echo system.
Responsible for the development of distributed computing tasks which include MapReduce, NoSQL, and other distributed environment technologies based on need or preference to solve the problems that arise.
Extensive experience developing complex MapReduce programs against structured and unstructured data.
Experience with loading data to Hive and writing software accessing Hive data using Hive and Impala.
Experience loading external data to Hadoop environments using tools like MapReduce, Sqoop and Flume.
Experience using scripting languages like Pig to manipulate data.
Experience working with very large data sets, knows how to build programs that leverage the parallel capabilities of Hadoop and MPP platforms
Experience with relational database technologies (Oracle, SQL Server, MySQL), inclusive of data Modeling and a working knowledge of SQL
Prefer experience with Cloudera Hadoop distribution components and custom packages.
Prefer experience with columnar DB solutions (e.g. Vertica, Cassandra, Greenplum) in cases where a columnar DB is best for data management
Working experience on Maintenance Projects.
Hands on expertise gathering requirements, designing, building, and implementing Data Integration applications.


Job Description for Hadoop Administrator

Skill Area Hadoop solutions Administration,
Configure various tools in the Hadoop ecosystem (monitoring, data loading, and workflow schedulers), Manage Cloudera distribution of Hadoop, Development experience with Impala, Hive and Pig.

Experience with cloud-based platforms and its relation to Big Data technologies.
Experience (Approx. in Yrs.) Overall can be 6+.

Relevant Certifications Cloudera Certification (Hadoop developer CCDH and/or Hadoop Admin CCAH).

Essentials: Key Job related (technical/ Functional) skills Desirable: Additional technical skills that would make the candidate more suitable
Proven experience with architecting and implementing Hadoop solutions in highly available, scalable production environments.
Ability to install / configure various tools in the Hadoop ecosystem (monitoring, data loading, workflow schedulers)
Experience managing Cloudera distribution of Hadoop (CDH3, CDH4, Cloudera manager, MapR, Hortonworks, etc.)
Ability to analyze and performance tune a Hadoop cluster.
Development experience with Impala, Hive and Pig.
Experience with cloud-based platforms and its relation to Big Data technologies.
Familiarity with SDLC processes and methodologies Background with NoSQL databases (HPCC, HBase, Cassandra, MongoDB).
Experience with relational database technologies (Oracle, SQL Server, MySQL), inclusive of data modeling and a working knowledge of SQL.
Experience in Data warehousing and modeling concepts.
Worked with ETL and traditional BI tools.


Job Posted By