Big Data Developers / Specialists - Hadoop/Hive/Pig

TechChefs Software
  • Bangalore
  • Confidential
  • 2-8 years
  • 18 Aug 2015

  • Software Design & Development, IT/ Information Technology

  • IT/ Technology - Software/ Services, IT/ Technology - Data Center/ Manage Infrastructure Services
Job Description

Job Description:

- Write Pig scripts to load data from - log files-
- Clean and join data sets, using Pig scripts and Hive queries
- Write Pig scripts and Hive queries to determine behaviour of customers (and other analytic)
- Update data onto Vertica database
- Handle a diversity of input data sources such as csv, JSON or data via APIs
- Scripts run on Amazon EC2 and data sources are on SFTP and Amazon S3 or via APIs (example : Sabre)

Required Qualifications and Competencies :

- Should have project exposure to big data problems (ingestion, reporting, ETL and analytics)
- Hands-on in writing Pig scripts
- Excellent in writing UDFs in Java for Pig
- Hands-on in writing Hive queries
- Very strong in SQL queries
- Exposure to Amazon EC2 and Amazon S3 is highly desirable
- Exposure to Azkaban / Oozie / Vertica / Scoop

Competencies/Skill sets for this job

Pig Hive Hadoop Big Data Sap Hana Vertica Scoop Azkaban Oozie

About Organisation

TechChefs Software