Big Data Administrator

Pitney Bowes Software India Pvt. Ltd.
  • Noida
  • Confidential
  • 7-10 years
  • 09 Sep 2015

  • Project/ Program Management IT

  • IT/ Technology - Software/ Services
Job Description


As a Big Data Architect and Lead, you will be part of the Big Data and Analytics Platform Team .The Team has built a multi-tenant Amazon Platform using several technologies including S3, IAM, EMR, Spark, Kinesis, Redshift, Dynamo, R and other technologies. This is enabling Business Units, Clients and Partners to publish data catalog, store the data in common Data Lake and data scientists to develop new value offerings and productize them for monetizable value.

The Job

* Working on the cutting edge of a wide range of innovative AWS uses cases and AWS Big Data Solutions including S3, EMR, Spark, Redshift and other integration tools
* Architecting solutions for massive scale, resiliency and maintainability with capacity planning using optimal instances, reserved and spot instances
* Designing software-defined networks and secure data access
* Setting-up and configuring AWS services to best practices and managing platform to comply to data governance and security policies defined by PB
* Administration of Data Lake and Data Hub to onboard data providers
* Integrating AWS asset provisioning with code release and continuous deployment processes
* Automated software deployment and configuration management
* Creating code assets and tools to accelerate customer projects
* Support of production workloads and production solutions
* Coaching Customer and Partner teams to be self-sufficient

Qualifications & Skills required

* BS level technical degree; Computer Science or Engineering background preferred; Masters degree desired
* 7+ years of experience in cloud related technologies
* Hands-on technical practitioner and individual contributor
* Strong verbal and written communication skills, with the ability to work effectively across internal and external organizations

* Must Have Skills:

o Strong practical Linux and Windows-based systems administration skills in a Cloud or Virtualized environment
o Experience building sophisticated and highly automated infrastructure
o Prior success in automating a real-world production environment
o Experience with Chef, Puppet, Salt, or Ansible in production environments with many nodes
o Familiarity with Cloud Formation and JSON
o Strong scripting skills, i.e., PowerShell, Python, Bash, Ruby, etc
o Knowledge of IP networking, VPN's, DNS, load balancing and firewalling
o Familiarity with any monitoring tools like Nagios, Incinga, SiteScope, etc
o Experience with revision control source code repositories (Git, SVN, Mercurial, Perforce)
o Management of continuous integration servers like Jenkins, Bamboo and TeamCity
o Experience with seamless/automated build scripts used for release management across all environments
o Experience with automated testing tools (ie. Selenium, JMeter)
o Understanding and experience with code deployment (tagging)
o Active open source contributor
o Understanding of Service-Oriented Architecture (SOA and REST)

* Good to have Skills:
o Experience working in cross-functional, multi-location teams
o Deep understanding and practice of Agile (Scrum)

Job Posted By