DATA Engineer - Nosql Hadoop

Ashtopus Consulting
  • Mumbai
  • Confidential
  • 2-7 years
  • 173 Views
  • 05 May 2015
dfdf

  • Software Design & Development

  • IT/ Technology - Software/ Services
Job Description

Education : IIT/NIT/PEC/Thapar

Responsibilities:

Architecting scalable databases, handling server scalability/availability and database capacity planning. Managing database performance with indexing, sharing and query optimization.
Build scalable pipelines for data analysis. Design near real-time (low latency) infrastructure for reporting, experimentation, and analysis.
Lead the development of NoSQL/Hadoop use-cases and solutions.
Analyze and improve efficiency, scalability, and stability of data collection, storage, and retrieval processes.

Requirements:

Experience in designing and architecting large data warehouse systems.
Serious experience with Postgres or other relational database. Experience in database replication, performance tuning and backup.
Experience with capturing, managing, and processing Big Data (terabytes of data present in web logs, documents, etc.).
Fluency with at least one scripting language like Python, Ruby or Scala.
Knowledge of non-relational databases like MongoDB or Hadoop, query tools (e.g. Hive or Pig) and tools for distributed computation (e.g. Spark).
Should value simple solutions, write concise code, lead with tests, and believe in devops.


Job Posted By

About Organisation

Ashtopus Consulting