Game Tester Freshers Walk-in Drive - GlobalStep Pune

Salary

1-4 LPA

Location

Mumbai

Highlights

Design scalable data pipelines, real-time processing, cloud deployment support, Hadoop ecosystem tools, automation with shell scripting.

Apply

Description

We are seeking a skilled Hadoop Data Engineer to join our dynamic team in Airoli. As part of the Hardware and Networks department, you will be responsible for designing, maintaining, and optimizing scalable data pipelines using cutting-edge technologies such as Spark, Kafka, Hive, and HDFS.

Key Responsibilities:

• Design and maintain robust, scalable Hadoop-based data pipelines to support real-time processing requirements.
• Implement batch and real-time data processing using Spark and Kafka, ensuring efficient data ingestion and transformation.
• Manage cluster environments and automate tasks with shell scripting for enhanced productivity and reliability.
• Support cloud deployments, leveraging technologies like Cloudera to ensure seamless integration and management of big data solutions.

Candidate Profile:

• 0-1 year of experience in Big Data with proficiency in Hadoop, Hive, Spark, and Kafka.
• Expertise in batch and real-time processing using Java/Python/Scala, as well as SQL and NoSQL databases.

Essential Skills:

• Experience with Hadoop ecosystem tools including Spark, Kafka, Hive, and HDFS.
• Familiarity with cloud technologies such as Cloudera for big data processing.
• Proficiency in shell scripting for automation tasks.
• Demonstrated knowledge of distributed systems and real-time data processing.
• Experience with NoSQL databases is a plus.

Hiring for:

• A role in the Hardware and Networks - Other department within IT Services & Consulting.

Skills

Hadoop Spark Kafka Shell-Scripting Cloudera