Data Engineer

Job Description

We are looking for an enthusiastic and skilled Data Engineer with hands-on experience in designing, developing, and maintaining scalable data pipelines using distributed data processing technologies. The candidate will work closely with senior engineers and data scientists to support data-driven analytics, insights, and product development.

Key Responsibilities

• Design and develop efficient data pipelines for batch and streaming data processing.
• Work with big data technologies such as Hadoop, Apache Spark, Apache Flink, and Apache Kafka to handle large-scale datasets.
• Support the data science and analytics teams by building ETL processes and transforming raw data into usable formats.
• Collaborate with cross-functional teams to define data ingestion, transformation, and storage strategies.
• Ensure data quality, consistency, and reliability across multiple systems.
• Write clean, reusable, and optimized code in Java and Python for data transformation and processing.
• Participate in performance tuning, monitoring, and troubleshooting of data pipelines.
• Contribute to data platform improvements and automation initiatives.

Technical Skills Required

• Programming Languages: Strong proficiency in Java and Python.
• Big Data Frameworks: Hands-on experience with Hadoop, Spark, Flink, and Kafka.
• Data Pipeline Development: Experience in batch processing and stream processing using Spark Streaming, Flink, or Kafka Streams.
• Data Storage Systems: Understanding of HDFS, Hive, HBase, or similar data storage technologies.
• Version Control: Knowledge of Git or similar version control systems.
• Domain Knowledge (Preferred): Experience in AMI (Advanced Metering Infrastructure) or Energy/Utilities domain will be an added advantage.

Job Types: Full-time, Permanent

Pay: ₹600,000.00 per year

Work Location: In person