Data Engineer

We are seeking a highly skilled and motivated Data Engineer to join our growing team. The ideal candidate will have a strong background in building and maintaining scalable data pipelines, with hands-on experience in ETL processes, Python programming, Apache Airflow, Apache Spark, and Neo4j graph database technology. You will play a crucial role in designing, implementing, and managing our data infrastructure to support our data-driven initiatives.

Responsibilities:

* Design, build, and maintain robust and scalable ETL pipelines to ingest data from a wide variety of sources.

* Develop and optimize data processing workflows and data models for efficiency and reliability.

* Utilize Apache Spark for large-scale data processing and complex data transformations.

* Orchestrate and schedule data pipelines using Apache Airflow, ensuring timely and accurate data delivery.

* Write clean, efficient, and well-documented Python code for data manipulation and automation.

* Model, implement, and manage graph databases using Neo4j to uncover relationships and insights within our data.

* Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver actionable1 insights.

* Ensure data quality and integrity through rigorous testing and validation.

* Monitor, troubleshoot, and resolve issues related to data pipelines and infrastructure.

* Stay up-to-date with emerging technologies and best practices in data engineering.

Qualifications:

• Proven experience as a Data Engineer or in a similar role.

• Strong proficiency in Python and its data-related libraries (e.g., Pandas, PySpark).

• Hands-on experience with ETL concepts and tools.

• Demonstrable experience with Apache Spark for distributed data processing.

• In-depth knowledge of workflow management and orchestration using Apache Airflow.

• Experience with graph databases, specifically Neo4j, including data modeling and Cypher query language.

• Solid understanding of SQL and NoSQL databases.

• Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and their data services.

• Excellent problem-solving and analytical skills.

• Strong communication and collaboration abilities.

• Bachelor's degree in Computer Science, Engineering, or a related field.

• Python, API & ETL Development, and Selenium Automation.

Job Type: Contractual / Temporary
Contract length: 3-6 months

Pay: ₹90,000.00 - ₹100,000.00 per month

Benefits:

• Work from home

Application Question(s):

• Do you have Strong proficiency in Python and its data-related libraries (e.g., Pandas, PySpark)?
• Do you have experience Working with ETL concepts and tools?
• Do you have experience Working with Selenium Automation?

Experience:

• Data Engineer: 5 years (Required)

Work Location: Remote