FIND_THE_RIGHTJOB.
Java Spark Developer (Pls avoid big data developer profile)
JOB_REQUIREMENTS
Hires in
Not specified
Employment Type
Not specified
Company Location
Not specified
Salary
Not specified
6+yrs
Chennai, Bangalore, Pune, Mumbai (Immediate Joiners to serving notice up to December).
Java Developer Hadoop, Java, Spark Offshore Key Responsibilities:
- Design and Development:
- Design, develop, and implement scalable and robust data pipelines and applications using Apache Spark with Java.
- Write efficient and optimized code for data processing, transformation, and analysis.
- Develop and maintain APIs and microservices using Java or Python for integrating with various systems.
- Data Management & Analysis:
• Work extensively with SQL for querying, manipulating, and optimizing relational databases (e.g., PostgreSQL, MySQL, Oracle, MS SQL Server). • Design and implement database schemas, stored procedures, and complex queries.
- Perform data analysis and develop insights from large datasets using Spark and relevant libraries.
- Big Data Ecosystem:
- Utilize and manage components within the Hadoop ecosystem (HDFS, YARN) for distributed storage and processing.
- Implement and manage data ingestion and orchestration workflows (e.g., Apache Airflow, Oozie).
- System Administration & Scripting:
- Work proficiently in Linux/Unix environments, including shell scripting for automation, system monitoring, and deployment tasks.
- Manage and configure servers and cloud resources (e.g., AWS EC2, EMR).
- Collaboration & Best Practices:
- Collaborate with data scientists, analysts, and other engineers to understand requirements and deliver solutions.
- Participate in code reviews, promote best practices, and ensure code quality and maintainability.
- Adhere to Agile/Scrum methodologies for software development.
- Performance Optimization & Troubleshooting:
- Identify and resolve performance bottlenecks in Spark jobs and data pipelines.
- Troubleshoot issues related to data processing, system stability, and application functionality.
Job Location: BangaloreChennaiMumbaiPune
© 2025 Qureos. All rights reserved.