Spark Scala Python

Job Summary

Join our dynamic team as a Developer where you will leverage your expertise in Spark Scala Python and SparkSQL to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to enhance data processing capabilities. Your contributions will directly impact our companys growth and societal advancements through data-driven insights.

Responsibilities

• Develop and implement scalable data processing solutions using Spark and Scala to enhance data analytics capabilities.
• Collaborate with data scientists and analysts to optimize data workflows and ensure efficient data processing.
• Design and maintain data pipelines using SparkSQL and Python to support business intelligence initiatives.
• Troubleshoot and resolve technical issues related to Spark applications to ensure seamless data operations.
• Conduct code reviews and provide feedback to team members to maintain high-quality code standards.
• Participate in agile development processes to deliver projects on time and within scope.
• Analyze complex data sets to identify trends and insights that drive business decisions.
• Document technical specifications and processes to ensure knowledge sharing and continuity.
• Stay updated with the latest industry trends and technologies to continuously improve data solutions.
• Work closely with stakeholders to understand requirements and translate them into technical solutions.
• Ensure data security and compliance with company policies and industry regulations.
• Provide technical support and guidance to junior developers to foster a collaborative team environment.
• Contribute to the companys mission by delivering data-driven solutions that positively impact society.

Qualifications

• Possess a strong background in Spark Scala Python and SparkSQL with a minimum of 5 years of experience.
• Demonstrate proficiency in designing and implementing data pipelines and workflows.
• Exhibit excellent problem-solving skills and the ability to troubleshoot complex technical issues.
• Show experience in working within agile development environments and delivering projects on time.
• Have a keen understanding of data security and compliance requirements.
• Display strong communication skills to effectively collaborate with cross-functional teams.
• Be committed to continuous learning and staying updated with industry advancements.

Certifications Required

Certified Spark Developer Python for Data Science Certification