Software Engineer II - Databricks, Python

Unlock the power of data with our expert Databricks Developer, transforming complex datasets into actionable insights with seamless efficiency. Elevate your business intelligence and drive innovation through cutting-edge data engineering solutions

Job Summary:

As a Databricks Developer at JPMorgan Chase within our Corporate Technology team, you will play a pivotal role in our cloud transformation journey. You will design, develop, and implement cloud-based solutions, replacing our existing SQL/On Premises infrastructure. Your expertise will enhance our data processing capabilities, empowering end users to swiftly access data and derive insights.

Job Responsibilities:

• Collaborate with cross-functional teams to understand business requirements and design cloud-based solutions.
• Lead the migration of existing SQL databases/ETL Layer and applications to Databricks and other cloud platforms.
• Drive the development and deployment of processes using the DBX framework.
• Develop, test, and deploy scalable and efficient cloud applications.
• Optimize data processing workflows while ensuring data integrity and security.
• Provide technical guidance and support to team members and stakeholders.
• Stay abreast of the latest cloud technologies and best practices

Required Qualifications, Capabilities, and Skills:

• Formal training or certification on software engineering concepts and 3+ years applied experience
• Proficiency with hands-on experience in programming languages such as Python and Big Data technologies like Spark, Kafka.
• Strong expertise in Databricks and cloud platforms such as AWS Cloud.
• Proven experience in SQL database management and development.
• Experience with data integration, ETL processes, and data warehousing.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills. Ability to work independently and efficiently.

Preferred Qualifications, Capabilities, and Skills:

• Certification in cloud technologies (e.g., AWS Certified Solutions Architect).
• Knowledge of ETL technologies like Abinitio/Informatica/Prophecy.
• Knowledge of DevOps practices and CI/CD pipelines, containerization - Docker, Kubernetes.
• Databricks certified Data Engineer or equivalent.
• Strong financial and business analytical skills.