- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and Databricks
- Highly proficient with Python and PL/SQL
- Experience in building ETL / data warehouse transformation processes
- Strong experience with Big Data, Data analysis with excellent analytical and problem-solving abilities
- Experience in Big Data components such as Spark SQL, Data frames, HIVE DB etc. implemented using Data Bricks would be preferred.
- Hands on experience on Cloud based environments - AWS preferred
- Hands on experience on AWS S3, Lambda, Redshift, Redshift Spectrum, Athena
- Excellent understanding of the full SDLC lifecycle including both waterfall, agile and DevOps methodologies
- Desire to work on a fast-paced, agile team
- Excellent written and verbal communication skills
Desired Skills
AWS | BigData | PL/SQL | SQL
Desired Candidate Profile
Qualifications : BACHELOR OF ENGINEERING