5 – 10 years of Python data engineering experience
-
Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc., on AZURE.
-
Experience in developing ETL, OLAP based and Analytical Applications.
-
Experience in ingesting batch and streaming data from various data sources.
-
Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)
-
Ability to quickly learn and develop expertise in existing highly complex applications and architectures.
-
Experience in Azure Data Factory (ADF), Azure Data Brick, Azure Synapse, Azure SQL, Azure DWH, Azure Data Lake Storage / Analytics, Azure Database Migration Services
-
Experience of DevOps and CD/CD tools.
-
Familiarity with Rest APIs
-
Experience with CI/CD pipelines, branching strategies, & GIT for code management
-
Comfortable working in Agile projects
-
Bachelor's degree in computer science, information technology, or a similar field. You will need to be well spoken and have an easy time establishing productive long lasting working relationships with a large variety of stakeholders
-
Take the lead on data pipeline design with strong analytical skills and a keen eye for detail to really understand and tackle the challenges businesses are facing
-
You will be confronted with a large variety of Data Engineer tools and other new technologies as well with a wide variety of IT, compliance, security related issues.
-
Design and develop world-class technology solutions to solve business problems across multiple client engagements.
-
Collaborate with other teams to understand business requirements, client infrastructure, platforms and overall strategy to ensure seamless transitions.
-
Work closely with AI and A team to build world-class solutions and to define AI strategy.
-
You will possess strong logical structuring and problem-solving skills with expert level understanding of database and have an inherent desire to turn data into actions.
-
Strong verbal, written and presentation skills
-
Clear and precise communication skills