Job Summary
The Sr Product Specialist(ISG) will play a crucial role in driving product innovation and excellence within the organization. With a focus on leveraging technical expertise in PySpark Azure Data Lake and Study Data Tabulation Model the candidate will contribute to the development and enhancement of data-driven solutions. This hybrid role requires a proactive approach to problem-solving and collaboration with cross-functional teams to achieve strategic objectives.
Responsibilities
-
Experienced in working with PySpark Data Frames Data Bricks and Azure Data Lake
-
Experienced in creating reusable parameterized libraries resp. re-usable code in Python for repetitive data transformations
-
Experience in writing and executing various types of DDL and DML SQL statements
-
Good Analytical and troubleshooting skills to resolve issues
-
Experienced in working with Git ADO and deployment pipelines
-
Good experience in Azure Data Factory for data transformation building and executing pipelines
-
Experienced in testing data transformations and pipelines
-
Good understanding of ETL Source to Target Mappings and Data warehousing concepts
-
Knowledgeable of data modeling principles and experience in designing efficient data models in Delta Lake including partitioning parallelization
-
Optionally understanding of data collected during ongoing clinical studies in pharmaceutical industry
-
Optionally understanding of SDTM as data model for clinical data
-
Experience in the life sciences/ pharma industry will be an added advantage
-
Good Communication skills
-
Update work items promptly and accurately in Azure Dev Ops
-
Attend scrum calls on time and provide proper updates on work items
-
Ability to work independently with Project Managers and Data Scientists for assigned tasks
-
Raise issues and showstoppers in team meetings and follow up/get it addressed
-
Work closely with other Azure Data Engineers and other team members for resolution of common issues
-
Provide regular status updates to leads and help in resolving issues