Data Engineer Principal

ACCOUNTABILITIES:

• All team members must champion and model our values of partnership, curiosity, compassion, integrity, and excellence, and must contribute to a culture of continuous learning.
• Work with stakeholders, data scientists and analysts to frame problems, clean and integrate data, and determine the best way to provision that data on demand
• Collaborate with other engineers to design technology solutions that achieve measurable results at scale
• Provide technical thought leadership for efficient data pipeline processes, warehouse architecture and business intelligence functions.
• Assist in the development of short, medium, and long-term plans to achieve strategic objectives.
• Guide, mentor, influence, and adopt a cloud-first modern data architectural direction, and consistently adopt the associated standards and best practices
• Develop, maintain, and distribute up-to-date training documentation and learning resources.
• Design and facilitate engaging learning labs, combining presentations with hands-on exercises.
• Create and deliver advanced training tailored for leadership, enabling them to support their teams effectively in a data-driven environment.
• Act as a technical translator and coach, helping team members understand and apply concepts related to data lakes, data governance, and data engineering.
• Collaborate with SMEs, engineers, and leadership to identify learning needs and close knowledge gaps.
• Serve as a solutions architect when needed, guiding technical setup and best practices in the absence of deep technical leadership.
• Champion a culture of continuous learning and technical enablement across the department.

REQUIRED SKILLS/ QUALIFICATIONS:

Bachelor’s degree in computer science, data or social science, operations research, statistics, applied mathematics, econometrics, or a related quantitative field AND 4+ years of experience in business analytics, data science, software development, data modeling and/or data engineering work OR Master's Degree in Computer Science, Math, Software is acceptable

• 10+ years of programming experience with command in at least two or more of the following programming languages: SQL, Python, Java, R or Spark
• Expert proficiency in SQL; experience with Oracle, PostgreSQL, MySQL, or Microsoft SQL Server
• 10+ years of experience using a combination of tools such as Azure Data Factory, Synapse, Data Explorer, App Insights, Power BI, and Databricks
• 3+ years of experience using Azure CosmosDB and Azure Data Lake Storage
• Must be motivated, self-driven, curious, and creative
• Proven ability to lead projects and teams with minimal guidance
• Must be skilled communicator, and demonstrate an ability to work with end users and business leaders
• Demonstrate the ability to support and complement the work of a diverse development and/or operations team
• Lead a collaborative, cross-functional team, Active participation in sprint reviews
• Expert and a minimum of five years' experience in the following domains: Data management, software engineering, I&O (infrastructure and operations)

PREFERRED QUALIFICATIONS:

• Knowledge of health care operations
• Exposure to agile/scrum
• Ability to work in a hybrid cloud environment consisting of on premise and public cloud infrastructure. An ideal candidate will have experience with one or more of the following skill sets
  • Expert in Relational databases like Oracle, SQL server
  • Expert in Optimizing and tuning SQL/Oracle queries, stored procedures and triggers
  • Expert in Python (numpy, pandas, matplotlib etc) and Jupyter notebooks for exploratory data analysis, machine learning, and process automation
  • Expert in areas of CI/CD, Continuous testing, and site reliability engineering.
  • Expert in Microsoft Azure applications such as Azure Data Factory, Synapse, Purview, Databricks /Spark, Power BI, PowerApps.
  • Expert in event streaming tools like NiFi, Kafka and Flink
  • Expert in data processing tools, like Apache’s Sqoop, Spark and Hive
  • Expert in Document or NoSQL datastores, particularly MongoDB
  • Expert in Power BI data models using advanced Power Query and DAX
  • Expert in in AI/ML Ops
• Interest and desire to contribute to emerging practices around DataOps (CI/CD, IaC, configuration management, etc.)
• Collaborate effectively with product management, program management, engineers, and stakeholders.
• Excellent analytical and critical thinking skills
• Ability to influence without authority and thrive in an ambiguous environment.