Data Engineer

ACCOUNTABILITIES:

• All team members must champion and model our values of partnership, curiosity, compassion, integrity, and excellence, and must contribute to a culture of continuous learning
• Work with stakeholders, data scientists and analysts to frame problems, clean and integrate data, and determine the best way to provision that data on demand
• Collaborate with other developers to design technology solutions that achieve measurable results at scale
• Help design and develop scalable, efficient data pipeline processes to handle data ingestion, cleansing, transformation, integration, and validation required to provide access to prepared data sets for business partners and web developers
• Utilize development best practices including technical design reviews, implementing test plans, monitoring/alerting, peer code reviews, and documentation
• Collaborate with cross functional team to resolve data quality and operational issues and ensure timely delivery of products
• Incorporate core data management competencies including data governance, data security and data quality.
• Participate in requirements gathering sessions with business and technical staff to distill technical requirement from business requests
• Assist Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
• Perform other duties as required, to meet team sprint goals

REQUIRED SKILLS/Qualifications:

• Bachelor's in computer science, data or social science, operations research, statistics, applied mathematics, econometrics, or a related quantitative field. Alternate experience and education in equivalent areas such as economics, engineering or physics is acceptable
• 2+ years' experience in a hands-on data engineering role
• 2+ years experience with SQL & Python for data transformation and analysis
• Experience working with Databricks or Spark-based platforms like SnowFlake
• Hands on experience working with large datasets (millions of records, enterprise data)
• Experience transforming data structures (multiple tables, different data sources, relational or semi-structured data)
• Demonstrate understanding working with data formats such as parquet, avro, delta, csv, json etc.
• Demonstrate understanding about data processing techniques like full-batch processing, time-based partitioning, distributed- and real-time processing etc.
• Demonstrate strong data profiling and analytic skills; Ability to discover and highlight unique patterns/trends within data to identify and solve complex problems
• Must be motivated, self-driven, curious, and creative
• Must be a skilled communicator, and demonstrate an ability to work with end users and partners
• Demonstrate the ability to support and complement the work of a diverse development and/or operations team
• Must be flexible and adaptable in fast-changing environments and deadline driven

PREFERRED QUALIFICATIONS:

• Experience with Airflow and Github
• Healthcare data experience, preferably Epic, clarity or claims data
• Knowledge of health care operations
• Exposure to agile/scrum
• Ability to work in a hybrid cloud environment consisting of on premise and public cloud infrastructure. An ideal candidate will have experience with one or more of the following skill sets
  • Experience with Relational databases like Oracle, SQL server
  • Experience Optimizing and tuning SQL/Oracle queries, stored procedures and triggers
  • Experience with Python (numpy, pandas, matplotlib etc) and Jupyter notebooks for exploratory data analysis, machine learning, and process automation
  • Experience in areas of CI/CD, Continuous testing, and site reliability engineering.
  • Familiarity in Microsoft Azure applications such as Azure Data Factory, Synapse, Purview, Databricks /Spark, Power BI, PowerApps.
  • Familiarity in Power BI data models using advanced Power Query and DAX
• Interest and desire to contribute to emerging practices around DataOps (CI/CD, IaC, configuration management, etc.)

We’re a nonprofit, integrated health care organization, providing health insurance in six states and high-quality care at more than 90 locations, including hospitals and clinics in Minnesota and Wisconsin. We bring together research and education through HealthPartners Institute, training medical professionals across the region and conducting innovative research that improve lives around the world.

At HealthPartners, everyone is welcome, included and valued. We’re working together to increase diversity and inclusion in our workplace, advance health equity in care and coverage, and partner with the community as advocates for change.

Benefits Designed to Support Your Total Health
As a HealthPartners colleague, we’re committed to nurturing your diverse talents, valuing your dedication, and supporting your work-life balance. We offer a comprehensive range of benefits to support every aspect of your life, including health, time off, retirement planning, and continuous learning opportunities. Our goal is to help you thrive physically, mentally, emotionally, and financially, so you can continue delivering exceptional care.

Join us in our mission to improve the health and well-being of our patients, members, and communities.

We are an Equal Opportunity Employer and do not discriminate against any employee or applicant because of race, color, sex, age, national origin, religion, sexual orientation, gender identify, status as a veteran and basis of disability or any other federal, state or local protected class.