Senior Engineer - Data

Summary:

We are seeking a highly skilled and motivated Senior Engineer to oversee our data engineering initiatives. This role requires a deep understanding of data engineering principles, cloud technologies, and the ability to translate business requirements into robust and scalable technical solutions. The ideal candidate will be a hands-on leader, capable of both strategic thinking and technical execution, with a passion for fostering a collaborative and high-performing team.

Responsibilities:

Technical Strategy and Architecture:

• Define and maintain the technical vision, architecture and future updates to our data platform within Microsoft Azure.
• Lead the design and implementation of scalable and efficient data pipelines using Dagster.
• Establish best practices for data modeling, data warehousing, and data lake strategies within Azure and SQL Server.
• Evaluate and recommend new technologies and tools to enhance our data capabilities.
• Ensure the security, reliability, and performance of our data infrastructure.

Team Leadership and Mentorship:

• Provide Technical Leadership and guidance to a team of Data Engineers, Developers and Analysts.
• Mentor team members on best practices, technical skills, and career development.
• Foster a collaborative and innovative team environment.
• Conduct performance reviews and provide constructive feedback.

SQL Server Database Management:

• Possess strong knowledge of SQL Server database design, development, and administration, with experience in integrating SQL Server with other systems within and outside of Azure.
• Optimize SQL queries and database performance, particularly in the context of data integration processes.
• Identify areas for improvement by targeting long-running queries and high resource consumption within our production environment.
• Ensure data integrity, security, and availability within SQL Server environments that participate in broader data integration strategies.

Data Pipeline Development and Integration:

• Oversee the development and maintenance of complex data pipelines using Dagster for seamless data integration from various sources.
• Ensure the reliability, efficiency, and scalability of Dagster pipelines.
• Troubleshoot and resolve issues related to data pipeline performance and data quality.
• Implement monitoring and alerting for data pipeline health.

Microsoft Fabric and Azure Expertise:

• Leverage a deep understanding of Microsoft Fabric and Azure data services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure Blob Storage, Azure SQL Database, Azure Databricks) to build and optimize data solutions.
• Design and implement data solutions that are cost-effective and aligned with Azure and SDLC best practices.
• Stay up-to-date with the latest Azure data platform developments.

Power BI Reporting and Analytics:

• Ensure data accuracy and performance of Power BI solutions by working with the Business Intelligence team to create seamless data integrations.
• Optimize Power BI data models and DAX queries for performance.

Python Scripting and Automation:

• Utilize Python for data manipulation, automation of data-related tasks, and integration with various data platforms and APIs, including those of external systems.
• Develop and maintain Python scripts for data extraction, transformation, and loading (ETL/ELT) processes that facilitate integration across different systems.
• Implement automated testing for Python-based data solutions involved in data integration.

Collaboration and Communication:

• Collaborate effectively with other departments, including Business Intelligence, Analytics, and Engineering teams, to understand data needs and deliver integrated data solutions.Senior Engineer
• Communicate technical concepts clearly and effectively to both technical and non-technical stakeholders, especially regarding the complexities of data integration.
• Participate in project planning and provide technical input, particularly concerning data integration strategies and challenges.
• Document technical designs, processes, and solutions, with a strong emphasis on data integration workflows and dependencies.
• Communicate regularly with the Director of Data to ensure alignment on key objectives and deliverables.

Job Requirements:

Experience:

• 5 - 7 years of relevant industry specific experience with at least 1 - 2 years in a formal leadership position or tech lead role.

Preferred Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field.
• Proven experience in a Technical Leadership role, guiding and mentoring data professionals.
• Solid knowledge of SQL Server database design, development, and performance tuning, including writing complex SQL queries and stored procedures.
• Extensive hands-on experience with Microsoft Azure and Microsoft Fabric data services, including but not limited to Azure Data Factory, Azure Synapse Analytics, Azure Blob Storage, and Azure SQL Databases and Lakehouses.
• Strong proficiency in developing and managing data pipelines using Dagster or similar orchestration tools (e.g., Apache Airflow).
• Deep understanding of data modeling concepts (e.g., relational, dimensional), data warehousing principles, and data lake architectures.
• Strong programming skills in Python, with experience in data manipulation libraries (e.g., Pandas, NumPy) and automation.
• Experience with version control systems (e.g., Git).
• Excellent problem-solving, analytical, and communication skills.
• Ability to work independently and as part of a team in a fast-paced environment.
• Ability to handle multiple projects simultaneously with competing deadlines.

Nice To Have Qualifications:

• Experience with Snowflake, Google Big Query, AlloyDB and other Database Management Systems.
• Experience with other cloud platforms (e.g., AWS, Google Cloud).
• Familiarity with data science concepts and machine learning workflows.
• Experience with CI/CD pipelines for data solutions.
• Knowledge of data security best practices and compliance standards.
• Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert).

Why Moxie?

• Award-winning workplace – Named a Top Place to Work since 2021
• Comprehensive benefits – Medical, dental, vision, and more
• 401(k) & Roth IRA – Because your future matters
• Paid Time Off – Work-life balance is important to us!
• Monthly company events & recognition programs
• Service projects – Be part of something bigger than just a job
• Pet insurance – Because furry family members deserve care too
• Wellness program – Prioritize your mental and physical well-being
• Previ – Exclusive employee perks including cellular discounts and up to 40% off gear from top lifestyle and tech brands
• Maternity Leave – Paid time off to support you during this important life moment