data analytics engineer

Gartner

<div>About Gartner IT :
Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients. We make a broad organizational impact by delivering cutting-edge technology solutions that power Gartner. Gartner IT values its culture of nonstop innovation, an outcome-driven approach to success, and the notion that great ideas can come from anyone on the team.
About the role
Gartner needs a well-rounded and motivated Senior Data Analytics Engineer who will be a part of the CDAO Platform Engineering team. The CDAO platform engineering team is responsible for innovating the platform on which CDO products are delivered, optimizing performance and cost.
What you will do:
<ul><li>Implement best practices for design, architecture, and implementation of high-performance, scalable, highly available, and optimized platforms on cloud.
</li><li>Guide and support teams on architecture decisions, best practices, and technical solutions, with an emphasis on providing architectural guidance and expertise.
</li><li>Design frameworks for deployment of data pipelines and applications to support internal users with their data requirements and reporting.
</li><li>Drive automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI)/Continuous Delivery (CD) tools such as Jenkins.
</li><li>Work with internal infrastructure teams on monitoring, security, and configuration of the platform environment and applications.
</li><li>Collaborate with internal business units and data science teams on business requirements, data access, processing/transformation, and reporting needs; provide guidance on leveraging existing and new tools to provide solutions; effectively support and partner with businesses on implementation, technical issues, and training on the data ecosystem.
</li><li>Work with the team on managing Azure resources (Databricks, ADF pipelines, etc.) and continuously improve deployment processes of applications.
</li><li>Support provisioning, monitoring, configuration, and maintenance of tools and services.
</li><li>Promote the integration of new cloud technologies and continuously evaluate new tools that will improve the organization&rsquo;s capabilities while leading to lower total cost of operation.
</li><li>Work with the team to implement data governance, access control, and identify and reduce security risks.
</li></ul>What you will need:
<ul><li>Bachelor&rsquo;s or Master&rsquo;s Degree in Computer Science, Information Systems, Engineering, or related technical fields.
</li><li>3-5 years&rsquo; experience in software development, including experience in Big Data and/or Cloud Services. Prior experience with Spark required.
</li><li>Experience in Azure cloud services, Linux Operating Systems, Shell scripting, Python, and DevOps/CI/CD frameworks.
</li><li>Experience with continuous integration/delivery tools like Jenkins and infrastructure as code using Terraform.
</li><li>Knowledge and experience of Azure data-related services such as Azure Databricks, Data Factory, EventHub, ADLS, etc.; self-learner with the ability to experiment and adopt new tools to build more efficient processes.
</li><li>Experience with one or more object-oriented/object function scripting languages (Python, Java, Scala, etc.).
</li><li>Experience with relational SQL and NoSQL databases, including Synapse, MS SQL, RDS, etc.. Good to have experience with data pipeline and workflow management tools: Oozie, Airflow, etc.
</li><li>Good to have experience with relational SQL and NoSQL databases, including RDS, MS SQL, DynamoDB, etc., and with data pipeline and workflow management tools: Databricks workflows, Oozie, Airflow, etc.
</li><li>Good combination of technical and interpersonal skills with strong written and verbal communication.
</li><li>Takes initiative on process and system improvements.
</li><li>Documents and communicates testing results, ensuring clear task ownership and defined target timelines.
</li><li>Demonstrates a solution-oriented mindset by identifying, communicating, and acting on issues and initiatives.
</li><li>Experience working with fast-paced operations/dev teams and DevOps.
</li></ul>Who are you:
<ul><li>Bachelor&rsquo;s degree or foreign equivalent degree in Computer Science or a related field required
</li><li>Excellent communication skills.
</li><li>Able to work independently or within a team proactively in a fast-paced AGILE-SCRUM environment.
</li><li>Owns success &ndash; Takes responsibility for the successful delivery of the solutions.
</li><li>Strong desire to improve upon their skills in tools and technologies
</li></ul>Don&rsquo;t meet every single requirement? We encourage you to apply anyway. You might just be the right candidate for this, or other roles.
#LI-SG4
Who are we?
At Gartner, Inc. (NYSE:IT), we guide the leaders who shape the world.
Our mission relies on expert analysis and bold ideas to deliver actionable, objective business and technology insights, helping enterprise leaders and their teams succeed with their mission-critical priorities.
Since our founding in 1979, we&rsquo;ve grown to 21,000 associates globally who support ~14,000 client enterprises in ~90 countries and territories. We do important, interesting and substantive work that matters. That&rsquo;s why we hire associates with the intellectual curiosity, energy and drive to want to make a difference. The bar is unapologetically high. So is the impact you can have here.
What makes Gartner a great place to work?
Our vast, virtually untapped market potential offers limitless opportunities &ndash; opportunities that may not even exist right now &ndash; for you to grow professionally and flourish personally. How far you go is driven by your passion and performance.
We hire remarkable people who collaborate and win as a team. Together, our singular, unifying goal is to deliver results for our clients.
Our teams are inclusive and composed of individuals from different geographies, cultures, religions, ethnicities, races, genders, sexual orientations, abilities and generations.
We invest in great leaders who bring out the best in you and the company, enabling us to multiply our impact and results. This is why, year after year, we are recognized worldwide as a great place to work.
What do we offer?
Gartner offers world-class benefits, highly competitive compensation and disproportionate rewards for top performers.
In our hybrid work environment, we provide the flexibility and support for you to thrive &mdash; working virtually when it's productive to do so and getting together with colleagues in a vibrant community that is purposeful, engaging and inspiring.
Ready to grow your career with Gartner? Join us. 
 
The policy of Gartner is to provide equal employment opportunities to all applicants and employees without regard to race, color, creed, religion, sex, sexual orientation, gender identity, marital status, citizenship status, age, national origin, ancestry, disability, veteran status, or any other legally protected status and to seek to advance the principles of equal employment opportunity.
Gartner is committed to being an Equal Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access the Company&rsquo;s career webpage as a result of your disability. You may request reasonable accommodations by calling Human Resources at +1 (203) 964-0096 or by sending an email to ApplicantAccommodations@gartner.com .
Job Requisition ID:106046
By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence.
Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy 
 
For efficient navigation through the application, please only use the back button within the application, not the back arrow within your browser.</div>

Sr Data Analytics Engineer

66degrees

<div><h2 class="jobSectionHeader">Overview of 66degrees</h2>

66degrees is a leading consulting and professional services company specializing in developing AI-focused, data-led solutions leveraging the latest advancements in cloud technology. With our unmatched engineering capabilities and vast industry experience, we help the world's leading brands transform their business challenges into opportunities and shape the future of work.
<h3 class="jobSectionHeader">
Overview of Role</h3>

66degrees is seeking a contractor - Data Analytics Engineer (Power BI) to engage on a 6 weeks of remote assignment for approximately 45 hours per week with the potential to extend. The contractor must be available to work from the last week of January.
<h3 class="jobSectionHeader">
Responsibilities</h3>
<ul><li>Collaborate with stakeholders to understand business requirements and translate them into high-performing technical implementations.</li>
<li>Work with Clients to enable them on the Power BI Platform, assisting them in building out an analytics ecosystem in Power BI from the ground up.</li>
<li>Implement best practices for scalable, governed analytics, helping clients build out their analytics centers of excellence through hands-on technical execution.</li>
<li>Utilize Power BI to design and develop interactive and visually appealing dashboards and reports for end-users.</li>
<li>Write clean, efficient, and scalable code (DAX, M, Python as applicable) to support complex data transformations.</li>
<li>Conduct performance tuning and optimization of data analytics solutions to ensure efficient processing and query performance at scale.</li>
<li>Stay up to date with the latest trends and best practices in cloud data analytics, big data technologies, and data visualization tools.</li>
<li>Collaborate with cross-functional teams to ensure seamless integration of data analytics solutions with existing systems and processes.</li>
<li>Provide technical guidance and mentorship to junior team members, sharing knowledge and promoting engineering best practices.</li>
</ul><h3 class="jobSectionHeader">Qualifications</h3>
<ul><li>Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.</li>
<li>Proven track record as a Senior Data Analytics Engineer, BI Engineer, or a similar role, with a minimum of 5 years of experience in data analytics and visualization.</li>
<li>Excellent technical proficiency in Power BI development and implementation; additional analytics platform experience (Looker preferred) is a major plus.</li>
<li>Experience with Google Cloud and its data services is preferred; however, experience with other major cloud platforms (AWS, Azure) and their data services will be considered.</li>
<li>Strong proficiency with SQL is required.</li>
<li>Demonstrated experience working with clients in various industry verticals, implementing solutions for their unique data challenges.</li>
<li>Excellent programming skills in Python and experience working with Python-enabled capabilities in analytics platforms.</li>
<li>Solid understanding of data modeling using star schemas, ETL/ELT processes, and data integration techniques. Experience working with dbt or dataform is a plus.</li>
<li>Strong problem-solving skills and the ability to execute technical solutions based on business requirements.</li>
<li>Excellent communication and collaboration skills, with the ability to work effectively in a team environment.</li>
<li>Microsoft Power BI certifications and any other cloud or analytics platform certifications are a plus.</li>
<li>A desire to stay ahead of the curve and continuously learn new technologies and techniques.</li>
</ul>
66degrees is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to actual or perceived race, color, religion, sex, gender, gender identity, national origin, age, weight, height, marital status, sexual orientation, veteran status, disability status or other legally protected class.</div>

Data Analytics Engineer (Power BI), Contract

<div>About the role:
Gartner needs a well-rounded and motivated Senior Data Analytics Engineer who will be a part of the CDAO Platform Engineering team. The CDAO platform engineering team is responsible for innovating the platform on which CDO products are delivered, optimizing performance and cost.
What You Will do:
<ul><li>Participate in architecture design and implementation of high-performance, scalable and optimized data solutions and data orchestration frameworks
</li><li>Enhance, maintain and support our web applications and rest APIs
</li><li>Design, build and automate the deployment of our data pipelines and applications
</li><li>Work with internal infrastructure teams on monitoring, security, and configuration of Datalake environment and applications
</li><li>Work with team on managing cloud resources and continuously improve deployment process of our applications
</li><li>Work with administrative resources and support provisioning, monitoring, configuration and maintenance of cloud based tools
</li><li>Support automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI) / Continuous Delivery (CD) tools such as Jenkins
</li><li>Work with the team to implement data governance, access control and identify and reduce security risks
</li><li>Promote the integration of new cloud technologies and evaluate new tools that will improve the organization&rsquo;s capabilities while leading to lower total cost of operation
</li><li>Collaborate with internal business units and data teams on business requirements, data access, processing/transformation and reporting needs and leverage existing and new tools to provide solutions
</li></ul>What You Will Need:
Must have:
<ul><li>Bachelor's Degree in Computer Science, Information Systems, Engineering or related technical fields
</li><li>2-5 year&rsquo;s experience in software development, including significant experience in data services and tools on the cloud
</li><li>Building and deploying containers (using docker) to Azure Kubernetes and Azure App services
</li><li>Experience with full-stack development of applications using .NET/C#. Experience with Python would be a plus.
</li><li>Microsoft SQL Server/Synapse Analytics and demonstrated SQL skills
</li><li>Experience with data workflow and orchestration with Azure Data Factory
</li><li>Well versed in the cloud design patterns, and their implementation in a real-life scenarios
</li><li>Experience utilizing monitoring and logging tools such as Dynatrace, Splunk and native cloud services such as Azure Monitor and Application insights
</li></ul>Nice to have:
<ul><li>Experience with stream-processing services such as EventHub and Spark-Streaming is preferred
</li><li>Web UI knowledge experience in frontend frameworks such as React/Angular JS/jQuery is a plus
</li><li>Experience in building Infrastructure as Code using Terraform/Jenkins/CodeDeploy
</li></ul>Who are you:
<ul><li>Proficient at researching innovative solutions for challenging technical problems.
</li><li>Strong willingness to learn new technologies and ability to think critically is required.
</li><li>Excellent communication skills both verbal and written.
</li><li>Able to work independently and in an agile team.
</li></ul>Don&rsquo;t meet every single requirement? We encourage you to apply anyway. You might just be the right candidate for this, or other roles.
#LI-SG4
Who are we?
At Gartner, Inc. (NYSE:IT), we guide the leaders who shape the world.
Our mission relies on expert analysis and bold ideas to deliver actionable, objective business and technology insights, helping enterprise leaders and their teams succeed with their mission-critical priorities.
Since our founding in 1979, we&rsquo;ve grown to 21,000 associates globally who support ~14,000 client enterprises in ~90 countries and territories. We do important, interesting and substantive work that matters. That&rsquo;s why we hire associates with the intellectual curiosity, energy and drive to want to make a difference. The bar is unapologetically high. So is the impact you can have here.
What makes Gartner a great place to work?
Our vast, virtually untapped market potential offers limitless opportunities &ndash; opportunities that may not even exist right now &ndash; for you to grow professionally and flourish personally. How far you go is driven by your passion and performance.
We hire remarkable people who collaborate and win as a team. Together, our singular, unifying goal is to deliver results for our clients.
Our teams are inclusive and composed of individuals from different geographies, cultures, religions, ethnicities, races, genders, sexual orientations, abilities and generations.
We invest in great leaders who bring out the best in you and the company, enabling us to multiply our impact and results. This is why, year after year, we are recognized worldwide as a great place to work.
What do we offer?
Gartner offers world-class benefits, highly competitive compensation and disproportionate rewards for top performers.
In our hybrid work environment, we provide the flexibility and support for you to thrive &mdash; working virtually when it's productive to do so and getting together with colleagues in a vibrant community that is purposeful, engaging and inspiring.
Ready to grow your career with Gartner? Join us. 
 
The policy of Gartner is to provide equal employment opportunities to all applicants and employees without regard to race, color, creed, religion, sex, sexual orientation, gender identity, marital status, citizenship status, age, national origin, ancestry, disability, veteran status, or any other legally protected status and to seek to advance the principles of equal employment opportunity.
Gartner is committed to being an Equal Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access the Company&rsquo;s career webpage as a result of your disability. You may request reasonable accommodations by calling Human Resources at +1 (203) 964-0096 or by sending an email to ApplicantAccommodations@gartner.com .
Job Requisition ID:106049
By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence.
Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy 
 
For efficient navigation through the application, please only use the back button within the application, not the back arrow within your browser.</div>

Sr Data Analytics Engineer (.NET)

Morgan Stanley

<div>
 We&rsquo;re seeking someone to join our team as ETL Developer who will be responsible for analyze the requirement and develop the Database procedure (MS SQL Server) to meet the business requirement, support existing application, and collaborates with business Analyst to understand the business requirement, perform the analysis and implement it.
 
 
 In the Technology division, we leverage innovation to build the connections and capabilities that power our Firm, enabling our clients and colleagues to redefine markets and shape the future of our communities. This is a ETL Dev on the AI platform position at Associate level, which is part of data &amp; analytics Engineering job family that provides specialist data analysis and expertise that drive decision-making and business insights as well as crafting data pipelines, implementing data models, optimizing data processes for improved data accuracy and accessibility, including applying machine learning and AI-based techniques.
 
 
 Morgan Stanley is an industry leader in financial services, known for mobilizing capital to help governments, corporations, institutions, and individuals around the world achieve their financial goals.
 
 
 
 What You&rsquo;ll Do In The Role
 
 
 
 <ul>
 <li>
 We are looking for highly motivated individuals who are ready to learn and grow.
 </li>
 <li>
 As a Software Engineer who will play a critical role in design and development of Informatica jobs to perform the data quality check to meet the business requirement.
 </li>
 <li>
 This role requires strong software engineering, design and development skills, and good problem-solving skills.
 
 
 </li>
 </ul>
 
 What You&rsquo;ll Bring To The Role
 
 
 
 <ul>
 <li>
 At least 2 years&rsquo; relevant experience would generally be expected to find the skills required for this role
 </li>
 <li>
 Analyzes complex Informatica mapping, designs and troubleshoots.
 </li>
 <li>
 Good experience in writing complex SQL/PLSQL.
 </li>
 <li>
 Good in database specially in SQL server, good to have Snowflake &amp; Hive knowledge.
 </li>
 <li>
 Good knowledge of Informatica Power Center &amp; IDQ.
 </li>
 <li>
 Good in data warehousing concept.
 </li>
 <li>
 Good Unix Scripting knowledge
 </li>
 <li>
 Performs new development, maintenance fixes and enhancements to meet business requirements
 </li>
 <li>
 Assists other teams to troubleshoot application issues in production, quality assurance and other environments
 </li>
 <li>
 Working experience in Agile model.
 </li>
 <li>
 Documents designs for system requirements
 
 
 </li>
 </ul>
 
 What You Can Expect From Morgan Stanley
 
 
 
 We are committed to maintaining the first-class service and high standard of excellence that have defined Morgan Stanley for over 89 years. Our values - putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity and inclusion, and giving back - aren&rsquo;t just beliefs, they guide the decisions we make every day to do what's best for our clients, communities and more than 80,000 employees in 1,200 offices across 42 countries. At Morgan Stanley, you&rsquo;ll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered. Our teams are relentless collaborators and creative thinkers, fueled by their diverse backgrounds and experiences. We are proud to support our employees and their families at every point along their work-life journey, offering some of the most attractive and comprehensive employee benefits and perks in the industry. There&rsquo;s also ample opportunity to move about the business for those who show passion and grit in their work.
 
 
 To learn more about our offices across the globe, please copy and paste https://www.morganstanley.com/about-us/global-offices into your browser.
 
 
 Morgan Stanley is an equal opportunities employer. We work to provide a supportive and inclusive environment where all individuals can maximize their full potential. Our skilled and creative workforce is comprised of individuals drawn from a broad cross section of the global communities in which we operate and who reflect a variety of backgrounds, talents, perspectives, and experiences. Our strong commitment to a culture of inclusion is evident through our constant focus on recruiting, developing, and advancing individuals based on their skills and talents.
</div>

ETL Developer_Associate_Data & Analytics Engineer

Allucent

<div>
 
 The Senior / Principal Data Engineer will design, develop, and maintain scalable data platform and analytics solutions across data lakes and operational databases. This role requires hands-on expertise in Azure Databricks, Azure SQL, Python/PySpark, Notebooks, with a strong understanding of data modeling, ETL/ELT best practices, and CI/CD automation in Azure DevOps. The ideal candidate will have a proven record of building robust, efficient, and secure data pipelines that enable analytics, reporting, and AI/ML solutions, preferably in life sciences, clinical research, or healthcare domains.&nbsp;
 
 
 
 
 Requirements
 
 
 
 
 
 Data Architecture &amp; Engineering&nbsp;
 
 <ul>
 <li>
 Design and implement end-to-end data pipelines using Azure Databricks, Azure Data Factory, and ADLS Gen2.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Build scalable and performant data models for data lakes (Medallion architecture), data warehouses, and operational systems.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Develop ELT/ETL frameworks for ingestion from APIs, relational sources, flat files, and third-party systems (e.g., Dynamics 365, Veeva, EDC).&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Optimize data transformations, partitioning, and delta lake performance for analytics workloads.&nbsp;
 </li>
 </ul>
 
 Data Integration &amp; Automation&nbsp;&nbsp;
 
 <ul>
 <li>
 Leverage Python and PySpark for data ingestion, cleansing, enrichment, and advanced transformations.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Implement CI/CD pipelines for data workflows using Azure DevOps and Git, including automated testing, deployment, and monitoring.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Develop and integrate RESTful APIs for cross-system data exchange and automation.&nbsp;
 </li>
 </ul>
 
 Analytics Enablement&nbsp;
 
 <ul>
 <li>
 Collaborate with the BI team to ensure clean, high-quality, and accessible data for the Power BI platform.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Support semantic modeling, metric layer design, and data governance best practices.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Enable advanced analytics by provisioning data for ML/AI initiatives and predictive insights.&nbsp;
 </li>
 </ul>
 
 Cross Functional Collaboration&nbsp;
 
 <ul>
 <li>
 Collaborate with product/system owners, analysts, and business stakeholders to translate analytical requirements into technical data solutions.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Drive best practices in Agile development, version control, and DevOps workflows.&nbsp;
 </li>
 </ul>
 
 &nbsp;
 
 
 Education Requirements and Qualifications&nbsp;
 
 
 
 Qualifications&nbsp;&nbsp;
 
 <ul>
 <li>
 Bachelor's degree in Computer Science, Information Systems, Engineering, or related field (Master's preferred).&nbsp;&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Minimum 5-8 years of relevant experience building and maintaining data solutions (data lakes, data warehouses, operational databases).&nbsp;&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Expert-level proficiency in Azure Databricks, PySpark, SQL, and Azure DevOps.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Proven experience with Azure Data Factory, ADLS Gen2, and Azure SQL Server.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Working knowledge of CI/CD automation, version control (Git), and infrastructure as code (ARM or Terraform).&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Experience with Power BI or similar analytics platforms (Tableau, Looker) required; experience with Snowflake, Redshift, or Synapse Analytics is a plus.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Strong analytical, debugging, and performance-tuning skills.&nbsp;
 </li>
 </ul>
 <ul>
 <li>
 Experience in life sciences or healthcare industries is a strong plus.&nbsp;
 </li>
 </ul>
 
 Skills&nbsp;
 
 
 Core expertise: Expert-level in Databricks, PySpark, SQL, and Azure DevOps&nbsp;
 
 
 Data engineering: Data modeling, Delta Lake optimization, ETL/ELT design, distributed processing.&nbsp;
 
 
 Integration &amp; Automation: Azure Data Factory, REST APIs, CI/CD pipelines, Git branching strategies.&nbsp;
 
 
 Analytics &amp; BI: Power BI (Tableau), semantic layer design, DAX/SQL tuning.&nbsp;
 
 
 Cloud &amp; DevOps: Azure ecosystem (ADF, ADLS, Azure SQL, Synapse), Infrastructure as Code&nbsp;
 
 
 Data Governance &amp; Quality: Metadata management, data validation frameworks, logging and monitoring.&nbsp;
 
 
 Soft skills: Good communication, mentoring, Agile teamwork, analytical thinking, collaboration.&nbsp;
 
 
 &nbsp;
 
</div>

Data Developer

Infosys

<div><h2 class="jobSectionHeader">Key Responsibilities:</h2> 
<ul>
<li>Design develop and deploy solutions using Microsoft Fabric components Data Engineer and Power BI and SQL</li>
<li>Collaborate with business stakeholders to gather requirements and translate them into technical solutions</li>
<li>Create interactive dashboards and reports using Power BI</li>
<li>Experience in designing implementing and supporting Data Warehousing and Business Intelligence solutions on Microsoft Fabric data pipelinesBuild custom applications using Power Apps to support business needs</li>
<li>Design and implement scalable and efficient data pipelines using Azure Data Factory Pyspark notebooks Spark SQL and Python</li>
<li>This includes data ingestion data transformation and data loading processes</li>
<li>Hands on experience in design development and implementation of Microsoft Fabric Azure Data Analytics Service Azure Data Factory ADF Data Lake Azure Synapse Azure SQL and Databricks</li>
<li>Write and optimize SQL queries for data extraction transformation and reporting</li>
<li>Ensure data integrity performance and security across all solutions</li>
<li>Provide support and maintenance for existing solutions and troubleshoot issues as needed</li></ul> 
<h2 class="jobSectionHeader">
Preferred Skills:</h2>
Analytics</div>

Associate Analyst - Knowledge Services

Microsoft

<div>Overview<div> 
Microsoft&rsquo;s Path team helps customers along their journey from the initial idea to the final realization of their goals from Idea-to-Plan-to-Done. 
 
We are responsible for collaborative Work Management products including Microsoft Project, Planner, To Do, and Visio. With Project and Planner, we help customers collaborate effectively to navigate complexity, determine critical paths, and orchestrate their plans to achieve more. With To Do and Tasks, we help customers capture, prioritize, and complete their aspirations and goals along their path to success. With Visio, we help customers model and conceptualize information pathways through process diagrams, organizational charts, and more to visualize what it is and what it can be. Collectively, we're responsible for an incredible portfolio of products and services that help guide people and organizations along their journey to achieve more. Microsoft, being a leader in AI space, we are heavily investing in building new AI tools, agents, skills, and MCP servers. 
The Senior Data Engineer will operate as an independent technical contributor shaping the data &amp; analytics foundations that power Microsoft Path org&rsquo;s products and platforms at a global scale. The engineer will collaborate with Product, Engineering, and Data Science stakeholders from multiple teams to analyze data requirements, understand the data flow across existing and new products, differentiate human vs. AI Agent generated data, lead the design of data models, and prepare design specifications for building data pipelines. The Data engineer will be responsible for identifying data sources, building code to extract raw data, and transforming it into formats compatible with downstream consumers. The Data Engineer will develop tools, do performance monitoring, and perform root cause analysis of issues to ensure robust and reliable data pipelines. You will contribute to define architectural direction, influence roadmaps, and set data engineering standards that enable reliable, secure, and scalable analytics for AI-driven products.
Additionally, the Sr. Data Engineer will deeply understand data governance &amp; compliance needs, and partner with Corporate, External, and Legal Affairs (CELA) to ensure compliance with laws and policies throughout the development process across WW, EU, and GOV clouds. The role involves designing data modeling, data handling procedures, data cleansing or abstractions, implementing solutions to minimize points of failure, and ensuring that all aspects of data management adhere to organizational standards and regulatory requirements.
Microsoft&rsquo;s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.</div> 
Responsibilities 
<div><ul><li>
Design, implement, monitor, and optimize large-scale, robust data pipelines and architectures that support Microsoft Path products data analytics initiatives.</li><li>
Develop scalable ETL/ELT workflows, ensure reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources with different schemas.</li><li>
Data Governance &amp; Trust: Enforce best practices for data quality, lineage, security, and compliance.</li><li>
Collaborate with stakeholders to define trustworthy data sets and implement rigorous data validation protocols, ensuring analytics are accurate and auditable.</li><li>
Cross-functional Collaboration: Work closely with Product Managers, Engineering Managers, software engineers, AI researchers, and business stakeholders to build data solutions that accomplish business goals.</li><li>
Enable self-service analytics and empower teams by building data models, semantic layers, and tools that streamline access to trusted information.</li><li>
Translate ambitious vision into actionable roadmaps and measurable outcomes.</li><li>
Mentor junior-mid data engineers and analysts, make independent design decisions, and foster a culture of engineering excellence, operational rigor, and continuous learning.</li></ul></div> 

Qualifications 
Required Qualifications:<div><ul><li>
Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python<ul><li>
OR equivalent experience.</li></ul></li></ul></div><div>
Other Requirements:
<ul><li>Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:</li></ul>
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 
</div><div>
Preferred Qualifications:<div><ul><li>
Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python<ul><li>
OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python</li><li>
OR equivalent experience.</li></ul></li><li>
Deep experience architecting and operating large-scale distributed data systems in cloud environments, preferably Azure.</li><li>
Ability to write clean, working code using core algorithms, data structures, and analytics‑oriented problem‑solving.</li><li>
Extensive experience in implementing and optimizing data pipelines and distributed data systems (e.g., Azure Data Lake, Spark, Synapse, SQL databases).</li><li>
Understanding of data governance, privacy, lineage, and security best practices, especially within highly regulated or enterprise environments.</li><li>
Excellent communication skills to convey complex technical concepts to both technical and non-technical audiences.</li><li>
Expertise with modern data engineering languages and frameworks (e.g., Azure Data Explorer, PySpark, SQL, etc).</li><li>
Experience collaborating in cross-functional teams and building consensus among stakeholders with diverse backgrounds (engineering, analytics, product, business).</li><li>
Track record of driving innovation in data engineering, including experience leading technical projects and mentoring others.</li></ul></div></div> 
 
 
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: 
https://careers.microsoft.com/us/en/us-corporate-pay 
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. 
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process.</div>

Senior Data Engineer

Search 10000+ Data analytics engineer jobs near you this January. New roles added regularly across leading industries. Apply today.