principal data architect

Hewlett Packard Enterprise | HPE

<div>Principal Data Engineer<p><br>
</p>This role has been designed as &lsquo;&rsquo;Onsite&rsquo; with an expectation that you will primarily work from an HPE office.<p></p><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><p><b>
Who We Are:</b></p></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><p>
Hewlett Packard Enterprise is the global edge-to-cloud company advancing the way people live and work. We help companies connect, protect, analyze, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today&rsquo;s complex world. Our culture thrives on finding new and better ways to accelerate what&rsquo;s next. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good. If you are looking to stretch and grow your career our culture will embrace you. Open up opportunities with HPE.</p></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><p></p><p><b>
Job Description:</b></p><p><br>
</p><p>Aruba is an HPE Company, and a leading provider of next-generation network access solutions for the mobile enterprise. Helping some the largest companies in the world modernize their networks to meet the demands of a digital future, Aruba is redefining the &ldquo;Intelligent Edge&rdquo; &ndash; and creating new customer experiences across intelligent spaces and digital workspaces. Join us redefine what&rsquo;s next for you.</p><p><b>
Job Description: Principal Data Engineer (Architect Level)</b></p><p><b><br>
About the Role</b></p><p>
We are looking for a highly skilled <b>Principal Data Engineer</b> with strong architectural expertise to design and evolve our next-generation data platform. You will help to define the technical vision, build scalable and reliable data systems, and guide the long-term architecture that powers analytics, operational decision-making, and data-driven products across the organization.</p><p><br>
This role is both <b>strategic and hands-on</b>. You will evaluate modern data technologies, define engineering best practices, and lead the implementation of robust, high-performance data solutions&mdash;including the design, build, and lifecycle management of data pipelines that support batch, streaming, and near-real-time workloads.</p><div></div><p><b>
What You&rsquo;ll Do</b></p><p><b>
Architecture &amp; Strategy</b></p><ul><li>
Own a segnificant portion of the architecture of our data platform, ensuring scalability, performance, reliability, and security.</li><li>
Define standards and best practices for data modeling, transformation, orchestration, governance, and lifecycle management.</li><li>
Evaluate and integrate modern data technologies and frameworks that align with our long-term platform strategy.</li><li>
Collaborate with engineering and product leadership to shape the technical roadmap.</li></ul><p><b>
Engineering &amp; Delivery</b></p><ul><li><b>
Design, build, and manage scalable, resilient data pipelines</b> for batch, streaming, and event-driven workloads.</li><li>
Develop clean, high-quality data models and schemas to support analytics, BI, operational systems, and ML workflows.</li><li>
Implement data quality, lineage, observability, and automated testing frameworks.</li><li>
Build ingestion patterns for APIs, event streams, files, and third-party data sources.</li><li>
Optimize compute, storage, and transformation layers for performance and cost efficiency.</li></ul><p><b><br>
Leadership &amp; Collaboration</b></p><ul><li>
Serve as a senior technical leader and mentor within the data engineering team.</li><li>
Lead architecture reviews, design discussions, and cross-team engineering initiatives.</li><li>
Work closely with analysts, data scientists, software engineers, and product owners to define and deliver data solutions.</li><li>
Communicate architectural decisions and trade-offs to technical and non-technical stakeholders.</li></ul><div><b>
What you need to bring:</b></div><ul><li>
8+ years of experience in Data Engineering, with demonstrated architectural ownership.</li><li><b>
Expert-level experience with Snowflake</b> (mandatory), including performance optimization, data modeling, security, and ecosystem components.</li><li>
Expert proficiency in SQL and strong Python skills for pipeline development and automation.</li><li>
Experience with modern orchestration tools (Airflow, Dagster, Prefect, or equivalent).</li><li>
Strong understanding of ELT/ETL patterns, distributed processing, and data lifecycle management.</li><li>
Familiarity with streaming/event technologies (Kafka, Kinesis, Pub/Sub, etc.).</li><li>
Experience implementing data quality, observability, and lineage solutions.</li><li>
Solid understanding of cloud infrastructure (AWS, GCP, or Azure).</li><li>
Strong background in DataOps practices: CI/CD, testing, version control, automation.</li><li>
Proven leadership in driving architectural direction and mentoring engineering teams.</li></ul><div></div><p><b>
Nice to Have</b></p><ul><li>
Experience with data governance or metadata management tools.</li><li>
Hands-on experience with <b>DBT</b>, including modeling, testing, documentation, and advanced features.</li><li>
Exposure to machine learning pipelines, feature stores, or MLOps.</li><li>
Experience with Terraform, CloudFormation, or other IaC tools.</li><li>
Background designing systems for high scale, security, or regulated environments.</li></ul><p></p><div><div><div><div><div><div><div><p><b>
Additional Skills:</b></p></div></div></div></div></div></div></div>
Cloud Architectures, Cross Domain Knowledge, Design Thinking, Development Fundamentals, DevOps, Distributed Computing, Microservices Fluency, Full Stack Development, Security-First Mindset, Solutions Design, Testing &amp; Automation, User Experience (UX)<p></p><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><p><b>
What We Can Offer You:</b></p></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><p><b>
Health &amp; Wellbeing</b></p><p>
We strive to provide our team members and their loved ones with a comprehensive suite of benefits that supports their physical, financial and emotional wellbeing.</p><p></p><p><b>
Personal &amp; Professional Development</b></p><p>
We also invest in your career because the better you are, the better we all are. We have specific programs catered to helping you reach any career goals you have &mdash; whether you want to become a knowledge expert in your field or apply your skills to another division.</p><p></p><p><b>
Unconditional Inclusion</b></p><p>
We are unconditionally inclusive in the way we work and celebrate individual uniqueness. We know varied backgrounds are valued and succeed here. We have the flexibility to manage our work and personal needs. We make bold moves, together, and are a force for good.</p><p></p><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><p><b>
Let's Stay Connected:</b></p></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><p>
Follow @HPECareers on Instagram to see the latest on people, culture and tech at HPE.
</p></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><p></p>#india
#aruba<p></p><p><b>
Job:</b></p>
Engineering<p><b>
Job Level:</b></p>
TCP_05<p><br>
</p><p></p><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><p>HPE is an Equal Employment Opportunity/ Veterans/Disabled/LGBT employer. We do not discriminate on the basis of race, gender, or any other protected category, and all decisions we make are made on the basis of qualifications, merit, and business need. Our goal is to be one global team that is representative of our customers, in an inclusive environment where we can continue to innovate and grow together. Please click here: Equal Employment Opportunity.</p></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><p><b>
Hewlett Packard Enterprise is EEO Protected Veteran/ Individual with Disabilities.</b></p><p><br>
</p><p>HPE will comply with all applicable laws related to employer use of arrest and conviction records, including laws requiring employers to consider for employment qualified applicants with criminal histories.</p><p><br>
</p><p><b>No Fees Notice &amp; Recruitment Fraud Disclaimer</b></p><p></p><p><i><br>
It has come to HPE&rsquo;s attention that there has been an increase in recruitment fraud whereby scammer impersonate HPE or HPE-authorized recruiting agencies and offer fake employment opportunities to candidates. These scammers often seek to obtain personal information or money from candidates.</i></p><p></p><p><i><br>
Please note that Hewlett Packard Enterprise (HPE), its direct and indirect subsidiaries and affiliated companies, and its authorized recruitment </i><i>agencies/vendors </i><b><i>will never charge any candidate a registration fee, hiring fee, or any other fee in connection with its recruitment and hiring process. </i></b><i>The credentials of any hiring agency that claims to be working with HPE for recruitment of talent should be verified by candidates and candidates shall be solely responsible to conduct such verification. Any candidate/individual who relies on the erroneous representations made by fraudulent employment agencies does so at their own risk, and HPE disclaims liability for any damages or claims that may result from any such communication.</i></p></div>

Principal Data Engineer

Xavor Corporation

<p><b>Key Responsibilities:</b></p><ul><li>Architect and lead scalable, high-availability data pipelines (batch &amp; streaming).</li><li>Design and implement cloud-native data solutions and ETL/ELT workflows on AWS.</li><li>Ensure data reliability, performance, security, and cost optimization.</li><li>Lead architectural reviews, define data standards, and drive best practices.</li><li>Mentor engineers and collaborate with cross-functional teams (Product, Analytics, DevOps).</li></ul><p><b>Must-Have Skills:</b></p><ul><li>Strong Python programming for data engineering, automation, and analytics.</li><li>Cloud expertise: AWS (Glue, S3, Lambda, Batch, IAM, ECR, SNS).</li><li>CI/CD, code reviews, and software development lifecycle (SDLC) best practices.</li><li>Experience with data pipelines, ETL/ELT, and batch/streaming processing.</li></ul><p><b>Nice-to-Have Skills:</b></p><ul><li>Real-time data replication and CDC using Oracle GoldenGate.</li><li>Event-driven streaming with Apache Kafka.</li><li>Observability, monitoring, and alerting for large-scale data systems.</li><li>Serverless architecture and containerization experience.</li></ul><p>Job Type: Full-time</p><p>Work Location: Remote</p>

Data Analysis Inc.

<div><div><div><h2 class="jobSectionHeader"><b>About Us</b></h2></div><div><p>
Data Analysis Incorporated (DAI) is the controlling entity of the O&rsquo;Neil family of businesses. DAI and its subsidiaries operate in diverse industries worldwide, including global equity markets, health care, financial services, digital news, and insurance. Our global footprint allows our teams to be responsive to customer needs in a timely and efficient manner. We are dedicated to using technology and innovation to bring change and growth to our businesses. We believe in a dynamic workplace, creating engaging, informative products and services that help our customers succeed. Integrity is an essential characteristic for our firms and our associates; if this describes you, please apply!</p></div></div><div><div><h2 class="jobSectionHeader"><b><br>
Summary</b></h2></div><div><p>
The Principal Database Engineer leads the design, optimization, and strategic development of enterprise-scale database systems across the organization. This role serves as a senior technical expert and strategic advisor, ensuring best-in-class data architecture, high availability, security, and performance to support complex business applications and analytics. The engineer collaborates closely with cross-functional leaders to align database solutions with business goals and technology vision.</p></div></div><div><div><h2 class="jobSectionHeader"><b><br>
Compensation Data</b></h2></div><div><p>
$150K - $175K base pay, +15% yearly bonus target.</p></div></div><div><div><h2 class="jobSectionHeader"><b>
Duties and Responsibilities</b></h2></div><div><ul><li>
Architect and evolve highly scalable, secure, and resilient database systems supporting transactional and analytical workloads.</li><li>
Lead the enterprise database strategy, including cloud migrations, modernization initiatives, and long-term platform selection.</li><li>
Design and implement advanced database automation, monitoring, and performance tuning solutions for mission-critical environments.</li><li>
Guide development teams in best practices for data modeling, query optimization, and stored procedure design.</li><li>
Oversee and troubleshoot complex SSIS packages and data pipelines integrating multiple systems.</li><li>
Serve as escalation point for high-impact database incidents, ensuring rapid resolution and root cause analysis.</li><li>
Drive adoption of DevOps practices in database development and deployment processes.</li><li>
Partner with InfoSec and Infrastructure teams to ensure compliance with data governance and security policies.</li><li>
Provide mentorship and technical direction to senior and mid-level database engineers.</li><li>
Stay current on industry trends and emerging technologies to influence strategic technology decisions.</li></ul></div></div><div><div><h2 class="jobSectionHeader"><b>
Qualifications &amp; Requirements</b></h2></div><div><p><b>
Required Education, Experience, Certification/Licensure</b></p><ul><li>
Bachelor&rsquo;s degree in Computer Science, Information Systems, or related field or experience equivalent.</li><li>
Minimum 6 years of professional experience in database engineering, including extensive leadership in SQL Server environments.</li><li>
Proven experience in designing and managing large-scale databases in hybrid on-prem/cloud environments.</li><li>
Expertise in database performance tuning, backup/recovery strategies, and high availability configurations.</li><li>
Demonstrated leadership in cross-functional projects involving application development, BI, and infrastructure.</li></ul><p><b>
Preferred Education, Experience, Certification/Licensure</b></p><ul><li>
Master&rsquo;s degree in related technical field.</li><li>
Certifications such as Microsoft Certified: Azure Database Administrator Associate or equivalent.</li><li>
Experience with PostgreSQL, MySQL, or NoSQL technologies is a plus.</li></ul><p><b>
KNOWLEDGE, SKILLS AND ABILITIES (KSAS)</b></p><ul><li>
Deep expertise in relational database design, T-SQL, SSIS, and Microsoft SQL Server architecture.</li><li>
Strong systems thinking and ability to translate business requirements into scalable data solutions.</li><li>
Excellent communication and stakeholder engagement skills, including executive-level reporting.</li><li>
Strategic mindset with the ability to align database platforms with long-term enterprise goals.</li><li>
Demonstrated mentoring and technical leadership across teams and geographies.</li></ul></div></div><div><div><h2 class="jobSectionHeader"><b>
Working Conditions</b></h2></div><div><p>
Must be able to perform essential job duties. Work is performed primarily in an office environment. Typically requires the ability to sit for extended periods of time (66%+ each workday), hear the telephone, and enter data on a computer and may also require the ability to lift up to 10 pounds.</p></div></div><div><div><h2 class="jobSectionHeader"><b><br>
Equal Opportunity Employer</b></h2></div><div><p>
Data Analysis Inc is an equal opportunity employer. All aspects of employment, including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law.</p></div></div></div>

Principal Database Engineer

Dataflix

<div><div><p><b>Overview</b></p><p>
We are seeking a <b>highly senior AI professional</b> with deep expertise in <b>Machine Learning, Large Language Models (LLMs), and Agentic AI systems</b>, who can <b>lead the AI technical team end-to-end</b>. This role is ideal for a seasoned <b>Data Scientist / AI Architect</b> who has hands-on experience building, scaling, and deploying advanced AI solutions and has worked extensively with <b>IBM Watson</b> along with other modern AI frameworks.</p><p></p><p><b><br>
Responsibilities</b></p><ul><li>
Lead the <b>design, development, and deployment</b> of advanced ML, NLP, and GenAI solutions.</li><li>
Architect and implement <b>LLM-based and Agentic AI systems</b> for real-world enterprise use cases.</li><li>
Provide <b>technical leadership and mentorship</b> to AI/ML engineers and data scientists.</li><li>
Drive <b>model experimentation, evaluation, optimization, and productionization</b>.</li><li>
Collaborate with product, engineering, and business teams to translate problems into AI solutions.</li><li>
Stay current with emerging AI research and apply it to business innovation.</li></ul><p><b>
Requirements</b></p><ul><li><b>
Strong foundation in Machine Learning &amp; Statistics</b> (supervised, unsupervised, deep learning).</li><li>
Extensive experience with <b>NLP, Generative AI, and Large Language Models (LLMs)</b>.</li><li>
Proven hands-on experience working with AI frameworks, IBM Watson experience will be an added advantage.</li><li>
Experience with <b>Agentic AI frameworks</b>, orchestration, and multi-agent systems.</li><li>
Proficiency in <b>Python</b> and ML/DL frameworks such as <b>TensorFlow, PyTorch, Scikit-learn</b>.</li><li>
Experience with <b>LLM frameworks</b> like <b>LangChain, LlamaIndex, Hugging Face</b>, or similar.</li><li>
Strong understanding of <b>model deployment, MLOps, and cloud-based AI solutions</b>.</li><li>
Experience working with <b>Azure, AWS, or GCP</b> AI/ML services is a plus.</li></ul></div></div>
<br><div><div><p>Location</p>
<p>Hyderabad, India</p>
</div><div><p>Salary</p>
<p>TBD</p>
</div><div><p>Job Type</p>
<p>Full-time</p>
</div><div><p>Date Posted</p>
<p>December 19th, 2025</p></div></div>

Principal AI Architect & Data Scientist

Micron Technology

<div><p><b>Our vision is to transform how the world uses information to enrich life for </b><b><i>all</i></b><b>.
</b></p><p>Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.</p><p></p><p>
At Micron, we transform how the world uses information to enrich life for all. The pace is fast, collaboration occurs on a regular basis, and innovation is expected. As a Staff/Principal Engineer within the STPG Product Engineer team, you will be responsible for architecting and developing machine learning models and agentic workflow solutions.</p><p></p><p><b>
Key Responsibilities:</b></p><ul><li>
Develop Proof-of-concepts (PoC) to assess the feasibility and performance of various AI models and to demonstrate the potential benefits to stakeholders.</li><li>
Perform business analysis, requirement gathering, and solution workflow design for traditional ML/Gen AI projects</li><li>
Design and implement Google ADK/other Gen AI framework solutions and POCs tailored to various teams needs.</li><li>
Collaborate with cross-functional teams, including teams of SMEs, data scientists and data engineers, to drive the AI strategy and implementation with the existing systems and to brainstorm software/AI/ML solutions.</li><li>
Routinely communicate overall project status to leadership and cross functional product team</li></ul><p></p><p><b>
Qualifications:</b></p><p></p><p>
Successful candidates for this exciting opportunity will have:</p><ul><li>
10+ years of hands-on experience in projects that focused on one or more of the following areas: Generative AI, machine learning, ML Ops and/or Predictive Analytics.</li><li>
Deep knowledge in statistics and Machine Learning models, deep learning models, NLP, Generative Adversarial Networks (GAN), and other generative models.</li><li>
Experience architecting high-impact AI solutions for diverse projects.</li><li>
Experience working in semiconductor industry is a plus.</li><li>
Hands-on experience in how LLMs work &amp; Generative AI (LLM) techniques particularly prompt engineering, RAG, and agents.</li><li>
Experience working with RAG, vector databases, LLM APIs and agentic frameworks.</li><li>
Excellent data analysis, problem solving, and decision-making skills</li><li>
Ability to work independently in a very fast paced environment and adapt to change</li><li>
Self-motivated and enthusiastic in a challenging, dynamic environment</li></ul><p></p><p><b>
Education:</b></p><ul><li>
Position requires a minimum of a Bachelor's degree in Computer Engineering, Electrical or Electronics.</li><li>
Course work in AI/ML, VLSI, semiconductor process is desirable, but not required.</li></ul><p></p><p><b>
About Micron Technology, Inc.</b></p><p>
We are an industry leader in innovative memory and storage solutions transforming how the world uses information to enrich life <i>for all</i>. With a relentless focus on our customers, technology leadership, and manufacturing and operational excellence, Micron delivers a rich portfolio of high-performance DRAM, NAND, and NOR memory and storage products through our Micron&reg; and Crucial&reg; brands. Every day, the innovations that our people create fuel the data economy, enabling advances in artificial intelligence and 5G applications that unleash opportunities &mdash; from the data center to the intelligent edge and across the client and mobile user experience.<br>
<br>
To learn more, please visit micron.com/careers<br>
<br>
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.<br>
<br>
To request assistance with the application process and/or for reasonable accommodations, please contact hrsupport_india@micron.com</p><p></p><p>
Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.</p><p></p><p>
Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.</p><p></p><p>
AI alert<b>:</b> Candidates are encouraged to use AI tools to enhance their resume and/or application materials. However, all information provided must be accurate and reflect the candidate's true skills and experiences. Misuse of AI to fabricate or misrepresent qualifications will result in immediate disqualification.
</p><p></p><p>Fraud alert: Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.</p></div><p></p>

Staff/Principal Engineer - Data Science/Agentic Frameworks

Microsoft

<div><b>Overview</b><div><p><br>
Microsoft&rsquo;s Path team helps customers along their journey from the initial idea to the final realization of their goals from Idea-to-Plan-to-Done.<br>
<br>
We are responsible for collaborative Work Management products including Microsoft Project, Planner, To Do, and Visio. With Project and Planner, we help customers collaborate effectively to navigate complexity, determine critical paths, and orchestrate their plans to achieve more. With To Do and Tasks, we help customers capture, prioritize, and complete their aspirations and goals along their path to success. With Visio, we help customers model and conceptualize information pathways through process diagrams, organizational charts, and more to visualize what it is and what it can be. Collectively, we're responsible for an incredible portfolio of products and services that help guide people and organizations along their journey to achieve more. Microsoft, being a leader in AI space, we are heavily investing in building new AI tools, agents, skills, and MCP servers.</p><p><br>
The <b>Principal Data</b> Engineer will operate as a senior technical leader shaping the data &amp; analytics foundations that power Microsoft Path org&rsquo;s products and platforms at a global scale. The engineer will collaborate with Product, Engineering, and Data Science stakeholders from multiple teams to analyze data requirements, understand the data flow across existing and new products, differentiate human vs. AI Agent generated data, lead the design of data models, and prepare design specifications for building data pipelines. The Data engineer will be responsible for identifying data sources, building code to extract raw data, and transforming it into formats compatible with downstream consumers. The Data Engineer will develop tools, do performance monitoring, and perform root cause analysis of issues to ensure robust and reliable data pipelines. You will define architectural direction, influence multi-team roadmaps, and set data engineering standards that enable reliable, secure, and scalable analytics for AI-driven products.</p><p>
Additionally, the Data Engineer will deeply understand data governance &amp; compliance needs, and partner with Corporate, External, and Legal Affairs (CELA) to ensure compliance with laws and policies throughout the development process across WW, EU, and GOV clouds. The role involves designing data modeling, data handling procedures, data cleansing or abstractions, implementing solutions to minimize points of failure, and ensuring that all aspects of data management adhere to organizational standards and regulatory requirements.</p><p><b><br>
*** This specific role has the potential to convert into a Data Engg Manager role in future as the team grows. ***</b></p><p><br>
Microsoft&rsquo;s mission is to empower every person and every organization on the planet to achieve more. By integrating the power of generative AI with tools for workflow management you will directly contribute to that mission empowering customers to achieve at a pace and scale beyond what has previously been considered possible.</p></div><b><br>
Responsibilities</b><br>
<div><ul><li>
Design, implement, monitor, and optimize large-scale, robust data pipelines and architectures that support Microsoft Path products data analytics initiatives.</li><li>
Develop scalable ETL/ELT workflows, ensure reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources with different schemas.</li><li>
Data Governance &amp; Trust: Enforce best practices for data quality, lineage, security, and compliance.</li><li>
Collaborate with stakeholders to define trustworthy data sets and implement rigorous data validation protocols, ensuring analytics are accurate and auditable.</li><li>
Cross-functional Collaboration: Work closely with product managers, software engineers, AI researchers, and business stakeholders to build data solutions that accomplish business goals.</li><li>
Enable self-service analytics and empower teams by building data models, semantic layers, and tools that streamline access to trusted information.</li><li>
Translate ambitious vision into actionable roadmaps and measurable outcomes.</li><li>
Mentor senior data engineers and technical leads, guide complex design decisions, and foster a culture of engineering excellence, operational rigor, and continuous learning across the organization.</li></ul></div><br>
<b>
Qualifications</b><p><b><br>
Required Qualifications:</b></p><div><ul><li>
Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python<ul><li>
OR equivalent experience.</li></ul></li></ul></div><div><p><b>
Other Requirements:
</b></p><ul><li>Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:</li></ul><b>
Microsoft Cloud Background Check</b>: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.<br>
</div><div><b>
Preferred Qualifications:</b><div><ul><li>
Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python<ul><li>
OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python</li><li>
OR equivalent experience.</li></ul></li><li>
Deep experience architecting and operating large-scale distributed data systems in cloud environments, preferably Azure.</li><li>
Ability to write clean, working code using core algorithms, data structures, and analytics‑oriented problem‑solving.</li><li>
Extensive experience in implementing and optimizing data pipelines and distributed data systems (e.g., Azure Data Lake, Spark, Synapse, SQL databases).</li><li>
Understanding of data governance, privacy, lineage, and security best practices, especially within highly regulated or enterprise environments.</li><li>
Excellent communication skills to convey complex technical concepts to both technical and non-technical audiences.</li><li>
Expertise with modern data engineering languages and frameworks (e.g., Azure Data Explorer, PySpark, SQL, etc).</li><li>
Experience collaborating in cross-functional teams and building consensus among stakeholders with diverse backgrounds (engineering, analytics, product, business).</li><li>
Track record of driving innovation in data engineering, including experience leading technical projects and mentoring others.</li></ul></div></div><br>
<br>
<br>
<p>Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
</p><p></p><p>Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:<br>
https://careers.microsoft.com/us/en/us-corporate-pay</p><p><br>
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.</p><p></p><p><br>
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process<b>.</b></p></div>

Confiz

<div><p>We are seeking an experienced Azure Data Engineer (5+ years) with strong expertise in data warehousing on lakehouse architecture, data engineering, data quality, and governance. The ideal candidate will design and build scalable data pipelines on Microsoft Fabric, implement data quality frameworks, and operationalize governance processes using Microsoft Purview. This role combines technical delivery with data compliance, ensuring trusted and well-governed data across the organization.</p>
<p><b>Key Responsibilities</b></p>
<ul><li>Design and develop <b>batch data pipelines</b> using <b>Fabric Pipelines and PySpark</b>.</li>
<li>Implement <b>data quality rules</b>, validation checks, and monitoring dashboards.</li>
<li>Develop <b>data catalog, lineage, classification, and business glossary</b> in <b>Microsoft Purview</b>.</li>
<li>Enforce <b>data governance policies, standards, and best practices</b> across Microsoft Fabric</li>
<li>Collaborate with DevOps to automate deployments using <b>Azure DevOps</b>.</li>
<li>Integrate data quality in <b>CI/CD pipelines</b> through <b>Azure DevOps</b>.</li>
<li>Ensure compliance with <b>data privacy regulations</b> (e.g., PDPL).</li>
<li>Partner with business and data stewards to improve overall data integrity and usability.</li>
</ul>
<p><b>Required Skills &amp; Experience</b></p>
<ul><li><b>5+ years</b> of experience in data engineering, quality, and governance roles.</li>
<li>Strong hands-on experience with <b>Azure Data Factory</b>, <b>Apache Spark (PySpark)</b>, and <b>Azure Synapse/Fabric</b>.</li>
<li>Proven expertise in <b>Microsoft Purview</b> for governance and catalog management.</li>
<li>Proficient in <b>Python</b> and <b>SQL</b> for data processing and validation.</li>
<li>Understanding of <b>data quality dimensions</b>, profiling, and cleansing techniques.</li>
<li>Strong analytical, problem-solving, and communication skills.</li>
<li>Experience with <b>Great Expectations</b> or similar data validation tools is a plus.</li>
</ul>
<p><b>Preferred Qualifications</b></p>
<ul><li><b>Microsoft Certified: Fabric Data Engineer Associate</b> or equivalent certification.</li>
<li>Experience with <b>Microsoft Fabric</b> and <b>AI-driven metadata or quality tools</b>.</li>
</ul>
<p>We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.</p>
<p>What makes Confiz stand out is our focus on processes and culture. Confiz is <b>ISO 9001:2015</b> (QMS), <b>ISO 27001:2022</b> (ISMS), <b>ISO 20000-1:2018</b> (ITSM), <b>ISO 14001:2015</b> (EMS), <b>ISO 45001:2018 </b>(OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.</p>
<p>People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.</p>
<p>To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</p></div>

Principal Data Engineer – Data Quality & Governance

Search 10000+ Principal data architect jobs near you this January. New roles added regularly across leading industries. Apply today.

10000 principal data architect jobs NEAR_ME

Principal Data Engineer

Principal Data Engineer

Principal Database Engineer

Principal AI Architect & Data Scientist

Staff/Principal Engineer - Data Science/Agentic Frameworks

Principal Data Engineer

Principal Data Engineer – Data Quality & Governance