data engineer lead

Algo

<div>Job title: Data Engineer Lead 
Location: DHA Phase-8, Lahore (on-site) 
 
Job Description
 
Job Responsibilities:
<div><ul><li>Design, build, and maintain efficient and scalable ETL/ELT data pipelines using tools like Azure Data Factory or Apache Airflow</li></ul>
<ul><li>Develop, test, and deploy Python-based data processing solutions</li></ul>
<ul><li>Work with Snowflake, Databricks and other data warehousing technologies to support data analytics and reporting needs</li></ul>
<ul><li>Write complex and optimized SQL queries for data transformation and extraction</li></ul>
<ul><li>Ensure data quality, accuracy, and compliance with internal and external standards</li></ul>
<ul><li>Collaborate with data engineers, analysts, and stakeholders to define and implement data workflows</li></ul>
<ul><li>Utilize version control (Git) and CI/CD pipelines for code deployment and process automation</li></ul>
<ul><li>Lead and mentor team of data engineers, delivering robust data solutions that improve forecasting and operational efficiency.</li></ul></div> 
 
Qualifications Needed:
<ul><li>Python</li></ul>
<ul><li>SQL</li></ul>
<ul><li>Snowflake</li></ul>
<ul><li>Databricks</li></ul>
<ul><li>Azure (or AWS)</li></ul>
<ul><li>ETL/ELT</li></ul>
<ul><li>ADF / Apache Airflow</li></ul>
<ul><li>Data Warehousing</li></ul>
<ul><li>Git</li></ul>
<ul><li>CI/CD</li></ul></div>

Data Engineer Lead

FedEx

<div>Grade - T7 
 
Please note that the Job will close at 12am on Posting Close date, so please submit your application prior to the Close Date 
 
What your main responsibilities are: 
 
Job Profile Summary 
 
Design, build, and optimise scalable data engineering solutions that empower analytics, reporting, and data-driven decision-making across the enterprise. Lead the architecture, implementation, and enhancement of cloud-based data platforms and pipelines that integrate structured and unstructured data from multiple disparate sources. 
 
Serve as a technical and people leader, guiding a team of data engineers, mentoring junior members, and fostering a culture of collaboration, innovation, and excellence. Act as a key liaison between technical teams and business stakeholders, effectively translating complex data concepts into actionable insights and communicating recommendations to senior leadership. 
 
Drive standardisation of best practices, enforce data governance, and ensure high performance, reliability, and scalability of the enterprise data ecosystem using modern Azure-based data technologies. 
Grade - T7
Please note that the Job will close at 12am on Posting Close date, so please submit your application prior to the Close Date
What your main responsibilities are:
Data Architecture &amp; Engineering 
Architect, design, and implement robust and scalable data pipelines and data lake solutions across diverse data sources using Azure Data Factory, Databricks, Azure Synapse, and other Azure services.
ETL/ELT Development &amp; Optimization 
Build, automate, and optimize ETL/ELT processes for data ingestion, cleansing, transformation, and storage from RDBMS (Oracle, Teradata, SQL Server) and other structured/unstructured systems. Ensure efficient data flow and accessibility for analytics and machine learning workloads.
Cloud Data Solutions 
Lead the deployment and management of cloud-native data platforms leveraging Azure ecosystem tools. Drive adoption of new cloud capabilities that improve performance, scalability, and data democratization.
Leadership, Mentorship &amp; Collaboration 
Lead and inspire a team of data engineers &mdash; providing technical guidance, mentorship, and coaching to help them develop their skills and deliver quality solutions. 
Foster strong cross-functional collaboration with analysts, data scientists, and business teams to ensure alignment between data initiatives and organisational priorities.
Data Modeling &amp; Governance 
Develop and maintain data models and standards that support consistency, re usability, and governance across teams. Implement data quality frameworks, lineage tracking, and metadata management solutions.
Monitoring, Optimization &amp; Automation 
Oversee monitoring and observability systems for data pipelines. Drive continuous improvement through automation, CI/CD practices, and infrastructure-as-code for data workflows.
Presentation &amp; Strategic Communication 
Deliver compelling presentations and reports to senior leadership and technical stakeholders. 
Effectively communicate complex technical concepts, architectural designs, and project outcomes through clear storytelling and visualization. 
Influence data strategy and advocate for innovation and best practices across teams. 
What we are looking for
Education: 
Bachelor&rsquo;s degree in Computer Science, Information Systems, Engineering, or a quantitative discipline such as Mathematics or Statistics. Master&rsquo;s degree in a relevant field preferred.
Experience: 
Minimum 8+ years of experience in data engineering, data architecture, or big data environments, including experience leading teams or projects.
Technical Skills:<ul><li>
Expert in SQL, Python, and PySpark</li><li>
Strong experience with Azure Data Factory, Databricks, Synapse, Data Lake, Event Hubs, and Logic Apps</li><li>
Deep understanding of ETL/ELT, data modeling, data warehousing, and data lakehouse architecture</li><li>
Experience with DevOps for data (CI/CD, Infrastructure as Code)</li><li>
Familiarity with real-time data streaming (Kafka, Event Hubs)</li><li>
Knowledge of data quality, metadata management, governance, and security</li><li>
Exposure to machine learning pipelines, AI integration, and advanced analytics enablement is an advantage</li><li>
Good to have:</li><li>
Experience with Delta Lake, Unity Catalog, and data mesh architectures</li><li>
Working knowledge of Power BI and Tableau for visualization</li><li>
Familiarity with Azure ML, Airflow, and Kubernetes environments</li></ul> 
FedEx was built on a philosophy that puts people first, one we take seriously. We are an equal opportunity/affirmative action employer and we are committed to a diverse, equitable, and inclusive workforce in which we enforce fair treatment, and provide growth opportunities for everyone.
All qualified applicants will receive consideration for employment regardless of age, race, color, national origin, genetics, religion, gender, marital status, pregnancy (including childbirth or a related medical condition), physical or mental disability, or any other characteristic protected by applicable laws, regulations, and ordinances.<h2 class="jobSectionHeader">
Our Company</h2>
FedEx is one of the world's largest express transportation companies and has consistently been selected as one of the top 10 World&rsquo;s Most Admired Companies by &quot;Fortune&quot; magazine. Every day FedEx delivers for its customers with transportation and business solutions, serving more than 220 countries and territories around the globe. We can serve this global network due to our outstanding team of FedEx team members, who are tasked with making every FedEx experience outstanding.<h2 class="jobSectionHeader">
Our Philosophy</h2>
The People-Service-Profit philosophy (P-S-P) describes the principles that govern every FedEx decision, policy, or activity. FedEx takes care of our people; they, in turn, deliver the impeccable service demanded by our customers, who reward us with the profitability necessary to secure our future. The essential element in making the People-Service-Profit philosophy such a positive force for the company is where we close the circle, and return these profits back into the business, and invest back in our people. Our success in the industry is attributed to our people. Through our P-S-P philosophy, we have a work environment that encourages team members to be innovative in delivering the highest possible quality of service to our customers. We care for their well-being, and value their contributions to the company.<h2 class="jobSectionHeader">
Our Culture</h2>
Our culture is important for many reasons, and we intentionally bring it to life through our behaviors, actions, and activities in every part of the world. The FedEx culture and values have been a cornerstone of our success and growth since we began in the early 1970&rsquo;s. While other companies can copy our systems, infrastructure, and processes, our culture makes us unique and is often a differentiating factor as we compete and grow in today&rsquo;s global marketplace.</div>

Data Engineer-Lead II

Codvo.ai

<div><div><div>Job Description:Data Engineer (OT Data) (Category - Engineer)
Sector: Oil and Gas<div> 
Experience - 6+ years</div><div></div> 
About Us
At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology. 
The Opportunity:
The Data Engineer will be a foundational architect of our delivery strategy, responsible for building and maintaining the data ecosystem required for our scoped-out use cases. You will be the crucial link between our vast, complex data sources and our advanced analytics ambitions. This involves tackling the unique challenges of the oil and gas sector, bridging the worlds of operational technology (OT)&mdash;with its real-time drilling data, SCADA systems, and seismic surveys&mdash;and information technology (IT). Your mission is to build the specific, high-performance data pipelines required to deliver our portfolio of projects. This means going beyond simple data movement; you will be creating reliable, scalable, and secure data products that serve as the fuel for our most critical AI models and analytics dashboards, directly enabling tangible business value and competitive advantage.<div></div> 
Key Responsibilities:<ul><li>Architect &amp; Build Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems and ETL/ELT pipelines.</li><li>Integrate Diverse Data Sources: Develop processes to ingest and integrate high-volume, high-velocity data from SCADA systems, historians (like OSIsoft PI, Aspen InfoPlus.21), DCS, PLC, and IoT sensors.</li><li>Cloud Data Platform Development: Implement and manage data solutions on the Microsoft Azure cloud platform, Leveraging services like Azure IoT Hub, Azure Event Hubs, and Azure Stream Analytics for real-time ingestion and processing of operational technology (OT) data.</li><li>Data Modelling &amp; Warehousing: Design and implement data models optimized for time-series data from industrial assets, supporting operational dashboards and real-time analytics.</li><li>Enable Advanced AI: Build the data infrastructure to support AI/ML models for predictive maintenance, operational anomaly detection, and process optimization using real-time OT data.</li><li>Champion Master Data Management (MDM): Design and implement MDM strategies and solutions to create a single, authoritative source of truth for critical data domains such as wells, equipment, and assets, ensuring data consistency across the enterprise.</li><li>Ensure Data Quality &amp; Governance: Implement robust data quality checks, validation rules, and monitoring to ensure the accuracy, consistency, and reliability of our data. Adhere to and help shape our data governance policies.</li><li>Embrace Industry Standards: Champion and implement industry-specific data standards and models, such as the OSDU&trade; Data Platform, to ensure interoperability and a unified data view across the upstream lifecycle.</li><li>Collaborate &amp; Innovate: Work closely with a cross-functional team of geoscientists, drilling engineers, data scientists, and business analysts to understand their data needs and deliver effective solutions.</li><li>Automate &amp; Optimize: Identify opportunities for process automation and infrastructure optimization to improve data delivery, scalability, and cost-effectiveness.</li><li>Security First: Implement and maintain security best practices to protect our sensitive and proprietary data assets.</li></ul> 
Required Skills and Qualifications:<ul><li>Bachelor's in engineering, Information Systems, or a related quantitative field.</li><li>5+ years of proven experience in a data engineering role.</li><li>Experience within oil and gas industry is highly preferred.</li><li>Demonstrable experience building and operationalizing large-scale data pipelines and applications.</li></ul> 
Technical Proficiencies:<ul><li> 
Expert-level proficiency in SQL and Python for data manipulation and pipeline development.</li><li>Big Data Technologies: Hands-on experience with distributed computing frameworks like Apache Spark (PySpark). Experience with streaming technologies like Kafka is a plus.</li><li>Cloud Platforms: Deep experience with Microsoft Azure (Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Azure Synapse).</li><li>Data Warehousing/Lakehouse: Proven experience with modern data platforms Databricks Delta Lake.</li><li>AI &amp; ML Knowledge: Understanding of machine learning lifecycles and the data requirements for training and deploying AI/ML models.</li><li>Orchestration: Experience with workflow orchestration tools like Airflow, Dagster, or Azure Data Factory.</li><li>Databases: Strong understanding of both relational (e.g., PostgreSQL, SQL Server) and NoSQL databases. Experience with graph databases (e.g., Neo4j) and vector databases is highly desirable.</li><li>Version Control: Proficiency with Git and CI/CD best practices.</li></ul> 
Preferred Qualifications:<ul><li>Familiarity with historian systems (e.g., OSIsoft PI System) and their data structures.</li><li>Hands-on experience with the OSDU&trade; Data Platform.</li><li>Experience working with industrial communication protocols (e.g., OPC UA, Modbus TCP/IP).</li><li>Understanding of cybersecurity considerations for OT environments and data segregation.</li><li>Experience integrating data from ERP systems like SAP.</li><li>Professional certifications in Azure or Databricks.</li><li>Advanced SQL skills, including query optimization and performance tuning.</li><li>Knowledge of containerization technologies (Docker, Kubernetes).</li><li>Experience of constructing and maintaining enterprise knowledge graphs.</li></ul> 
Domain - Oil &amp; Gas</div></div></div>

Data Engineer Lead (OT Data)( Oil & Gas) (India)

Kenvue

<div><div><div><div><div><div><div><div>Kenvue is currently recruiting for a:</div></div></div></div></div></div></div>
Data Engineering Lead
What we do
At Kenvue, we realize the extraordinary power of everyday care. Built on over a century of heritage and rooted in science, we&rsquo;re the house of iconic brands - including NEUTROGENA&reg;, AVEENO&reg;, TYLENOL&reg;, LISTERINE&reg;, JOHNSON&rsquo;S&reg; and BAND-AID&reg; that you already know and love. Science is our passion; care is our talent.
Who We Are
Our global team is ~ 22,000 brilliant people with a workplace culture where every voice matters, and every contribution is appreciated. We are passionate about insights, innovation and committed to delivering the best products to our customers. With expertise and empathy, being a Kenvuer means having the power to impact millions of people every day. We put people first, care fiercely, earn trust with science and solve with courage &ndash; and have brilliant opportunities waiting for you! Join us in shaping our future&ndash;and yours.
Role reports to:
Data Engineering Manager
Location:
Asia Pacific, India, Karnataka, Bangalore
Work Location:
Hybrid
What you will do
As a Lead Data Engineer, you will Lead a team responsible for the build, enhancements, and optimization of modern data solutions and analytical products across the Azure Data Platform. You&rsquo;ll design and manage robust data pipelines (Azure Data Factory, Azure Databricks, Data Lake, Spark.,SQL, Posgres) You will collaborate closely with business stakeholders, data engineers, and data scientists to maintain reliable, secure, and scalable data products that drive decision-making&mdash;particularly within Supply Chain and CPG contexts.
Key Responsibilities: 
Data Engineering &amp; Platform Operations<ul><li>Design\Architect, develop, customize, and manage data integration tools, data lakes, warehouses, and analytical systems on Azure.</li><li>Build, scale, and harden data pipelines (internal &amp; external sources) using Azure Data Factory, Azure Databricks (PySpark/Spark SQL), Azure Data Lake, Azure Synapse, and Azure SQL\Posgres</li><li>Good understanding of different tools like Microsoft Fabric, Graph databases (Neo4J)</li></ul><ul><li>
Deploy data pipelines into production environments by enriching the model with data stored in a Data Lakes or coming directly from data sources, configuring data attributes, managing computing resources, setting up monitoring tools, etc.</li><li>
Mentor and Build a Data Engineering Support team composed of Data Engineering Resources</li></ul><ul><li>Own automation, observability, and monitoring frameworks&mdash;capturing operational KPIs and data quality metrics; set up alerting and runbooks.</li><li>Monitor performance &amp; stability, triage incidents, and adapt pipelines as data/models/requirements evolve.</li><li>Implement best practices for systems integration, security (RBAC, Key Vault, RLS/OLS), performance, cost optimization, and data governance.</li></ul><ul><li>
Work with the Data Asset and Capability teams to identify the right data sources and understand and build and support the data architectures for optimal data extraction and transformation for key business processes.</li><li>
Test the reliability and performance of data engineering pipelines and support testing team with data validation activities</li><li>
Partner with various Azure Engineering subject matter experts including project Managers and business team to scope and build customer facing content, modules, tools and proof of concepts</li><li>
Research and cultivate in state-of-the-art data engineering methodologies, drive product innovation, and act as an Azure subject matter expert for other engineers</li><li>Apply DevOps/DataOps/Agile methodologies; manage version control (Git/Bitbucket) and CI/CD pipelines (Azure DevOps/Jenkins) for data and BI assets.</li></ul>
Required Qualifications<ul><li>Bachelor&rsquo;s degree in Engineering, Computer Science, Data Analytics, IT, or related field.</li><li>6-8 years of relevant experience across Azure Data Engineering and Power BI.</li><li>Hands-on expertise with:</li></ul>
o Azure Databricks (PySpark/Spark SQL)\Microsoft Fabric, Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL\Posgres
o Data modelling, Performance Tuning
o SQL/T-SQL (complex queries, stored procedures)<ul><li>
Experience of leading a Data Engineering team</li><li>
Good scripting, data modeling and programming skills</li><li>
Understanding of cloud architecture principles and best practices</li><li>
Experience in the design and build of end-to-end solutions that meet business requirements and adhere to scalability, reliability, and security standards</li><li>
Familiarity with version control systems like Bitbucket, Jenkins and DevOps practices for CI/CD pipelines</li></ul> 
Desired Qualifications<ul><li>Certifications:</li></ul>
o Microsoft Certified: Azure Data Engineer Associate (DP-203)
o Databricks Data Engineer Associate/Professional<ul><li>
Familiarity with version control systems like Bitbucket, Jenkins and DevOps practices for CI/CD pipelines</li></ul><ul><li>Experience with migration &amp; modernization (from legacy ETL/BI to Azure-native).</li><li>Preferred CPG/Supply Chain domain expertise.</li><li>
Familiarity with version control systems like Bitbucket, Jenkins and DevOps practices for CI/CD pipelines</li></ul>
If you are an individual with a disability, please check our Disability Assistance page for information on how to request an accommodation.</div>

Data Engineering Lead

Bank of America

<div>Job Description:
At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day. 
 
Being a Great Place to Work is core to how we drive Responsible Growth. This includes our commitment to being an inclusive workplace, attracting and developing exceptional talent, supporting our teammates&rsquo; physical, emotional, and financial wellness, recognizing and rewarding performance, and how we make an impact in the communities we serve. 
 
Bank of America is committed to an in-office culture with specific requirements for office-based attendance and which allows for an appropriate level of flexibility for our teammates and businesses based on role-specific considerations. 
 
At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us! 
Job Description: 
This job is responsible for driving efforts to develop and deliver complex data solutions to accomplish technology and business goals. Key responsibilities include leading code design and delivery tasks with the integration, cleaning, transformation and control of data in operational and analytical data systems. Job expectations include liaising with vendors and working with stakeholders and Product and Software Engineering teams to implement data requirements, analyzing performance, and researching and troubleshooting issues within system engineering domains.
Enterprise BI Technology (EBIT) team is seeking a Power BI Technical Lead and Architect to lead Power BI Cloud initiative and SSRS migrations to Power BI Platform. As a Technical Lead, you will be responsible for leading development and support of Power BI COE and will work closely with the rest of the Power BI team and business peers to effectively execute Business Intelligence project initiatives. This person should be able to deliver in a fast-paced and deadline-driven environment. 
Responsibilities:<ul><li>
Leads story refinement and delivery of requirements through the delivery lifecycle and assists team members in resolving technical complexities</li><li>
Codes complex solutions to integrate, clean, transform, and control data, builds processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management, assembles complex data sets, and communicates required information for deployment</li><li>
Leads documentation of system requirements, collaborates with development teams to understand data requirements and feasibility, and leverages architectural components to develop client requirements</li><li>
Leads testing teams to develop test plans, contributes to existing test suites including integration, regression, and performance, analyzes test reports, identifies test issues and errors, and leads triage of underlying causes</li><li>
Leads work efforts with technology partners and stakeholders to close gaps in data management standards adherence, negotiates paths forward by thinking outside the box to identify and communicate solutions to complex problems, and leverages knowledge of information systems, techniques, and processes</li><li>
Leads complex information technology projects to ensure on-time delivery and adherence to release processes and risk management and defines and builds data pipelines to enable data-informed decision making</li><li>
Mentors Data Engineers to enable continuous development and monitors key performance indicators and internal controls</li></ul>
Required Qualification:<ul><li>
 10+ years of Data Analytics and Reporting experience.</li><li>
3+ years of Tech lead experience.</li><li>
Hands-on development Experience using Power BI.</li><li>
Development experience using other reporting tools like Tableau, MicroStrategy and Cognos.</li><li>
Good Analytical and Communication Skills</li><li>
Competent with Report Server and its metadata in SQL Server.</li><li>
Proven advanced skill and experience with Power BI development and administration.</li><li>
Proficient with querying languages, such as ANSI-SQL, T-SQL</li><li>
Problem solving / troubleshooting experience /skills to assist Production Support in issue resolution.</li><li>
Proven ability to independently champion business intelligence principles with business owners, application owners, data analysts and DBAs</li><li>
Proven ability to handle multiple projects while meeting deadlines and documenting progress towards those deadlines.</li><li>
Excellent communication skills (must be able to interface with both technical and business leaders in the organization)</li><li>
Ability to be a self-starter that can provide leadership.</li><li>
Comprehensive understanding of the Agile Development process</li><li>
Bachelor's degree in computer science or related field</li></ul>
Desired Qualification:<ul><li>
Experience leading or supporting enterprise Power BI Cloud implementations</li><li>
Hands‑on experience with SSRS modernization and migration to Power BI / PBIRS</li><li>
Familiarity with Power BI Premium and Microsoft Fabric capacity planning</li><li>
Experience establishing COE standards, governance frameworks, and operating models</li><li>
Prior experience mentoring or leading BI engineers and developers</li><li>
Strong understanding of enterprise BI security and compliance requirements</li><li>
Experience working with executive stakeholders and influencing technical direction</li></ul>
Skills:<ul><li>
Analytical Thinking</li><li>
Application Development</li><li>
Data Management</li><li>
DevOps Practices</li><li>
Solution Design</li><li>
Agile Practices</li><li>
Collaboration</li><li>
Decision Making</li><li>
Risk Management</li><li>
Test Engineering</li><li>
Architecture</li><li>
Business Acumen</li><li>
Data Quality Management</li><li>
Financial Management</li><li>
Solution Delivery Process</li></ul>
Shift:
1st shift (United States of America)
Hours Per Week:
40</div>

Data Engineer III

Confiz

<div>
 We seek an experienced Big Data expert to lead our Big Data platform's design, development, and maintenance. Collaborating with data engineers and Big Data Business Analysts across various platform layers, you'll demonstrate a commitment to collaborative problem-solving, sophisticated design, and delivering high-quality products.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Facilitate and lead the roadmap and enhancements for the enterprise Big Data platform.
 </li>
 <li>
 Lead Data Engineers, Business Analysts, and BI engineers to architect and deliver the solutions that fulfill the Business information needs.
 </li>
 <li>
 Ensure the design, code, and procedural aspects of the solution are production-ready, in terms of operational, security, and compliance standards.
 </li>
 <li>
 Participate in day-to-day project and production delivery status meetings, and provide technical support for faster resolution of issues.
 </li>
 <li>
 Yearning for continuous learning and training/mentoring future big data developers and architects.
 </li>
 <li>
 Design and implement scalable, near real-time data ingestion pipelines to enable low-latency data processing and analytics.
 </li>
 <li>
 Architect and optimize data streaming solutions to handle high-throughput, distributed systems while ensuring data consistency, reliability, and fault tolerance in near real-time workflows.
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 <ul>
 <li>
 14 years of experience in enterprise data architecture, integration, and analytics, with a proven track record of design and implementation of big data and analytics solutions in recent years.
 </li>
 <li>
 Experience in leading a team of Data Engineers and BI Developers.
 </li>
 <li>
 Bachelor&rsquo;s degree in computer science or relevant field from an accredited college or university; Master&rsquo;s degree from an accredited college or university preferred.
 </li>
 <li>
 Strong technical experience in the following:
 </li>
 <li>
 Big data stack and solutions, including cloud technologies.
 </li>
 <ul>
 <li>
 Data lake architecture, including data model design and implementation (incl. relational, dimensional, and No-SQL).
 </li>
 <li>
 Enterprise Application and Data Integration design and implementation (e.g. ETL, messaging, replication, and APIs).
 </li>
 <li>
 Telco Domain Experience
 </li>
 <li>
 Azure Solutions Architect Certification
 </li>
 <li>
 Azure Data Lake, Azure Data Factory, Databricks, Azure SQL, Apache NiFi, Azure Synapse, Power BI
 </li>
 </ul>
 <li>
 Awareness of Data management best practices (e.g. data quality, metadata management, data lineage).
 </li>
 <li>
 Awareness of Machine Learning techniques is nice to have
 </li>
 <li>
 Willingness to travel to UK (25% travelling might be required)
 
 </li>
 </ul>
 We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
 
 
 What makes Confiz stand out is our focus on processes and culture. Confiz is
 
 ISO 9001:2015
 
 (QMS),
 
 ISO 27001:2022
 
 (ISMS),
 
 ISO 20000-1:2018
 
 (ITSM),
 
 ISO 14001:2015
 
 (EMS),
 
 ISO 45001:2018
 
 (OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
 
 
 People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
 
 
 To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/
</div>

Big Data Architect

<div>We seek an experienced Big Data expert to lead our Big Data platform's design, development, and maintenance. Collaborating with data engineers and Big Data Business Analysts across various platform layers, you'll demonstrate a commitment to collaborative problem-solving, sophisticated design, and delivering high-quality products.
Responsibilities:
<ul><li>Facilitate and lead the roadmap and enhancements for the enterprise Big Data platform.</li>
<li>Lead Data Engineers, Business Analysts, and BI engineers to architect and deliver the solutions that fulfill the Business information needs.</li>
<li>Ensure the design, code, and procedural aspects of the solution are production-ready, in terms of operational, security, and compliance standards.</li>
<li>Participate in day-to-day project and production delivery status meetings, and provide technical support for faster resolution of issues.</li>
<li>Yearning for continuous learning and training/mentoring future big data developers and architects.</li>
<li>Design and implement scalable, near real-time data ingestion pipelines to enable low-latency data processing and analytics.</li>
<li>Architect and optimize data streaming solutions to handle high-throughput, distributed systems while ensuring data consistency, reliability, and fault tolerance in near real-time workflows.</li>
</ul>
Qualifications:
<ul><li>14 years of experience in enterprise data architecture, integration, and analytics, with a proven track record of design and implementation of big data and analytics solutions in recent years.</li>
<li>Experience in leading a team of Data Engineers and BI Developers.</li>
<li>Bachelor&rsquo;s degree in computer science or relevant field from an accredited college or university; Master&rsquo;s degree from an accredited college or university preferred.</li>
<li>Strong technical experience in the following:</li>
<li>Big data stack and solutions, including cloud technologies.
<ul><li>Data lake architecture, including data model design and implementation (incl. relational, dimensional, and No-SQL).</li>
<li>Enterprise Application and Data Integration design and implementation (e.g. ETL, messaging, replication, and APIs).</li>
<li>Telco Domain Experience</li>
<li>Azure Solutions Architect Certification</li>
<li>Azure Data Lake, Azure Data Factory, Databricks, Azure SQL, Apache NiFi, Azure Synapse, Power BI</li>
</ul></li><li>Awareness of Data management best practices (e.g. data quality, metadata management, data lineage).</li>
<li>Awareness of Machine Learning techniques is nice to have</li>
<li>Willingness to travel to UK (25% travelling might be required)</li></ul> 

We have an amazing team of 700+ individuals working on highly innovative enterprise projects &amp; products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), ISO 14001:2015 (EMS), ISO 45001:2018 (OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/</div>

Search 10000+ Data engineer lead jobs near you this March. New roles added regularly across leading industries. Apply today.

10000 data engineer lead jobs Near Me

Data Engineer Lead

Data Engineer-Lead II

Data Engineer Lead (OT Data)( Oil & Gas) (India)

Data Engineering Lead

Data Engineer III

Big Data Architect

Big Data Architect