cloud data engineer

Apple

<div>The people here at Apple don&rsquo;t just build products - they build the kind of wonder that&rsquo;s revolutionized entire industries. It&rsquo;s the diversity of those people and their ideas that inspires the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Join Apple, and help us leave the world better than we found it. Imagine what you could do here.<br>
<br>
Are you passionate about handling large &amp; complex data problems, want to make an impact and have the desire to work on groundbreaking big data technologies? Then we are looking for you.<br>
<br>
At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Would you like to work in a fast-paced environment where your technical abilities will be challenged on a day-to-day basis? If so, Apple's Global Business Intelligence team is looking for passionate, meticulous, technical savvy, energetic engineer who likes to think creatively.<br>
<br>
<b>Description</b><br>
Apple's Enterprise Data warehouse team deals with Petabytes of data catering to a wide variety of real- time, near real-time and batch analytical solutions. These solutions are integral part of business functions like Retail, Sales, Operations, Finance, AppleCare, Marketing and Internet Services, enabling business drivers to make critical decisions. We use a diverse technology stack such as Snowflake, Spark, HANA, SingleStore, Kafka, Iceberg, Cassandra and beyond. Designing, developing and scaling these big data solutions are a core part of our daily job.&quot;,&quot;responsibilities&quot;:&quot;- As a Cloud Data Engineer you will design, develop and implement modern cloud based data warehouse/ data lakes and influence overall data strategy for the organization.
<br>
<br>
<ul><li>Translate complex business requirements into scalable technical solutions meeting data warehousing/analytics design standards</li></ul><br>
<ul><li>Strong understanding of analytics needs and proactive-ness to build solutions to improve the efficiency along with that help implement leading data practices &amp; standards.</li></ul><br>
<ul><li>Collaborate with multiple multi-functional teams and work on solutions which has larger impact on Apple business</li></ul><br>
- Ability to communicate effectively, both written and verbal, with technical and non- technical multi-functional teams<br>
<br>
<ul><li>You will get along with many other internal/external teams to deliver elite products in an exciting rapidly changing environment</li></ul><br>
<ul><li>Ability to manage partner communication &amp; project risks.</li></ul><br>
<ul><li>Thrives in a multifaceted environment, maintaining composure and a positive attitude.</li></ul><br>
<b>
Preferred Qualifications</b><br>
High expertise in modern cloud warehouse, data lakes and implementation experience on any of the cloud platforms like AWS/GCP/Azure - preferably AWS.
<br>
<br>
Experience working with data at scale (peta bytes) with big data tech stack and advanced programming languages e:g Python, Scala.<br>
<br>
Database development experience with Relational or MPP/distributed systems such as Snowflake, SingleStore
<br>
<br>
Excellent problem solving, critical thinking with ability to evaluate and apply new technologies in a short time<br>
<br>
Strong written and oral communication skills<br>
<br>
Experience in working with global collaborators with ability to influence decision making.
<br>
<br>
Dedicated, highly motivated with learnability skills.
<br>
<br>
Exposure working in Data Science projects will be a plus<br>
<br>
<b>Minimum Qualifications</b><br>
5 - 8 years of Hands on Experience in developing and building data pipelines on Cloud &amp; Hybrid infrastructure for analytical needs<br>
Experience working with cloud based data warehouse solutions - Snowflake, SingleStore etc., along with expertise in SQL and Advance SQL.<br>
Experience in designing and building dimensional data models to improve accessibility, efficiency and quality of data
<br>
Bachelor&rsquo;s Degree or equivalent in data engineering, computer science or similar field.&quot;,&quot;internalDetails&quot;:null,&quot;eeoContent&quot;:null</div>

Cloud Data Engineer

BMW TechWorks India

<p></p><div><div><div><div><div><div><div><div><div><div><div>Skills</div></div><div><div><p>
Skill</p><div><p>
PYTHON
</p><p>PYSPARK
</p><p>MYSQL
</p><p>AWS
</p><p>AWS GLUE
</p><p>FIXERS
</p></div></div><div><p>Minimum Qualification</p><div><p>
B.TECH/B.E</p><p>
MCA</p></div></div></div></div></div><div><div><div><div>
Job Description</div></div><p><div><div><div><b>
Role</b></div><div><br>
Senior Cloud Data Engineer</div></div><div></div><div><div><div><b><br>
Visit our website </b><b>bmwtechworks.in</b><b> to know more.</b></div></div></div><div></div><div><div><b><br>
Location</b></div><div><br>
Chennai</div></div><div><div><b><br>
Experience:</b></div><div><br>
6 to 8 Years</div></div><div><div><div><b><br>
What awaits you/ Job Profile</b></div></div><div></div><div><div><br>
You will design, develop, and optimize large-scale data pipelines. You will take ownership of critical components of the data architecture, ensuring performance, security, and compliance.</div><ul><li>
Design and implement scalable data pipelines for batch and real-time processing.</li><li>
Optimize data storage and computing resources to improve cost and performance.</li><li>
Ensure data security and compliance with industry regulations.</li><li>
Collaborate with data scientists, analysts, and application teams to align data storage strategies.</li><li>
Lead technical discussions with stakeholders to deliver the best possible solutions.</li><li>
Automate data workflows and develop reusable frameworks.</li><li>
Monitor and troubleshoot ETL pipelines, jobs, and cloud services.</li></ul></div></div><div><div><div><b><br>
What should you bring along</b></div></div><br>
<div></div><ul><li>
6+ years of experience in AWS cloud services and data engineering.</li><li>
Strong expertise in data modeling, ETL pipeline design, and SQL query optimization.</li><li>
Prior experience working with streaming solutions like Kafka.</li><li>
Excellent knowledge of Terraform and GitHub Actions.</li><li>
Experienced in being in the lead of a feature team.</li></ul></div><div><div><b><br>
Must have technical skill</b></div><br>
<ul><li>
Python, PySpark, Hive, Unix</li><li>
AWS (S3, Lambda, Glue, Athena, RDS, Step Functions, SNS, SQS, API Gateway)</li><li>
MySQL, Oracle, NoSQL and experience in writing complex queries</li></ul></div><div><div><b><br>
Good to have technical skills</b></div><br>
<ul><li>
Cloud Architect Certification.</li><li>
Terraform</li><li>
Git, GitHub Actions, Jenkins</li><li>
Delta Lake, Iceberg</li><li>
Experience in AI-powered data solutions</li></ul></div></div></p></div></div></div></div></div></div></div></div></div><p></p>

Senior Cloud Data Engineer

Capco

<p></p><div><p><b>About Us</b></p>
<p><b>
&ldquo;Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar &amp; Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.</b></p>
<p><b>
WHY JOIN CAPCO?</b></p>
<p><b>
You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.</b></p>
<p><b>
MAKE AN IMPACT</b></p>
<p><b>
Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.</b></p>
<p><b>
#BEYOURSELFATWORK</b></p>
<p><b>
Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.</b></p><br>
<p></p>
<p><b>
CAREER ADVANCEMENT</b></p>
<p><b>
With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.</b></p>
<p><b>
DIVERSITY &amp; INCLUSION</b></p>
<p><b>
We believe that diversity of people and perspective gives us a competitive advantage.</b></p>
<p><b>
MAKE AN IMPACT</b></p>
<div>
<div><div><div><p>Key Responsibilities -</p><p><br>
Design, develop and deploy AI/ML solutions on cloud platform(AWS)<br>
Build and optimize data pipelines using Databricks and PySpark for large-scale data processing<br>
Implement machine learning models and integrate them into production environments<br>
Collaborate with data scientists and engineers to ensure scalable and efficient solutions<br>
Monitor and maintain cloud-based ML workflows for performance and cost optimization<br>
Maintain and support current legacy system in Unix and sql , pl/sql environment<br>
Develop high quality, secure and scalable data pipelines using spark, Java/Scala on object storage and Hadoop<br>
Follow MasterCard Quality Assurance and Quality Control processes<br>
Leverage new technologies and approaches to innovating with increasingly large data sets<br>
Work with project team to meet scheduled due dates, while identifying emerging issues and recommending solutions for problems<br>
Perform assigned tasks and production incident independently<br>
Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency
<br>
<br>
All About You<br>
Hands-on experience with cloud platform(AWS) for AI/ML workloads.<br>
Strong proficiency in Python and PySpark for data engineering and ML tasks.<br>
Solid understanding of Databricks for big data processing and ML model deployment.<br>
Knowledge of data architecture, distributed computing and performance tuning.<br>
Familiarity with CI/CD pipelines for ML models.<br>
Should have experience of working in Unix environment<br>
Experience in Data Engineering and implementing multiple end-to-end DW projects in Big Data environment<br>
Experience of building data pipelines through Spark with Java/Scala on Hadoop or Object storage<br>
Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge<br>
Experience of working on Nifi will be an added advantage<br>
Experience of working with APIs will be an added advantage<br>
Understanding of containerization (Docker, Kubernetes) added advantage<br>
Experience of working in Agile teams<br>
Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan<br>
Strong communication skills - both verbal and written &ndash; and strong relationship, collaboration skills and organizational skills<br>
Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members<br>
Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results<br>
Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement<br>
Flexibility to work as a member of a matrix based diverse and geographically distributed project teams</p></div></div></div></div></div>

Eating Recovery Center Pathlight Mood and Anxiety Center

<div><p><b>Who we are</b></p>
<p>ERC Pathlight is an innovative, rapidly growing clinical leader in the behavioral health sector. Founded in 2008 by pre-eminent psychiatrists and psychologists in the eating disorder space, ERC Pathlight now treats over 6,000 patients per year, operates more than 30 facilities in 9 states and delivers tele-healthcare to patients nationally. We offer the most comprehensive treatment program in the country for patients who struggle with eating disorders, mood and anxiety and trauma-related disorders.</p>
<p><b>What you'll be doing:</b></p>
<p>The Senior Cloud Data Engineer at ERC Pathlight is responsible for designing, building, and maintaining scalable data pipelines that enable reliable, accessible, and high-quality data across the organization. This role supports clinical, operational, and analytical teams by transforming raw data into actionable insights, helping drive informed decision-making and improved patient outcomes. By ensuring the integrity and performance of our data systems, the Senior Data Engineer plays a key role in advancing ERC Pathlight&rsquo;s mission to provide evidence-based treatment for mood, anxiety, and eating disorders. This is a key role in building the Enterprise Data Warehouse (EDW) for ERC Pathlight.
</p><p><b>Essential Duties:</b></p>
<p><b>Data Integration Engineering</b></p>
<ul><li>Lead and strongly work on enterprise cloud data engineering, design, and data management techniques and principles related to <b>data warehousing, operations data stores, data marts, data lake design, and other</b> emerging technologies.</li>
<li>Design and orchestrate batch and real-time data ingestion workflows using <b>Azure Data Factory (ADF)</b> and other ETL tools such as Informatica IICS, Snowflake, AWS Glue, etc.</li>
<li>Heavily works on <b>building, testing, deploying, and monitoring</b> scalable ETL/ELT pipelines using Azure Data Factory and related Azure services.</li>
<li>Lead and work on data pipelines for troubleshooting, development of triggers, automatic failure notification, optimizing, and cost-tuning Azure-based data pipelines and cloud workflows.</li>
<li>Integrate data from a wide range of cloud data systems, cloud storage and web applications, such as Meta Ads, Google Ads, GA4, BigQuery, Salesforce, and REST APIs using Azure Data Factory.</li>
<li><b>Querying, managing, and optimizing datasets</b> within Azure SQL Database and Azure Synapse Analytics.</li>
<li>Work with <b>Azure Data Lake and Azure Blob Storage</b> to manage structured and unstructured data assets.</li>
<li>Develop robust pipelines to ingest data from <b>databases, sFTP, file-based systems, and external APIs</b> within the Azure ecosystem.</li>
<li>Strongly work on Azure data and AI ecosystem, with proficiency in services such as <b>Azure Data Lake, Azure Synapse Analytics, Azure ML, Azure SQL Database</b>, and seamless integration of ADF pipelines with <b>AI/ML workflows</b>.</li>
<li><b>Develop and operationalize AI/ML pipelines</b>, including preparing training datasets, orchestrating model training/inference, and integrating ML models into data workflows using ADF, Azure ML, Databricks, or Synapse ML.</li>
<li>Lead and implement and <b>uphold coding standards, manage code reviews, and lead data</b> validation and testing (unit, integration, and regression) and other documentations.</li>
<li>Lead and establish ETL <b>coding standards, EDW naming conventions, and other best practices for EDW development.</b></li>
<li>Store healthcare data vocabulary, business glossaries, data dictionaries such as <b>SNOMED CT, LOINC, ICD-10, and RxNorm</b> etc. inside EDW.</li>
<li>Lead, implement and adopt <b>Azure board, CI/CD pipelines, including branching strategies, version control (e.g., Git), </b>and automated deployments.</li>
<li>Guide and mentor data engineering team on <b>ETL development, troubleshoot, document creation, Proof of concept projects</b> and other data engineering initiatives.
</li></ul><p><b>Data Modeling</b></p>
<ul><li>Lead data modeling initiatives including <b>data normalization, denormalization, relational database design,</b> and using data modeling tools such as ER/Studio, Erwin, or SQL Power Architect.</li>
<li>Adopt and EDW clinical data model, including <b>conceptual, logical, and physical model</b> design for both transactional and analytical systems.</li>
<li>Design and implement scalable, cloud-optimized data models (<b>e.g., star, snowflake, or data vault)</b> to support analytical and operational workloads.</li>
<li>Optimize data models for performance, cost-efficiency, and maintainability across cloud data warehouses like <b>BigQuery, Redshift, Synapse, Azure SQL, or Snowflake.</b></li>
</ul>
<p><b>Data Security, Quality and Governance</b></p>
<ul><li>Develop and maintain <b>data quality frameworks, including data profiling, validation, and cleansing </b>strategies.</li>
<li>Lead and drive <b>metadata management and data lineage practices that support auditability, compliance, and governance.</b></li>
<li>Design and implement secure data pipelines on cloud platforms, ensuring encryption at rest and in transit also build various quality frames such an<b> encryption, tokenization, patterning etc.</b></li>
<li>Collaborate with security teams to enforce IAM policies, audit logs, and compliance with standards like <b>HIPAA, GDPR, or SOC 2.</b></li>
<li>Monitor and remediate vulnerabilities in <b>data infrastructure, leveraging tools for threat detection and incident response</b>.</li>
<li>Implement data cataloging and lineage tools such as <b>Purview, Informatica EDC, Collabra etc.</b> to support discoverability, traceability, and compliance requirements.</li>
<li>Build data validation frameworks such as <b>Audit, Balance and Control (ABC) frameworks to ensure accuracy, completeness, and consistency</b> across pipelines.</li>
</ul>
<p><b>Project management, Problem solving, Innovations and Collaboration</b></p>
<ul><li>Lead and manage end-of-the-end data engineering projects by <b>tracking deliverables and timelines</b> using tools like Smartsheet and Excel, ensuring <b>realistic scheduling and on-time delivery of all project milestones and task line items.</b></li>
<li>Lead the exploration and establishment of an <b>agentic AI/ML and clinical advanced analytics framework,</b> contributing to proof-of-concept (POC) initiatives and <b>study models to</b> support future development.</li>
<li>Diagnosis and resolving<b> bottlenecks in large-scale data pipelines</b> such as Azure Data Factory, Data Lake, Databricks, snowflake etc. applying root cause analysis and creative solutions to ensure system reliability and efficiency.</li>
<li>Pioneer scalable data pipeline architectures such as <b>Hub and Spoke, Medallion architecture, SOA, Datamart&rsquo;s/data Warehouse</b> etc. using emerging cloud technologies, driving automation and cost optimization across data platforms.</li>
<li>Partner closely with <b>data scientists, analysts, and cross-functional teams</b> to gather <b>requirements, design data models, and deliver high-impact</b> solutions aligned with business goals including <b>offshore and global data engineering and analytics team</b>.</li>
<li>Create <b>high-level design documents, mapping specification</b> documents, and detailed design documents, and present them in various forums such as <b>analytics roundtables, working groups, monthly showcases, and other stakeholder meetings</b>.</li>
<li>Strongly collaborate with <b>business, clinical, and technical stakeholders</b> to align data initiatives with organizational goals and regulatory requirements (e.g., HIPAA, GDPR).</li>
<li>Lead, advocate and manage <b>project timelines, prioritize tasks</b>, adapt to changing requirements, and deliver high-quality data solutions on time.</li>
</ul>
<p><b>Must Haves:</b></p>
<ul><li>Bachelors degree in Computer Science, Data Science, Information Systems, Software Engineering, Computer Engineering, or other applicable field.</li>
<li>Over 5 years of experience in designing and implementing <b>conceptual, logical, and physical data models in both transactional and analytical environments for healthcare organizations.
</b></li><li>Over 5 years of recent hands-on experience in designing and implementing cloud data engineering solutions in the <b>healthcare domain</b>.</li>
<li>Over 8 years of experience in Deep understanding of <b>data normalization and denormalization principles</b>, relational database design, and performance optimization.</li>
<li>Over 10 Years of experience in developing cloud <b>data warehousing, data lake, data marts and centralized data</b> ecosystem using various ETL tools and database management system.
</li><li>Over 8 years of experience translating <b>complex business and clinical requirements into scalable data structures that support reporting, analytics, and interoperability</b>.</li>
<li>Over 5 years of experience in healthcare industry-standard healthcare data models <b>(e.g., CDISC SDTM/ADaM, OMOP, FHIR, HL7).</b></li>
<li>Over 7 years of experience in developing, automating, and optimizing scalable data pipelines using <b>Azure Data Factory, Azure Synapse Analytics, and Azure Databricks</b> to ingest, transform, and load data from various sources into cloud-based data lakes and warehouses.</li>
<li>Over 7 years of experience in Implementing<b> robust data models and architecture</b> using Azure SQL Database, Azure Lake Storage Gen2, and Delta Lake to support analytics, BI, and machine learning cases.</li>
<li>Over 7 years of experience in<b> developing and maintaining ADF pipelines, data flows, and integration runtimes</b>, ensuring reliable and scalable data ingestion into Azure Data Lake, Azure SQL, and Synapse Analytics.</li>
<li>Over 5 years of experience in master data management &amp; data quality, metadata management, data lineage, business glossaries &amp; definition documentation, ensuring transparency and traceability of model elements.</li>
<li>Over 7 years of experience in designing and developing complex <b>Azure Data Factory (ADF) pipelines</b> to orchestrate data ingestion, transformation, and loading (ETL/ELT) across hybrid data sources including <b>SQL Server, REST APIs, Blob Storage, and third-party services.</b></li>
<li>Over 3 years of experience designing and implementing <b>AI/ML pipelines and training data models</b> for analytics engines using a variety of cloud-based analytics tools</li>
<li>Over 3 years of leading and principal data engineering experience in data integration, modeling, data quality, validation and security.
</li><li>Possess outstanding communication (written and verbal), listening and interpersonal skills; and be able to quickly establish credibility and rapport with a broad set of executives and constituencies.</li>
<li>Proven track record of collaboration and relationship building across diverse teams in a heterogeneous environment.</li>
<li>Ability to develop and enhance partnership with customers, take ownership of issues, and assist customers in navigating ITS using &quot;warm handoffs&quot; and other related techniques.</li>
<li>Ability to prepare and give presentations, and to communicate (written and verbal) complex technical content to technical and non-technical stakeholders.</li>
<li>Ability to work with customers to conduct detailed requirements gathering and analyze information to translate customer objectives into a detailed technical implementation plan.</li>
<li>Experience mentoring, coaching and training staff, and creating personal development plans.</li>
</ul>
<p><b>How we invest in you</b></p>
<p>Every role at ERC Pathlight is essential to delivering the high-quality care we promise to our patients. This means that from day one, we&rsquo;re here to support your role by offering ongoing training and continuing education opportunities as well as support to achieve internal growth.</p>
<p><b>What we offer</b></p>
<p>Healthy organizations value the mental wellness of their teams, and we understand that the professionals who work for us are not immune to their own mental health conditions. In the same way we observe and guide our patients, we take the same consideration for our employees when building our benefits packages and healthcare offerings. We offer competitive pay, comprehensive benefit plans, Generous Paid Time Off, 401(K) with company match and tuition reimbursement.</p>
<p><i>The compensation for the Sr Data and Engineering position ranges from $145,000- $175,000 and is dependent on candidate experience and market location.</i></p></div><p></p>

Sr Cloud Data Engineer

Qatar Airways

<div><div><div><div><div><div><div><div>Job title
</div><div>Data Engineer - Ahmedabad, India
</div></div><div><div>Ref #
</div><div>224369
</div></div><div><div>Location
</div><div>India - Ahmedabad
</div></div><div><div>Job family
</div><div>Corporate &amp; Commercial
</div></div><div><div><ul><li>Closing date: 31-Dec-2025</li></ul><br>
</div></div></div></div></div><div><div><div><div><div><p>We are seeking a highly skilled Senior Data Engineer with extensive experience in Google Cloud to join our dynamic team. In this role, you will be responsible for designing, implementing, and optimizing data pipelines and architectures to support our data-driven decision-making processes. You will collaborate with cross-functional teams to ensure the seamless integration and utilization of data across the organization.</p><p><b>
Key Responsibilities:</b></p><ul><li>Design and develop scalable data pipelines and architectures using Google Cloud Platform (GCP) services.</li><li>Create and maintain optimum data pipeline architecture for ingestion, storage, processing &amp; transformation of data for building data products for analytics</li><li>Implement data integration solutions to consolidate data from various sources.</li><li>Build the optimal data extraction &amp; transformation mechanisms for various kinds of data.</li><li>Optimize data storage and retrieval processes for performance and cost-efficiency.</li><li>Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.</li><li>Ensure data quality, integrity, and security across all data processes.</li><li>Conduct pro-active performance and fine tuning for early detection and rectification of slow response, application errors, tuning, and implement corrective and preventive actions.</li><li>Monitor and troubleshoot data pipeline issues to ensure continuous data flow.</li><li>Build data pipelines which are scalable, resilient and sustainable to address business requirements.</li><li>Excellent problem-solving skills and attention to detail.</li><li>Stay updated with the latest trends and best practices in data engineering and Google Cloud technologies.</li></ul><p><b>
Be part of an extraordinary story</b><br>
Your skills. Your imagination. Your ambition. Here, there are no boundaries to your potential and the impact you can make. You&rsquo;ll find infinite opportunities to grow and work on the biggest, most rewarding challenges that will build your skills and experience. You have the chance to be a part of our future, and build the life you want while being part of an international community. Our best is here and still to come. To us, impossible is only a challenge. Join us as we dare to achieve what&rsquo;s never been done before.</p><p>
Together, everything is possible.</p>
</div></div></div></div></div><div><div><div><h3 class="jobSectionHeader"><b>Qualifications
</b></h3></div></div><div><div><div><div><div><b>About you</b><br>
<ul><li>Proven experience as a Senior Data Engineer, with a focus on Google Cloud Platform (GCP).</li><li>Strong proficiency in GCP services such as BigQuery, Dataproc, Dataflow, Pub/Sub, Cloud Composer, and Cloud Storage.</li><li>Expertise in SQL and database management.</li><li>Experience with ETL processes and tools.</li><li>Proficiency in Python programming language.</li><li>Knowledge of data modeling, data warehousing, and data lakes.</li><li>Excellent problem-solving skills and attention to detail.</li><li>Strong communication and collaboration skills.</li><li>Experience with machine learning and AI frameworks.</li><li>Knowledge of containerization and orchestration tools.</li><li>Experience with data visualization tools (Tableau, PowerBI, Looker).</li><li>Understanding of data governance and compliance standards.</li><li>Knowledge of airline domain</li><li>Knowledge of agile/lean development methodologies</li></ul></div><p><b>
About Qatar Airways Group</b><br>
Our story started with four aircraft. Today, we deliver excellence across 12 different businesses coming together as one. We&rsquo;ve grown fast, broken records and set trends that others follow. We don&rsquo;t slow down by the fear of failure. Instead, we dare to achieve what&rsquo;s never been done before. So, whether you&rsquo;re creating a unique experience for our customers or innovating behind the scenes, every person contributes to our proud story. A story of spectacular growth and determination. Now is the time to bring your best ideas and passion to a place where your ambition will know no boundaries, and be part of a truly global community.</p><p><b>
How to apply</b><br>
If you&rsquo;re ready to join a progressive team and have a challenging and rewarding career, then apply now by uploading your CV and completing our quick application form.</p><br>
</div></div><div></div><div><div><br>
<div><b>About Qatar Airways Group
</b></div><br>
Our story started with four aircraft. Today, we deliver excellence across 12 different businesses coming together as one. We&rsquo;ve grown fast, broken records and set trends that others follow. We don&rsquo;t slow down by the fear of failure. Instead, we dare to achieve what&rsquo;s never been done before.<br>
<br>
So whether you&rsquo;re creating a unique experience for our customers or innovating behind the scenes, every person contributes to our proud story. A story of spectacular growth and determination. Now is the time to bring your best ideas and passion to a place where your ambition will know no boundaries, and be part of a truly global community.<br>
</div></div><div><div>https://aa115.taleo.net/careersection/QA_External_CS/jobapply.ftl?lang=en&amp;job=224369</div></div></div></div></div></div></div></div>

Data Engineer - Ahmedabad, India

Capgemini Engineering

<div><p>At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.</p><div><div><div><div><b>
Your Role</b></div></div><div><ul><li>
Build and optimize data pipelines, design scalable data architectures, and enable advanced analytics and machine learning workflows on <b>Google Cloud Platform (GCP)</b>.
</li><li>Collaborate with data scientists, analysts, and application developers to deliver high-quality data solutions.
</li><li>Ensure data quality, governance, and security across all pipelines and storage layers.
</li><li>Implement data quality checks and monitoring, ensuring data accuracy and reliability.</li></ul></div></div><div><div><div><b>
Your Profile</b></div></div><div><ul><li>
7&ndash;10 years of experience as a Google Cloud data engineer with hands-on expertise in <b>GCP Dataflow, BigQuery, Pub/Sub, Cloud Composer, and Cloud Storage</b>.
</li><li>Proficiency in <b>Python, PySpark</b>, and strong SQL skills including query optimization and performance tuning.
</li><li>Experience with big data tools (<b>Hadoop, Spark, Kafka</b>) and relational/NoSQL databases such as Microsoft SQL Server, MySQL, PostgreSQL, Oracle, Hadoop, Cassandra, MongoDB.
</li><li>Strong analytic skills for structured, semi-structured, and unstructured datasets, along with familiarity with data warehousing, data lake concepts, and ETL processes.</li></ul></div></div><div><div><div><b>
What you will love about working here</b></div></div><div><ul><li>
We recognize the significance of flexible work arrangements to provide support. Be it remote work, or flexible work hours, you will get an environment to maintain healthy work life balance.</li><li>
At the heart of our mission is your career growth. Our array of career growth programs and diverse professions are crafted to support you in exploring a world of opportunities.</li><li>
Equip yourself with valuable certifications in the latest technologies such as Generative AI.</li></ul></div></div></div><p>
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.</p></div>
<br><div><div><div><div>Ref. code</div><div>
360373-en_GB</div></div><div><div>
Posted on</div><div>
26 Nov 2025</div></div><div><div>
Experience level</div><div>
Experienced Professionals</div></div><div><div>
Contract type</div><div>
Permanent</div></div><div><div>
Location</div><div>
Bangalore</div></div><div><div>
Business unit</div><div>
INVENT</div></div><div><div>
Brand</div><div>
Capgemini Invent</div></div><div><div>
Professional communities</div><div>
Data &amp; AI</div></div></div></div><p></p>

GCP Data Engineer

ZecData Technology

<p><b>Job Description: Data Engineer</b></p><p><b>Position:</b> Data Engineer<br/><b>Location:</b> Indore<br/><b>Experience:</b> 0-7<br/><b>Employment Type:</b> Full-Time</p><p><b>Job Summary:</b></p><p>We are looking for a skilled Data Engineer to design, develop, and maintain data pipelines, ensuring efficient data processing, storage, and retrieval for business analytics and decision-making. The ideal candidate will have strong experience in working with large-scale data systems, ETL processes, and cloud-based platforms.</p><p><b>Key Responsibilities:</b></p><ul><li><b>Data Pipeline Development:</b></li><li>Design, build, and maintain scalable, reliable, and efficient data pipelines to process and integrate data from various sources.</li><li>Ensure the timely and accurate flow of data across systems.</li><li><b>Data Architecture:</b></li><li>Develop and optimize data models and architectures for data warehouses, data lakes, and databases.</li><li>Collaborate with data scientists, analysts, and other stakeholders to ensure data accessibility.</li><li><b>ETL/ELT Processes:</b></li><li>Design and implement ETL/ELT workflows to extract, transform, and load data from diverse sources into target systems.</li><li>Monitor and troubleshoot ETL processes to maintain data integrity.</li><li><b>Data Governance:</b></li><li>Implement data quality checks, validation processes, and monitoring to ensure accuracy and consistency.</li><li>Ensure compliance with data privacy regulations and organizational policies.</li><li><b>Cloud &amp; Big Data Platforms:</b></li><li>Work with cloud-based tools (AWS, Azure, GCP) and big data technologies (Hadoop, Spark) for data storage and processing.</li><li>Optimize performance and cost-effectiveness of cloud-based data solutions.</li><li><b>Collaboration:</b></li><li>Partner with software engineers, data analysts, and business teams to identify and fulfill data requirements.</li><li>Provide support for ad-hoc data requests and troubleshoot data issues.</li></ul><p><b>Key Skills and Qualifications:</b></p><ul><li><b>Technical Skills:</b></li><li>Proficiency in programming languages such as Python, Java, or Scala.</li><li>Strong knowledge of SQL and database systems (e.g., PostgreSQL, MySQL, MongoDB).</li><li>Hands-on experience with ETL tools (e.g., Apache NiFi, Talend, Informatica).</li><li>Familiarity with big data technologies like Hadoop, Spark, and Kafka.</li><li>Experience with cloud platforms (AWS, GCP, Azure) and related services (e.g., S3, Redshift, BigQuery).</li><li><b>Analytical Skills:</b></li><li>Solid understanding of data modeling and database design principles.</li><li>Ability to analyze and interpret large data sets to solve business problems.</li><li><b>Other Skills:</b></li><li>Strong problem-solving and debugging skills.</li><li>Excellent communication and teamwork abilities.</li><li>A keen eye for detail and commitment to delivering high-quality work.</li></ul><p>Job Types: Full-time, Permanent, Fresher</p><p>Pay: &#8377;25,000.00 - &#8377;50,000.00 per month</p><p>Benefits:</p><ul><li>Cell phone reimbursement</li><li>Paid sick time</li><li>Provident Fund</li></ul><p>Experience:</p><ul><li>total work: 1 year (Preferred)</li></ul><p>Work Location: In person</p>

Data Engineer

Search 10000+ Cloud data engineer jobs near you this December. New roles added regularly across leading industries. Apply today.

10000 cloud data engineer jobs NEAR_ME

Cloud Data Engineer

Senior Cloud Data Engineer

Cloud Data Engineer

Sr Cloud Data Engineer

Data Engineer - Ahmedabad, India

GCP Data Engineer

Data Engineer