data scientist Jobs in Bangalore Jobs In Test Jobs In Mangaluru

data scientist

data analyst Jobs in Bangalore Jobs In Test Jobs In Mangaluru

data analyst

design engineer Jobs in Bangalore Jobs In Test Jobs In Mangaluru

design engineer

senior data engineer Jobs in Bangalore Jobs In Test Jobs In Mangaluru

senior data engineer

senior data scientist Jobs in Bangalore Jobs In Test Jobs In Mangaluru

senior data scientist

data engineer

Infosys

<div><h2 class="jobSectionHeader"><b>Job Description:</b></h2><br>
<ul>
<li>We are seeking an experienced Data Engineer with strong expertise in Azure Data Services Big Data technologies and ETL ELT processes</li>
<li>The ideal candidate will have domain knowledge in CPG and Manufacturing sectors along with hands on experience in data governance data modeling and cloud based data engineering</li>
<li>This role involves building scalable data pipelines integrating industrial data platforms and enabling advanced analytics for smarter decision making</li></ul><br>
<h2 class="jobSectionHeader"><b>
Key Responsibilities:</b></h2><br>
<ul>
<li>Design and develop data pipelines using Azure Data Factory Azure Databricks and Azure Data Lake Gen2</li>
<li>Implement ETL ELT processes data integration techniques and data governance standards</li>
<li>Work with Big Data technologies such as Apache Spark and PySpark for large scale data processing</li>
<li>Gather engineer and prepare data for analytics and business insights</li>
<li>Integrate systems and data across diverse environments ensuring seamless connectivity</li>
<li>Build solutions to extract and consolidate data from multiple sources sales inventory product customer databases</li>
<li>Collaborate with ML Engineers Data Scientists and business stakeholders to enable automation and advanced analytics</li>
<li>Contribute to coding standards and best practices for data engineering workloads</li>
<li>Support modernization initiatives aligned with Industry 4</li>
<li>0 and ISA 95 standards</li></ul><br>
<h2 class="jobSectionHeader"><b>
Technical Requirements:</b></h2><br>
<ul>
<li>5 7 years of experience in data engineering and data governance within industrial domains CPG Manufacturing</li>
<li>Strong knowledge of Azure Data Services Azure Data Factory Azure Databricks Azure Data Lake Gen2</li>
<li>Expertise in ETL processes data integration tools and pipeline development</li>
<li>Proficiency in Python SQL and Apache Spark</li>
<li>Understanding of Industry 4</li>
<li>0 ISA 95 standards and maintenance strategies</li>
<li>Familiarity with AI ML concepts and ability to work with advanced analytics teams</li>
<li>Experience with DevOps CI CD for data pipeline automation</li></ul><br>
<h2 class="jobSectionHeader"><b>
Additional Responsibilities:</b></h2><br>
<ul>
<li>Good to have</li>
<li>Exposure to data modeling data warehousing and cloud architecture</li>
<li>Knowledge of business intelligence tools and statistical programming</li>
<li>Ability to research and implement new tools for automation and optimization</li></ul><br>
<h2 class="jobSectionHeader"><b>
Preferred Skills:</b></h2>
Technology-&gt;Data Engineering-&gt;Databricks,Technology-&gt;Cloud Integration-&gt;Azure Data Factory (ADF),Technology-&gt;Cloud Platform-&gt;Azure Analytics Services-&gt;Azure Data Lake,Technology-&gt;Consulting - Data Governance-&gt;Data Governance,Technology-&gt;Database-&gt;Data Modeling,Technology-&gt;OpenSystem-&gt;Python - OpenSystem</div>

Data Engineer

Yugn

<p>About the role:</p><p>We are seeking a talented Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Google Cloud Platform (GCP), BigQuery, Python, and SQL, and will be responsible for designing and maintaining scalable data solutions that power business insights.</p><p>Responsibility:</p><p>Design, develop, and maintain robust data pipelines and ETL workflows.</p><p>Manage large-scale datasets using GCP and BigQuery for optimal performance.</p><p>Write clean, efficient Python and SQL code for data processing and transformation.</p><p>Collaborate with data analysts, scientists, and business teams to ensure data quality and availability.</p><p>Optimize workflows for scalability, cost-efficiency, and performance.</p><p>Skills/Qualifications:</p><p>3&ndash;4 years of professional experience as a Data Engineer.</p><p>Hands-on expertise in GCP, BigQuery, Python, and SQL.</p><p>Strong understanding of data warehousing concepts, ETL processes, and cloud architecture.</p><p>Proficiency in data modeling, performance tuning, and query optimization.</p><p>Familiarity with CI/CD pipelines, version control (Git), and workflow orchestration tools (e.g., Airflow).</p><p>Excellent problem-solving skills, attention to detail, and ability to work in cross-functional teams.</p><p>Strong communication and collaboration skills.</p><p>Nice-to-Have:</p><p>Experience with Apache Spark for distributed data processing.</p><p>Knowledge of Kubernetes for container orchestration and deployment.</p><p>Exposure to Machine Learning pipelines and integration with data workflo</p><p>Job Types: Full-time, Permanent</p><p>Pay: ₹1,200,000.00 - ₹2,500,000.00 per year</p><p>Benefits:</p><ul><li>Health insurance</li><li>Provident Fund</li></ul><p>Work Location: In person</p>

Fusemachines

<div><p><b>About Fusemachines</b></p><p>
Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 450 full-time employees). Fusemachines seeks to bring its global expertise in AI to transform companies around the world.<br>
<br>
<b>Type: Full-time, Remote</b></p><p><b>
About the role</b></p><p>
This is a remote full-time position responsible for designing, building, testing, optimizing and maintaining the infrastructure and code required for data integration, storage, processing, pipelines and analytics (BI, visualization and Advanced Analytics) from ingestion to consumption, implementing data flow controls, and ensuring high data quality and accessibility for analytics and business intelligence purposes. This role requires a strong foundation in programming, and a keen understanding of how to integrate and manage data effectively across various storage systems and technologies.</p><p>
We are looking for a skilled Data Engineer with a strong background in <b>Python</b>, <b>SQL</b>, <b>Pyspark</b> and <b>AWS</b> cloud-based large scale data solutions with a passion for data quality, performance and cost optimization. The ideal candidate will develop in an Agile environment.</p><p>
This role is perfect for an individual passionate about leveraging data to drive insights, improve decision-making, and support the strategic goals of the organization through innovative data engineering solutions.</p><p><b>
Qualification &amp; Experience</b></p><ul><li>
Must have a full-time Bachelor's degree in Computer Science Information Systems, Engineering, or a related field.</li><li>
At least 2 years of experience as a data engineer with strong expertise in Python, SQL, PySpark and AWS in an Agile environment, with a proven track record of building and optimizing data pipelines, architectures, and datasets, and proven experience in data storage, modeling, management, lake, warehousing, processing/transformation, integration, cleansing, validation and analytics.</li><li>
2+ years of experience with DevOps tools and technologies: GitHub or AWS DevOps.</li><li>
Proven experience delivering large scale projects and products for Data and Analytics, as a data engineer within AWS.</li><li>
Preferred previous experience working with retail or other similar data models.</li><li>
Following certifications:<ul><li>
AWS Certified Cloud Practitioner</li><li>
AWS Certified Data Engineer - Associate</li><li>
Nice to have:<ul><li>
Databricks Certified Associate Developer for Apache Spark</li><li>
Databricks Certified Data Engineer Associate</li></ul></li></ul></li></ul><p><b>
Required skills/Competencies</b></p><ul><li>
Strong programming Skills in one or more object-oriented languages such as <b>Python</b> (must have), Scala, Java, and proficiency in writing high-quality, scalable, maintainable, efficient and optimized code for data integration, storage, processing, manipulation and analytics solutions.</li><li>
Strong <b>SQL</b> skills and experience working with complex data sets, Enterprise Data Warehouse and writing advanced SQL queries. Proficient with Relational Databases (RDS, MySQL, Postgres, or similar) and NonSQL Databases (Cassandra, MongoDB, Neo4j, etc.).</li><li>
Strong analytic skills related to working with structured and unstructured datasets.</li><li>
Thorough understanding of big data principles, techniques, and best practices.</li><li>
Experience with scalable and distributed Data Processing Technologies such as Spark/<b>PySpark</b> (must have including <b>Spark SQL</b>) and <b>Kafka</b>, to be able to handle large volumes of data.</li><li>
Experience with stream-processing systems: Storm, Spark-Streaming, etc. is a plus.</li><li>
Experience in implementing data pipelines and efficient <b>ELT/ETL</b> processes, batch and real-time, in AWS and using open source solutions, being able to develop custom integration solutions as needed, including Data Integration from different sources such as APIs (PoS integrations is a plus), ERP (Oracle and Allegra are a plus), databases, flat files, Apache Parquet, event streaming, including cleansing, transformation and validation of the data.</li><li>
Experience in data cleansing, transformation, and validation.</li><li>
Understanding of <b>Data Modeling</b> and Database Design Principles. Being able to implement efficient database schemas that meet the requirements to support data solutions. With good understanding of dimensional data modeling</li><li>
Knowledge in cloud computing specifically in AWS services related to data and analytics, such as <b>S3</b>, <b>EMR</b>, <b>Glue</b>, SageMaker, <b>RDS</b>, <b>Redshift</b>, <b>Lambda</b>, Kinesis, Lake Formation, EC2, ECS/ECR, EKS, IAM, CloudWatch, etc. implementing Data Warehousing, data lake and data lake house, solutions in AWS.</li><li>
Experience in Orchestration using technologies like Azkaban, Luigi, Airflow, etc..</li><li>
Good understanding of BI solutions including <b>Looker</b> and <b>LookML</b> (Looker Modeling Language)</li><li>
Familiar with advanced analytics, AI/ML services and tools, and the ability to integrate advanced analytics, machine learning, and AI capabilities into data solutions, nice to have.</li><li>
Strong understanding of the software development lifecycle (SDLC), especially <b>Agile methodologies</b>.</li><li>
Knowledge of SDLC tools and technologies, including project management software (Jira or similar), source code management (GitHub, AWS CodeCommit or similar), CI/CD system (GitHub actions, Jenkins, AWS CodePipeline or similar) and binary repository manager (Sonatype Nexus, AWS CodeArtifact or similar).</li><li>
Knowledge and hands-on experience of DevOps principles, tools and technologies (<b>GitHub</b> and <b>AWS DevOps</b>) including continuous integration, continuous delivery (CI/CD), infrastructure as code (IaC &ndash; Terraform), configuration management, automated testing, performance tuning and cost management and optimization.</li><li>
Knowledge of data structures and algorithms and good software engineering practices.</li><li>
Strong analytical skills to identify and address technical issues, performance bottlenecks, and system failures.</li><li>
Proficiency in debugging and troubleshooting issues in complex data and analytics environments and pipelines.</li><li>
Understanding of <b>Data Quality</b> and Governance, including implementation of data quality and integrity checks and monitoring processes to ensure that data is accurate, complete, and consistent.</li><li>
Good Problem-Solving skills: being able to troubleshoot data processing pipelines and identify performance bottlenecks and other issues.</li><li>
Strong interpersonal skills and ability to work with a wide range of stakeholders.</li><li>
Excellent <b>communication</b> skills to collaborate with cross-functional teams, including business users, data architects, DevOps/DataOps/MLOps engineers, data analyst, data scientists, developers, and operations teams. Essential to convey complex technical concepts and insights to non-technical stakeholders effectively.</li><li>
Ability to document processes, procedures, and deployment configurations.</li><li>
Understanding of security practices, including network security groups, encryption, and compliance standards, and ability to implement security controls and best practices within data and analytics solutions, including proficient knowledge and working experience on various cloud security vulnerabilities and ways to mitigate them.</li><li>
Self-motivated with the ability to work well in a team.</li><li>
Strong project management and organizational skills.</li><li>
A willingness to stay updated with the latest services, Data Engineering trends, and best practices in the field.</li><li>
Comfortable with picking up new technologies independently and working in a rapidly changing environment with ambiguous requirements.</li><li>
Care about architecture, observability, testing, and building reliable infrastructure and data pipelines.</li></ul><p><b>
Responsibilities:</b></p><ul><li>
Design, implement, deploy, test and maintain highly scalable and efficient data architectures, defining and maintaining standards and best practices for data management independently with minimal guidance.</li><li>
Ensure systems meet business requirements and industry practices for data integrity, performance, and reliability.</li><li>
Integrate new data management technologies and software engineering tools into existing structures.</li><li>
Create custom software components and analytics applications.</li><li>
Employ a variety of languages and tools to marry systems together or try to hunt down opportunities to improve current processes.</li><li>
Evaluate and advise on technical aspects of open work requests in the data pipeline with the project team.</li><li>
Handle ELT/ETL processes, including data extraction, loading and transformation, from different sources ensuring consistency and quality.</li><li>
Transform and clean data for further analysis and storage.</li><li>
Design and optimize data models and schemas to support business requirements and analysis.</li><li>
Implement monitoring tools and systems to ensure the availability and performance of data systems.</li><li>
Manage data security and access, ensuring confidentiality and integrity.</li><li>
Automate repetitive tasks and processes to improve operational efficiency.</li><li>
Collaborate with data science teams to establish pipelines and workflows for training, validation, deployment, and monitoring of machine learning models. Automate deployment and management of machine learning models in production environments.</li><li>
Contribute to data quality assurance efforts, such as implementing data validation checks and tests to ensure reliability, efficiency, accuracy, completeness and consistency of data.</li><li>
Test software solutions and meet product quality standards prior to release to QA.</li><li>
Ensure the reliability, scalability, and efficiency of data systems are maintained at all times. Identifying and resolving performance bottlenecks in pipelines due to data, queries and processing workflows to ensure efficient and timely data delivery.</li><li>
Work with DevOps teams to optimize resources.</li><li>
Assist in the configuration and management of data warehousing and data lake solutions.</li><li>
Collaborate closely with cross-functional teams including Product, Engineering, Data Scientists, and Analysts to thoroughly understand data requirements and provide data engineering support and extend the company&rsquo;s data with third-party sources of information when needed.</li><li>
Takes ownership of storage layer, database management tasks, including schema design, indexing, and performance tuning.</li><li>
Evaluate and implement cutting-edge technologies and methodologies and continue learning and expanding skills in data engineering and cloud platforms, to improve and modernize existing data systems.</li><li>
Develop, design, and execute data governance strategies encompassing cataloging, lineage tracking, quality control, and data governance frameworks that align with current analytics demands and industry best practices working closely with Data Architect.</li><li>
Ensure technology solutions support the needs of the customer and/or organization.</li><li>
Define and document data engineering architectures, processes and data flows.</li></ul><p><b><i>
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.</i></b></p><p>
</p><p>XudWe5nO8A</p></div>

Amgen

<div>
 <strong>
  Role Name:
 </strong>
 Data Engineer
 <br/>
 <br/>
 <strong>
  Department Name:
 </strong>
 XXX
 <br/>
 <br/>
 <strong>
  Role GCF:
 </strong>
 4
 <br/>
 <br/>
 <strong>
  Hiring Manager Name: Chunhai He
  <br/>
  <br/>
 </strong>
 <strong>
  About Amgen
  <br/>
  <br/>
 </strong>
 Amgen harnesses the best of biology and technology to fight the world&rsquo;s toughest diseases, and make people&rsquo;s lives easier, fuller and longer. We discover, develop, manufacture and deliver innovative medicines to help millions of patients. Amgen helped establish the biotechnology industry more than 40 years ago and remains on the cutting-edge of innovation, using technology and human genetic data to push beyond what&rsquo;s known today.
 <br/>
 <br/>
 <strong>
  About The Role
  <br/>
  <br/>
 </strong>
 Role Description:
 <br/>
 <br/>
 We seek a skilled Data Engineer to build and optimize our data infrastructure. As a key contributor, you will collaborate closely with cross-functional teams to design and implement robust data pipelines that efficiently extract, transform, and load data into our AWS-based data lake and data warehouse. Your expertise will be instrumental in empowering data-driven decision making through advanced analytics and predictive modeling.
 <br/>
 <br/>
 Roles &amp; Responsibilities:
 <br/>
 <br/>
 <ul>
  <li>
   Building and optimizing data pipelines, data warehouses, and data lakes on the AWS and Databricks platforms.
  </li>
  <li>
   Managing and maintaining the AWS and Databricks environments.
  </li>
  <li>
   Ensuring data integrity, accuracy, and consistency through rigorous quality checks and monitoring.
  </li>
  <li>
   Maintain system uptime and optimal performance
  </li>
  <li>
   Working closely with cross-functional teams to understand business requirements and translate them into technical solutions.
  </li>
  <li>
   Exploring and implementing new tools and technologies to enhance ETL platform performance.
   <br/>
   <br/>
  </li>
 </ul>
 Functional Skills:
 <br/>
 <br/>
 <strong>
  Must-Have Skills:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Proficient in SQL for extracting, transforming, and analyzing complex datasets from both relational and columnar data stores. Proven ability to optimize query performance on big data platforms.
  </li>
  <li>
   Proficient in leveraging Python, PySpark, and Airflow to build scalable and efficient data ingestion, transformation, and loading processes.
  </li>
  <li>
   Ability to learn new technologies quickly. Strong problem-solving and analytical skills. Excellent communication and teamwork skills.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Good-to-Have Skills:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Experienced with SQL/NOSQL database, vector database for large language models
  </li>
  <li>
   Experienced with data modeling and performance tuning for both OLAP and OLTP databases
  </li>
  <li>
   Experienced with Apache Spark, Apache Airflow
  </li>
  <li>
   Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops
  </li>
  <li>
   Experienced with AWS, GCP or Azure cloud services
   <br/>
   <br/>
  </li>
 </ul>
 Education and Professional Certifications
 <br/>
 <br/>
 <ul>
  <li>
   Bachelor&rsquo;s degree in computer science and engineering preferred, other Engineering field is considered
  </li>
  <li>
   AWS Certified Data Engineer preferred
  </li>
  <li>
   Databricks Certificate preferred
   <br/>
   <br/>
  </li>
 </ul>
 Soft Skills:
 <br/>
 <br/>
 <ul>
  <li>
   Excellent analytical and troubleshooting skills.
  </li>
  <li>
   Strong verbal and written communication skills
  </li>
  <li>
   Ability to work effectively with global, virtual teams
  </li>
  <li>
   High degree of initiative and self-motivation.
  </li>
  <li>
   Ability to manage multiple priorities successfully.
  </li>
  <li>
   Team-oriented, with a focus on achieving team goals
  </li>
  <li>
   Strong presentation and public speaking skills.
   <br/>
   <br/>
  </li>
 </ul>
 EQUAL OPPORTUNITY STATEMENT
 <br/>
 <br/>
 Amgen is an Equal Opportunity employer and will consider you without regard to your race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, or disability status.
 <br/>
 <br/>
 We will ensure that individuals with disabilities are provided with reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
</div>


Accenture

<p><b>Project Role : </b>Data Engineer<br>
<b>Project Role Description : </b>Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
<br>
<b>Must have skills : </b>Google Cloud Platform Architecture<br>
<b>Good to have skills : </b>NA<br>
Minimum <b>3</b> year(s) of experience is required<br>
<b>Educational Qualification : </b>15 years full time education<br>
<br>
Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to effectively migrate and deploy data across various systems, contributing to the overall efficiency and reliability of data management within the organization. Roles &amp; Responsibilities: - Expected to perform independently and become an SME. - Required active participation/contribution in team discussions. - Contribute in providing solutions to work related problems. - Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications. - Monitor and optimize data pipelines for performance and reliability. Professional &amp; Technical Skills: - Must To Have Skills: Proficiency in Google Cloud Platform Architecture. - Strong understanding of data modeling and database design principles. - Experience with data integration tools and ETL processes. - Familiarity with data warehousing concepts and technologies. - Knowledge of programming languages such as Python or Java for data processing. Additional Information: - The candidate should have minimum 3 years of experience in Google Cloud Platform Architecture. - This position is based at our Hyderabad office. - A 15 years full time education is required.</p>
<br>
15 years full time education

TECHBLOCKS

<div><div><b>Role: Data Engineer
</b></div><div><b>Location: New York, NY</b></div><div></div><div><b><br>
Responsibilities</b></div><ul><li>Use the latest technology to build data pipelines and integrate machine learning models
</li><li>Build and expand our data platform
</li><li>Develop applications that run on a Google Cloud-based infrastructure.<br>
</li></ul><div></div><br>
<div><b>Qualifications
</b></div><ul><li>2+ years of experience in Big Data and Data Engineering, building enterprise-level applications in a public cloud, preferably Google Cloud
</li><li>Experience building cloud-native data pipelines using Python, Apache Airflow, Apache Spark, and Apache Beam.
</li><li>Working knowledge of SQL and data warehousing concepts, including PostgreSQL and BigQuery.
</li></ul><div>Optionally, knowledge of Mongo and AlloyDB is a plus.
</div><ul><li>Comfortable using Azure DevOps or similar CI/CD tools, Git.
</li><li>Experience with TDD, agile software development processes, and collaborating in multi-functional agile teams.
</li><li>Communicate effectively with technical teams and non-technical stakeholders.
</li><li>Bachelor's degree in Computer Science or related engineering discipline, or equivalent combination of education and experience.
</li></ul><div>Optionally, experience building Docker images and deploying them to a Production environment. Integrate Docker container orchestration framework using Kubernetes by creating pods, config Maps, and deployments using Terraform.
</div><ul><li>Optionally, experience with C#, .NET core, and microservices</li></ul></div>

Capgemini

<div><div><div><p>Bangalore</p><div>
Data Engineer</div><p>
</p></div></div><div></div><div><div><div><div><div><p>
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world&rsquo;s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&amp;D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.</p><div><div><div><div><b>
Your Role</b></div></div><div><ul><li>
5+ yrs of total IT experience and 4+ yrs of relevant experience as Azure Data Engineer and having good hands-on experience on Azure Data Factory, Azure Databricks, Python, Azure Synapse, Azure Data Lake, PySpark, SQL Server and Power BI.</li><li>
Knowledge in design of Extract, Transform and Load environment using Data bricks, Spark Azure Data Factory (ADF).</li><li>
Setting Up Microsoft Azure with Data bricks, Data bricks Workspace for Business Analytics, Manage Clusters in Data bricks.</li><li>
Hands on experience Data extraction (extract, Schemas, corrupt record handling and parallelized code), transformations and loads (user defined functions, join optimizations) and Production (optimize and automate Extract, Transform and Load).</li><li>
Copy of data from on-premises data (SQL Server) to Azure Data Lake Store (ADLS) using Azure Data Factory (ADF V2).</li><li>
Data migrated using Azure Data Factory and created new pipelines, data flows.</li><li>
Hands on experience on Migrating SQL database to Azure Data Lake, Azure datalake Analytics, Azure SQL Database, Data Bricks and Azure SQL Data warehouse and controlling and granting database access.</li><li>
Experience in working with Data bricks notebooks for developing and executing transformation logic and data processing tasks. Extensive experience in designing ETL pipelines using Data bricks, Apache Spark, and Azure Data Factory (ADF).</li></ul>
Works in the area of Software Engineering, which encompasses the development, maintenance and optimization of software solutions/applications.1. Applies scientific methods to analyse and solve software engineering problems.2. He/she is responsible for the development and application of software engineering practice and knowledge, in research, design, development and maintenance.3. His/her work requires the exercise of original thought and judgement and the ability to supervise the technical and administrative work of other software engineers.4. The software engineer builds skills and expertise of his/her software engineering discipline to reach standard software engineer skills expectations for the applicable role, as defined in Professional Communities.5. The software engineer collaborates and acts as team player with other software engineers and stakeholders.</div></div><div><div><div><b>
Your Profile</b></div></div><div><ul><li>
Proficient in data extraction, schema management, and handling corrupt records with parallelized processing.</li><li>
Expertise in transformations and data loads, including optimization of joins and implementing user-defined functions (UDFs).</li><li>
Created Data bricks notebooks for data transformation, using various transformation processes such as join, merge, lookup, filter, remove duplicates, and aggregation.</li><li>
Designed ADF pipelines to execute Databricks notebooks and carry out complex transformations.</li><li>
Carryout transformations and creating notebooks using various transformation processes like Join, Merge, Lookup, remove Duplicates, Filter and Aggregator.</li><li>
Utilized spark transformations in Databricks for data cleaning, filter in and transformation tasks.</li><li>
Experience in troubleshooting SQL issues by using SQL Tools, execution plans, Trace, statistics, index tuning wizard.</li></ul></div></div><div><div><div><b>
What will you love working at Capgemini
</b></div></div><div><ul><li>You will have the opportunity to learn on one of the industry's largest digital learning platforms, with access to 250,000+ courses and numerous certifications.</li><li>
We&rsquo;re committed to ensure that people of all backgrounds feel encouraged and have a sense of belonging at Capgemini. You are valued for who you are, and you can bring your original self to work.</li><li>
At Capgemini, you can work on cutting-edge projects in tech and engineering with industry leaders or create solutions to overcome societal and environmental challenges.
</li><li>Capgemini office campuses in India are green and run on 100% renewable electricity. We have installed Solar plants across India locations and &lsquo;Battery Energy Storage Solution&rsquo; (BESS) in the Noida and Mumbai campuses. You will have chance to make a difference everyday.</li></ul></div></div></div><p>
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.</p></div></div><div><div><div>
<div><div>Ref. code</div><div>
332598-en_GB</div></div><div><div>
Posted on</div><div>
08 Dec 2025</div></div><div><div>
Experience level</div><div>
Experienced Professionals</div></div><div><div>
Contract type</div><div>
Permanent</div></div><div><div>
Location</div><div>
Bangalore</div></div><div><div>
Business unit</div><div>
Engineering and RandD Services</div></div><div><div>
Brand</div><div>
Capgemini Engineering</div></div><div><div>
Professional communities</div><div>
Software Engineering</div></div></div></div></div></div></div></div></div><p></p>

Explore 9376+ Data engineer in Bangalore Jobs In Test Jobs In Mangaluru this December. Find roles across top companies and apply now to boost your career.

9376 data engineer jobs IN Bangalore Jobs In Test Jobs In Mangaluru

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer