data scientist Jobs in Bangalore Jobs In Test Jobs In Mangaluru

data scientist

software engineer Jobs in Bangalore Jobs In Test Jobs In Mangaluru

software engineer

senior data scientist Jobs in Bangalore Jobs In Test Jobs In Mangaluru

senior data scientist

senior data engineer Jobs in Bangalore Jobs In Test Jobs In Mangaluru

senior data engineer

data analyst Jobs in Bangalore Jobs In Test Jobs In Mangaluru

data analyst

data engineer

CAI (Computer Aid, Inc.)

<b>Req number:</b> R6646
<br><br>
<b>Employment type:</b> Full time
<br><br>
<b>Worksite flexibility:</b> Remote Who we are
<br>CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.
<br><br>
Job Summary We are seeking a motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in building cloud-based data lake and analytics architectures using AWS and Databricks and is proficient in Python programming for data processing and automation. This is a Full-time and Remote position.
<br><br>
Job Description
<br>We are looking for a Data Engineer that has experience in building data products using Databricks and related technologies. This position will be Full-time and Remote position.
<br>What You’ll Do
<br><br>
Design, develop, and maintain data lakes and data pipelines on AWS using ETL frameworks and Databricks
<br><br>
Integrate and transform large-scale data from multiple heterogeneous sources into a centralized data lake environment
<br><br>
Implement and manage Delta Lake architecture using Databricks Delta or Apache Hudi
<br><br>
Develop end-to-end data workflows using PySpark, Databricks Notebooks, and Python scripts for ingestion, transformation, and enrichment
<br><br>
Design and develop data warehouses and data marts for analytical workloads using Snowflake, Redshift, or similar systems
<br><br>
Design and evaluate data models (Star, Snowflake, Flattened) for analytical and transactional systems
<br><br>
Optimize data storage, query performance, and cost across the AWS and Databricks ecosystem
<br><br>
Build and maintain CI/CD pipelines for Databricks notebooks, jobs, and Python-based data processing scripts
<br><br>
Collaborate with data scientists, analysts, and stakeholders to deliver high-performance, reusable data assets
<br><br>
Maintain and manage code repositories (Git) and promote best practices in version control, testing, and deployment
<br><br>
Participate in making major technical and architectural decisions for data engineering initiatives
<br><br>
Monitor and troubleshoot Databricks clusters, Spark jobs, and ETL processes for performance and reliability
<br><br>
Coordinate with business and technical teams through all phases of the software development life cycle
<br>What You'll Need
<br>Required
<br><br>
5+ years of experience building and managing Data Lake Architecture on AWS Cloud
<br><br>
3+ years of experience with AWS Data services such as S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS, and Redshift
<br><br>
3+ years of experience building Data Warehouses on Snowflake, Redshift, HANA, Teradata, or Exasol
<br><br>
3+ years of hands-on experience working with Apache Spark or PySpark, on Databricks
<br><br>
3+ years of experience implementing Delta Lakes using Databricks Delta or Apache Hudi
<br><br>
3+ years of experience in ETL development using Databricks, AWS Glue, or other modern frameworks
<br><br>
Proficiency in Python for data engineering, automation, and API integrations.
<br><br>
Experience in Databricks Jobs, Workflows, and Cluster Management
<br><br>
Experience with CI/CD pipelines and Infrastructure as Code (IaC) tools like Terraform or CloudFormation is a plus
<br><br>
Bachelor’s degree in computer science, Information Technology, Data Science, or related field
<br>Physical Demands
<br><br>
This role involves mostly sedentary work, with occasional movement around the office to attend meetings, etc.
<br><br>
Ability to perform repetitive tasks on a computer, using a mouse, keyboard, and monitor
<br><br>
Reasonable accommodation statement
<br>If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.

Data Engineer

Virtusa

<div><p><b>Data Engineer</b><br>
Migrating SSIS packages to AWS Glue would focus on a data engineer or architect with experience in ETL processes and cloud computing. The role would involve automating the migration of SSIS packages to AWS Glue using tools like AWS Schema Conversion Tool (AWS SCT) and potentially developing custom connectors.<br>
Create, build, and maintain data processing systems and pipelines on AWS, using services like Glue, EMR, Lambda, and S3<br>
Construct and manage data warehouses and data lakes using AWS services such as Redshift, Lake Formation, and Glue.<br>
Develop and maintain Extract, Transform, and Load (ETL) processes using AWS Glue and Lambda.<br>
Implement data governance and security policies, and ensure data is clean, reliable, and optimized for analysis.<br>
Work with cross-functional teams, including data scientists and business analysts, to understand data requirements and build solutions.<br>
Skill<br>
S3<br>
Glue streaming<br>
EMR<br>
Spark<br>
ETL Concepts</p><div><p><b>
About Virtusa</b></p>
<p>Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth &mdash; one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.</p>
<p>Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.</p>
<p>Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.</p></div></div><p></p>

Capco

<div>
 <strong>
  Job Title: Sr. Data Engineer
  <br/>
  <br/>
 </strong>
 <strong>
  About Us
  <br/>
  <br/>
 </strong>
 &ldquo;Capco, a Wipro company, is a global technology and management consulting firm. Awarded with
 <strong>
  Consultancy of the year in the British Bank Award
 </strong>
 and has been ranked
 <strong>
  Top 100 Best Companies for Women in India 2022 by
 </strong>
 <strong>
  Avtar &amp; Seramount
 </strong>
 . With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery.
 <br/>
 <br/>
 <strong>
  WHY JOIN CAPCO?
  <br/>
  <br/>
 </strong>
 You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.
 <br/>
 <br/>
 <strong>
  MAKE AN IMPACT
  <br/>
  <br/>
 </strong>
 Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.
 <br/>
 <br/>
 <strong>
  #BEYOURSELFATWORK
  <br/>
  <br/>
 </strong>
 Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.
 <br/>
 <br/>
 <strong>
  CAREER ADVANCEMENT
  <br/>
  <br/>
 </strong>
 With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.
 <br/>
 <br/>
 <strong>
  DIVERSITY &amp; INCLUSION
  <br/>
  <br/>
 </strong>
 We believe that diversity of people and perspective gives us a competitive advantage.
 <br/>
 <br/>
 <strong>
  MAKE AN IMPACT
  <br/>
  <br/>
 </strong>
 <strong>
  Job Summary
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Position: Sr Consultant
  </li>
  <li>
   Location: Capco Locations (Bengaluru/ Chennai/ Hyderabad/ Pune/ Mumbai/ Gurugram)
  </li>
  <li>
   Band: M3/M4 (8 to 14 years)
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Role Description
  <br/>
  <br/>
 </strong>
 <strong>
  Job Title: Senior Consultant - Data Engineer
  <br/>
  <br/>
 </strong>
 <strong>
  Responsibilities
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Design, build and optimise data pipelines and ETL processes in Azure Databricks ensuring high performance, reliability, and scalability.
  </li>
  <li>
   Implement best practices for data ingestion, transformation, and cleansing to ensure data quality and integrity.
  </li>
  <li>
   Work within clients best practice guidelines as set out by the Data Engineering Lead
  </li>
  <li>
   Work with data modellers and testers to ensure pipelines are implemented correctly.
  </li>
  <li>
   Collaborate as part of a cross-functional team to understand business requirements and translate them into technical solutions.
   <br/>
   <br/>
  </li>
 </ul>
 Role Requirements
 <br/>
 <br/>
 <ul>
  <li>
   Strong Data Engineer with experience in Financial Services
  </li>
  <li>
   Knowledge of and experience building data pipelines in Azure Databricks
  </li>
  <li>
   Demonstrate a continual desire to implement &ldquo;strategic&rdquo; or &ldquo;optimal&rdquo; solutions and where possible, avoid workarounds or short term tactical solutions
  </li>
  <li>
   Work within an Agile team
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Experience/Skillset
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   8+ years experience in data engineering
  </li>
  <li>
   Good skills in SQL, Python and PySpark
  </li>
  <li>
   Good knowledge of Azure Databricks (understanding of delta tables, Apache Spark, Unity Catalog)
  </li>
  <li>
   Experience writing, optimizing, and analyzing SQL and PySpark code, with a robust capability to interpret complex data requirements and architect solutions
  </li>
  <li>
   Good knowledge of SDLC
  </li>
  <li>
   Familiar with Agile/Scrum ways of working
  </li>
  <li>
   Strong verbal and written communication skills
  </li>
  <li>
   Ability to manage multiple priorities and deliver to tight deadlines
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  WHY JOIN CAPCO?
  <br/>
  <br/>
 </strong>
 You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry. We offer:
 <br/>
 <br/>
 <ul>
  <li>
   A work culture focused on innovation and creating lasting value for our clients and employees
  </li>
  <li>
   Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
  </li>
  <li>
   A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
  </li>
  <li>
   A diverse, inclusive, meritocratic culture
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  We Offer
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   A work culture focused on innovation and creating lasting value for our clients and employees
  </li>
  <li>
   Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
  </li>
  <li>
   A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
   <br/>
   <br/>
  </li>
 </ul>
</div>


Arting Digital Private Limited

<div><div>Position: Data Engineer - 1<br>
</div><div>
Experience: 3 - 5 Years<br>
</div><div>
Location: Udaipur, Rajasthan<br>
</div><div>
Work Mode: On-site (5 Days a Week)</div><p></p><p><br>
About the Role</p><div><br>
We are looking for an experienced Data Engineer Lead to design, build, and optimize scalable data platforms and pipelines. In this leadership role, you will take full ownership of data engineering initiatives, ensure high-quality data delivery, and work closely with cross-functional teams to drive data strategy and innovation across the organization.</div><div><br>
You will lead end-to-end data engineering efforts&mdash;from ingestion and transformation to orchestration and infrastructure&mdash;ensuring reliability, performance, and scalability of the data ecosystem.</div><p></p><p><br>
Key Responsibilities</p><ul><li><div><br>
Lead the design, development, and maintenance of scalable, secure, and automated data pipelines (batch and streaming).</div></li><li><div><br>
Build, optimize, and manage data lakes / data warehouses on platforms such as Redshift, Snowflake, BigQuery, or Delta Lake.</div></li><li><div><br>
Develop and deploy data workflows using Airflow, DBT, Spark, Kafka, and other modern data engineering tools.</div></li><li><div><br>
Implement and optimize ETL/ELT processes, ensuring data quality, governance, lineage, and observability.</div></li><li><div><br>
Work closely with analytics, product, and engineering teams to define data strategy, architecture, and KPIs.</div></li><li><div><br>
Lead and mentor junior and mid-level data engineers, ensuring adherence to best practices and coding standards.</div></li><li><div><br>
Build and maintain CI/CD pipelines for data engineering processes using tools like GitHub Actions, Jenkins, or similar.</div></li><li><div><br>
Deploy and manage container environments using Docker and Kubernetes.</div></li><li><div><br>
Ensure performance optimization of queries, storage, pipelines, and cloud infrastructure.</div></li><li><div><br>
Drive innovation by evaluating new tools, technologies, and architectural improvements.</div></li></ul><p></p><p><br>
Required Skills &amp; Qualifications<br>
</p><h3 class="jobSectionHeader">
Core Technical Skills</h3><ul><li><div><br>
Strong expertise in data processing &amp; workflow automation.</div></li><li><div><br>
Expert-level proficiency in Python and SQL.</div></li><li><div><br>
Hands-on experience with Cloud Platforms (AWS / GCP / Azure) for data engineering services.</div></li><li><div><br>
Proven experience building and managing pipelines using Airflow, DBT, Spark, Kafka, etc.</div></li><li><div><br>
Strong understanding of modern data warehousing technologies:</div><ul><li><div><br>
Redshift</div></li><li><div><br>
Snowflake</div></li><li><div><br>
BigQuery</div></li><li><div><br>
Delta Lake</div></li></ul></li><li><div><br>
Experience with CI/CD tools (GitHub Actions, Jenkins, Bitbucket Pipelines, etc.).</div></li><li><div><br>
Strong working knowledge of Docker, Kubernetes, and containerized deployments.</div></li></ul><h3 class="jobSectionHeader"><br>
Preferred Skills</h3><ul><li><div><br>
Knowledge of data governance, lineage, metadata management, and observability frameworks.</div></li><li><div><br>
Experience with distributed systems and performance tuning.</div></li><li><div><br>
Familiarity with version control (Git), DevOps practices, and cloud cost optimization.</div></li></ul><p></p><p><br>
Soft Skills</p><ul><li><div><br>
Strong leadership and mentoring capabilities.</div></li><li><div><br>
Excellent communication and stakeholder management skills.</div></li><li><div><br>
Analytical mindset with a strong problem-solving approach.</div></li><li><div><br>
Ability to work in a fast-paced, data-driven environment.</div></li></ul></div><div></div>

Data Engineer - 1

NielsenIQ

<div><b>Job Description</b><br>
<ul><li>
Responsible to assemble large, complex sets of data that meet non-functional and functional business requirements.</li><li>
Responsible to identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.</li><li>
Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure, Databricks and SQL technologies</li><li>
Responsible for the transformation of conceptual algorithms from R&amp;D into efficient, production ready code. The data developer must have a strong mathematical background in order to be able to document and maintain the code</li><li>
Responsible for integrating finished models into larger data processes using UNIX scripting languages such as ksh, Python, Spark, Scala, etc.</li><li>
Produce and maintain documentation for released data sets, new programs, shared utilities, or static data. This must be done within department standards</li><li>
Ensure quality deliverables to clients by following existing quality processes, manually calculating comparison data, developing statistical pass/fail testing, and visually inspecting data for reasonableness: the requirement is on-time with zero defects</li></ul><br>
<b>
Qualifications</b><p><b><br>
Education/Training</b></p><ul><li>
B.E./B.Tech. with a major in Computer Science, BIS, CIS, Electrical Engineering, Operations Research or some other technical field.</li><li>
Course work or experience in Numerical Analysis, Mathematics or Statistics is a plus</li></ul><p><b>
Hard Skills</b></p><ul><li>
Proven experience working as a data engineer</li><li>
Highly proficient in using the <b>spark framework (python and/or Scala)</b></li><li>
Extensive knowledge of Data Warehousing concepts, strategies, methodologies.</li><li>
Programming experience in <b>Python, SQL, Scala</b></li><li>
Direct experience of building data pipelines using <b>Apache Spark (preferably in Databricks), Airflow.</b></li><li><b>
Hands on experience designing and delivering solutions using Azure including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake</b></li><li>
Experience with big data technologies (Hadoop)</li><li>
Databricks &amp; Azure Big Data Architecture Certification would be plus</li><li>
Must be team oriented with strong collaboration, prioritization, and adaptability skills required</li><li>
Ability to write highly efficient code in terms of performance / memory utilization</li><li>
Basic knowledge of SQL; capable of handling common functions</li></ul><p><b>
Experience</b></p><ul><li><b>
Minimum 3 - 6 years of experience as Data engineer</b></li><li>
Experience modeling or manipulating large amounts of data is a plus</li><li>
Experience with Demographic, Retail business is a plus</li></ul><br>
<b>
Additional Information</b><div></div><p><b><br>
Our Benefits</b></p><ul><li>
Flexible working environment</li><li>
Volunteer time off</li><li>
LinkedIn Learning</li><li>
Employee-Assistance-Program (EAP)</li></ul>
<p><b>
About NIQ</b></p><p>
NIQ is the world&rsquo;s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights&mdash;delivered with advanced analytics through state-of-the-art platforms&mdash;NIQ delivers the Full View&trade;. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world&rsquo;s population.</p><p>
For more information, visit NIQ.com</p><p>
Want to keep up with our latest updates?</p><p>
Follow us on: LinkedIn | Instagram | Twitter | Facebook</p>
<p><b>
Our commitment to Diversity, Equity, and Inclusion</b></p><p>
At NIQ, we are steadfast in our commitment to fostering an inclusive workplace that mirrors the rich diversity of the communities and markets we serve. We believe that embracing a wide range of perspectives drives innovation and excellence. All employment decisions at NIQ are made without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, marital status, veteran status, or any other characteristic protected by applicable laws. We invite individuals who share our dedication to inclusivity and equity to join us in making a meaningful impact. To learn more about our ongoing efforts in diversity and inclusion, please visit the https://nielseniq.com/global/en/news-center/diversity-inclusion</p></div>

Barclays

<div><p>Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences.</p><p></p><p>
To be successful as a Data Engineer you should have experience with:</p><ul><li><p>
Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL</p></li><li><p>
Hands on Experience in developing, testing and maintaining applications on AWS Cloud.</p></li><li><p>
Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena)</p></li><li><p>
Design and implement scalable and efficient data transformation/storage solutions using Snowflake.</p></li><li><p>
Experience in Data ingestion to Snowflake for different storage format such Parquet, Iceberg, JSON, CSV etc</p></li><li><p>
Experience in using DBT (Data Build Tool) with snowflake for ELT pipeline development.</p></li><li><p>
Experience in Writing advanced SQL and PL SQL programs.</p></li><li><p>
Hands On Experience for building reusable components using Snowflake and AWS Tools/Technology</p></li><li><p>
Should have worked at least on two major project implementations.</p></li><li><p>
Exposure to data governance or lineage tools such as Immuta and Alation is added advantage.</p></li><li><p>
Experience in using Orchestration tools such as Apache Airflow or Snowflake Tasks is added advantage.</p></li><li><p>
Knowledge on Abinitio ETL tool is a plus</p></li></ul><p></p><p>
Some other highly valued skills may include:</p><ul><li><p>
Ability to engage with Stakeholders, elicit requirements/ user stories and translate requirements into ETL components</p></li><li><p>
Ability to understand the infrastructure setup and be able to provide solutions either individually or working with teams.</p></li><li><p>
Good knowledge of Data Marts and Data Warehousing concepts.</p></li><li><p>
Resource should possess good analytical and Interpersonal skills.</p></li><li><p>
Implement Cloud based Enterprise data warehouse with multiple data platform along with Snowflake and NoSQL environment to build data movement strategy.</p></li></ul><p></p><p>
You may be assessed on key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen, strategic thinking and digital and technology, as well as job-specific technical skills.</p><p></p><p>
The role is based out of Pune.</p>
<p><b>
Purpose of the role</b></p><p>
To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.</p><p></p><p><b>
Accountabilities</b></p><ul><li>
Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.</li><li>
Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.</li><li>
Development of processing and analysis algorithms fit for the intended data complexity and volumes.</li><li>
Collaboration with data scientist to build and deploy machine learning models.</li></ul><p></p><p><b>
Analyst Expectations</b></p><ul><li>
To perform prescribed activities in a timely manner and to a high standard consistently driving continuous improvement.</li><li>
Requires in-depth technical knowledge and experience in their assigned area of expertise</li><li>
Thorough understanding of the underlying principles and concepts within the area of expertise</li><li>
They lead and supervise a team, guiding and supporting professional development, allocating work requirements and coordinating team resources.</li><li>
If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L &ndash; Listen and be authentic, E &ndash; Energise and inspire, A &ndash; Align across the enterprise, D &ndash; Develop others.</li><li>
OR for an individual contributor, they develop technical expertise in work area, acting as an advisor where appropriate.</li><li>
Will have an impact on the work of related teams within the area.</li><li>
Partner with other functions and business areas.</li><li>
Takes responsibility for end results of a team&rsquo;s operational processing and activities.</li><li>
Escalate breaches of policies / procedure appropriately.</li><li>
Take responsibility for embedding new policies/ procedures adopted due to risk mitigation.</li><li>
Advise and influence decision making within own area of expertise.</li><li>
Take ownership for managing risk and strengthening controls in relation to the work you own or contribute to. Deliver your work and areas of responsibility in line with relevant rules, regulation and codes of conduct.</li><li>
Maintain and continually build an understanding of how own sub-function integrates with function, alongside knowledge of the organisations products, services and processes within the function.</li><li>
Demonstrate understanding of how areas coordinate and contribute to the achievement of the objectives of the organisation sub-function.</li><li>
Make evaluative judgements based on the analysis of factual information, paying attention to detail.</li><li>
Resolve problems by identifying and selecting solutions through the application of acquired technical experience and will be guided by precedents.</li><li>
Guide and persuade team members and communicate complex / sensitive information.</li><li>
Act as contact point for stakeholders outside of the immediate function, while building a network of contacts outside team and external to the organisation.</li></ul><p></p><p>
All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship &ndash; our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset &ndash; to Empower, Challenge and Drive &ndash; the operating manual for how we behave.</p></div>

Accenture

<p><b>Project Role : </b>Data Engineer<br>
<b>Project Role Description : </b>Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
<br>
<b>Must have skills : </b>Apache Spark<br>
<b>Good to have skills : </b>Python (Programming Language), Google BigQuery, PySpark<br>
Minimum <b>12</b> year(s) of experience is required<br>
<b>Educational Qualification : </b>15 years full time education<br>
<br>
Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems, contributing to the overall efficiency and effectiveness of data management within the organization. Roles &amp; Responsibilities: - Expected to be an SME. - Collaborate and manage the team to perform. - Responsible for team decisions. - Engage with multiple teams and contribute on key decisions. - Expected to provide solutions to problems that apply across multiple teams. - Mentor junior team members to enhance their skills and knowledge in data engineering. - Continuously evaluate and improve data processes to ensure optimal performance and reliability. Professional &amp; Technical Skills: - Must To Have Skills: Proficiency in Apache Spark. - Good To Have Skills: Experience with PySpark, Python (Programming Language), Google BigQuery. - Strong understanding of data pipeline architecture and design. - Experience with ETL processes and data integration techniques. - Familiarity with data quality frameworks and best practices. Additional Information: - The candidate should have minimum 12 years of experience in Apache Spark. - This position is based at our Chennai office. - A 15 years full time education is required.</p>
<br>
15 years full time education

Explore 6685+ Data engineer in Bangalore Jobs In Test Jobs In Mangaluru this December. Find roles across top companies and apply now to boost your career.

6685 data engineer jobs IN Bangalore Jobs In Test Jobs In Mangaluru

Data Engineer

Data Engineer

Data Engineer

Data Engineer - 1

Data Engineer

Data Engineer

Data Engineer