business analyst

software engineer

data scientist

data analyst

senior software engineer

data engineer

Techversant Infotech

<div><div>What&rsquo;s important to us:
We are looking for a skilled and experienced Data Engineer with over 4 years of professional experience in building, automating, and optimizing data pipelines and cloud-based architectures. The ideal candidate will have hands-on experience with cloud data services (AWS, Azure, or GCP) and CI/CD pipelines for deploying scalable, reliable, and secure data solutions.
The candidate will collaborate with cross-functional teams including data analysts, data scientists, and software engineers to design and maintain robust data infrastructure that supports analytics, AI/ML workflows, and enterprise reporting systems.
Key Responsibilities:<ul><li>
Design, build, and maintain end-to-end ETL/ELT pipelines using both on-premise and cloud-based technologies.</li><li>
Architect and operate data storage and streaming solutions leveraging cloud-based services on AWS, Azure, or GCP.</li><li>
Design and implement data ingestion and transformation workflows using Airflow, AWS Glue, or Azure Data Factory.</li><li>
Develop and optimize data pipelines using Python and PySpark for large-scale distributed data processing.</li><li>
Build data models &mdash; normalized, denormalized, and dimensional (Star/Snowflake) &mdash; for analytics and warehousing solutions.</li><li>
Implement data quality, lineage, and governance using metadata management and monitoring tools.</li><li>
Collaborate with cross-functional teams to deliver clean, reliable, and timely data for analytics and machine learning use cases.</li><li>
Integrate CI/CD pipelines for data infrastructure deployment using GitHub Actions, Jenkins, or Azure DevOps.</li><li>
Automate infrastructure provisioning using Infrastructure as Code (IaC) tools such as AWS CloudFormation or Terraform.</li><li>
Monitor and optimize data processing performance for scalability, reliability, and cost-efficiency.</li><li>
Enforce data security policies and ensure compliance with standards such as GDPR and HIPAA.</li></ul>
Must-Have Skills &amp; Qualifications:<ul><li> 
Education: Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Information Technology, Data Engineering, or a related field.</li><li>
Experience: Minimum 4 years of hands-on experience as a Data Engineer or in data-intensive environments.</li><li>
SQL Expertise: Advanced proficiency in SQL for complex queries, joins, window functions, and performance tuning.</li><li>
Analytical Databases: Experience working with Snowflake, Amazon Redshift, Google BigQuery, Azure Synapse, and PostgreSQL.</li><li>
Query Optimization: Skilled in query optimization, indexing, and execution plan analysis for high-performance analytics workloads.</li><li>
Programming: Proficient in Python and PySpark for data manipulation, automation, and pipeline orchestration.</li><li>
Data Processing Frameworks: Strong understanding of Apache Spark (RDD, DataFrame, Spark SQL, optimization), Hive, Hadoop, and Flink for large-scale distributed data processing.</li><li>
ETL/ELT Frameworks: Hands-on experience designing and maintaining pipelines using Airflow, AWS Glue, or Azure Data Factory.</li><li>
Data Integration Patterns: Familiar with incremental loading, Slowly Changing Dimensions (SCD), Change Data Capture (CDC), and error handling in data pipelines.</li><li>
Data Modeling: Expertise in data modeling, schema design, and building normalized, denormalized, and dimensional (Star/Snowflake) schemas.</li><li>
Data Architecture: Strong understanding of Data Warehousing, Data Lakes, and Lakehouse architectures, including Delta Lake, ACID transactions, and partitioning strategies.</li><li>
Cloud Platforms: Practical experience with major cloud ecosystems &mdash;<ul><li>
AWS: S3, Glue, Redshift, Athena, Lambda, Step Functions, EMR</li><li>
Azure: Data Factory, Data Lake Gen2, Synapse, Databricks</li></ul></li><li>
Cloud Security: Experience managing IAM roles, access control, and encryption in cloud environments.</li><li>
Pipeline Optimization: Skilled in optimizing data pipelines for performance, scalability, and cost-efficiency.</li><li>
CI/CD and DevOps: Hands-on experience with CI/CD tools such as GitHub Actions, GitLab CI, or Azure DevOps.</li><li>
Version Control: Proficient with Git and familiar with agile development practices.</li></ul>
Good-to-Have Skills:<ul><li>
Experience with containerization and orchestration.</li><li>
Exposure to data cataloging and governance tools.</li><li>
Experience with monitoring tools .</li><li>
Familiarity with data APIs and microservices architecture.</li><li>
Certification in cloud data engineering (e.g., AWS Certified Data Engineer, Azure Data Engineer Associate, or GCP Professional Data Engineer).</li><li>
Experience supporting machine learning and analytics pipelines.</li></ul>
Soft Skills:<ul><li>
Strong analytical and problem-solving mindset.</li><li>
Excellent communication and documentation skills.</li><li>
Ability to work collaboratively in a cross-functional, fast-paced environment.</li><li>
Strong attention to detail with a focus on data accuracy and reliability.</li><li>
Eagerness to learn and adopt emerging data technologies.</li></ul></div><div><div><div><div>
Job Type: Full Time</div><div>
Job Location: Kochi Trivandrum</div></div></div></div></div>

Data Engineer

AreteMinds Technologies Pvt. Ltd.

Data Engineer Consultant Role - Hyderabad LocationGUS Education India (GEI), the education arm of Global University Systems, seeks a skilled Data Engineer Consultant based in Hyderabad for a full-time role in IT &amp; Analytics. Reporting to SLM and approved by COE Lead, this position focuses on designing, building, and maintaining scalable data pipelines on AWS.Role OverviewDevelop reliable ETL/ELT pipelines using AWS services like Glue, Spark, S3, Athena, Redshift, and Lambda to support analytics, reporting, and ML projects. Transform and integrate data from multiple sources, ensure data quality, and collaborate with Data Scientists, Analysts, and IT teams while adhering to governance and security standards.​Key Responsibilities<ul><li>Design and maintain scalable ETL/ELT pipelines with AWS Glue, Spark, Step Functions, S3, and Athena for efficiency and reliability.​</li><li>Clean, transform data from institutional systems, and integrate into unified pipelines.​</li><li>Partner with stakeholders to enable data access via Principle of Least Privilege and AWS IAM.​</li><li>Optimize processes, apply SQL best practices, and contribute to data governance/compliance.​</li></ul>Required Skills &amp; Experience<ul><li>8+ years in Data Engineering; minimum 10 years professional experience.​</li><li>Strong Python, SQL, Spark, and data lakes expertise.​</li><li>Hands-on with AWS (Redshift, Glue, Lambda, S3) and ETL/ELT pipelines.​</li><li>Data governance, quality frameworks, problem-solving, and analytical skills.​</li><li>Degree in Data Science, Statistics, CS, or related field.​</li><li>Excellent communication, stakeholder management, and project skills.​</li></ul>Key Results Areas (KRAs)<ul><li>Pipeline delivery/reliability, data quality, innovation/automation, stakeholder satisfaction, and L&amp;D (biannual assessment).​</li></ul>Apply now for this Hyderabad-based opportunity at GEI! Equal opportunity employer encouraging diverse applicants.Job Type: Full-timePay: From ₹1,500,000.00 per yearBenefits:<ul><li>Health insurance</li><li>Provident Fund</li></ul>Work Location: In person

Bexcode Services

Job Title: Junior Data Engineer Location: Bangalore (Onsite) Job Type: Full-Time Working Hours: 6:30 PM &ndash; 3:30 AM IST (US Time Zone) Working Days: Monday to Friday Salary Range: ₹5,00,000 &ndash; ₹7,00,000 per annumJob SummaryWe are looking for a motivated Junior Data Engineer to join our data engineering team in Bangalore. The ideal candidate will have hands-on experience with SQL, Python, Databricks, and PySpark, and be eager to work in a fast-paced, data-driven environment supporting US-based stakeholders. This role offers strong learning opportunities and exposure to modern data platforms and large-scale data processing.Key Responsibilities<ul><li>Develop, maintain, and optimize data pipelines using Python and PySpark</li><li>Work with Databricks for data processing, transformation, and analytics</li><li>Write and optimize SQL queries for data extraction, validation, and reporting</li><li>Support ingestion of structured and semi-structured data from multiple sources</li><li>Assist in building and maintaining ETL/ELT workflows</li><li>Perform data quality checks and troubleshoot data issues</li><li>Collaborate with data analysts, senior data engineers, and stakeholders</li><li>Document data processes, workflows, and best practices</li><li>Support US-based teams during assigned working hours</li></ul>Required Skills and Qualifications<ul><li>Bachelor&rsquo;s degree in Computer Science, Engineering, or a related field</li><li>1&ndash;3 years of experience in data engineering or related roles</li><li>Strong working knowledge of SQL and Python</li><li>Hands-on experience with Databricks and PySpark</li><li>Basic understanding of data warehousing and data modeling concepts</li><li>Familiarity with cloud platforms (AWS / Azure / GCP) is a plus</li><li>Ability to work in US time zone (6:30 PM &ndash; 3:30 AM IST)</li><li>Strong problem-solving, analytical, and communication skills</li></ul>Preferred Qualifications<ul><li>Experience working with large datasets and distributed data processing</li><li>Exposure to ETL tools, orchestration frameworks, or version control (Git)</li><li>Knowledge of data lakes, Delta Lake, or similar technologies</li></ul>Why Join Us<ul><li>Competitive salary package (₹6&ndash;7 LPA)</li><li>Opportunity to work on modern data platforms and technologies</li><li>Exposure to US-based projects and stakeholders</li><li>Strong learning, mentorship, and career growth opportunities</li><li>Collaborative and fast-paced work environment</li></ul>Job Types: Full-time, PermanentPay: ₹500,000.00 - ₹700,000.00 per yearWork Location: Remote

RUDE The professional salon

We are looking for a skilled Data Engineer to join our team in Bangalore. The ideal candidate will have strong experience in building and optimizing data pipelines, working with structured and semi-structured data, and supporting analytics and visualization needs.Key Responsibilities<ul><li>Design, develop, and maintain ETL pipelines</li><li>Write and optimize PL/SQL and SQL queries</li><li>Work on API integration and performance optimization</li><li>Ensure data quality, reliability, and scalability</li><li>Support data visualization and reporting requirements</li><li>Collaborate with analytics, product, and engineering teams</li><li>Troubleshoot data performance and pipeline issues</li></ul>Mandatory Skills &amp; Experience<ul><li>4+ years of experience as a Data Engineer</li><li>Strong hands-on experience with ETL tools/processes</li><li>Proficiency in PL/SQL, SQL, and complex SQL queries</li><li>Experience in API optimization and integration</li><li>Exposure to data visualization tools and concepts</li><li>Strong problem-solving and communication skills</li></ul>Preferred / Nice to Have<ul><li>Experience working in a hybrid or agile environment</li><li>Knowledge of cloud platforms (AWS / Azure / GCP)</li><li>Experience with large datasets and performance tuning</li></ul>Work Arrangement<ul><li>Hybrid work model</li><li>Bangalore location (local candidates preferred)</li></ul>Job Type: Full-timePay: ₹1,800,000.00 - ₹1,900,000.00 per yearWork Location: Hybrid remote in Ramesh Nagar, Karnataka

Barclays

<div>Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences.
To be successful as a Data Engineer you should have experience with:<ul><li>
Hands on experience in pyspark and strong knowledge on Dataframes, RDD and SparkSQL</li><li>
Hands on Experience in developing, testing and maintaining applications on AWS Cloud.</li><li>
Strong hold on AWS Data Analytics Technology Stack (Glue, S3, Lambda, Lake formation, Athena)</li><li>
Design and implement scalable and efficient data transformation/storage solutions using Snowflake.</li><li>
Experience in Data ingestion to Snowflake for different storage format such Parquet, Iceberg, JSON, CSV etc</li><li>
Experience in using DBT (Data Build Tool) with snowflake for ELT pipeline development.</li><li>
Experience in Writing advanced SQL and PL SQL programs.</li><li>
Hands On Experience for building reusable components using Snowflake and AWS Tools/Technology</li><li>
Should have worked at least on two major project implementations.</li><li>
Exposure to data governance or lineage tools such as Immuta and Alation is added advantage.</li><li>
Experience in using Orchestration tools such as Apache Airflow or Snowflake Tasks is added advantage.</li><li>
Knowledge on Abinitio ETL tool is a plus</li></ul>
Some other highly valued skills may include:<ul><li>
Ability to engage with Stakeholders, elicit requirements/ user stories and translate requirements into ETL components</li><li>
Ability to understand the infrastructure setup and be able to provide solutions either individually or working with teams.</li><li>
Good knowledge of Data Marts and Data Warehousing concepts.</li><li>
Resource should possess good analytical and Interpersonal skills.</li><li>
Implement Cloud based Enterprise data warehouse with multiple data platform along with Snowflake and NoSQL environment to build data movement strategy.</li></ul>
You may be assessed on key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen, strategic thinking and digital and technology, as well as job-specific technical skills.
The role is based out of Pune.

Purpose of the role
To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
Accountabilities<ul><li>
Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.</li><li>
Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.</li><li>
Development of processing and analysis algorithms fit for the intended data complexity and volumes.</li><li>
Collaboration with data scientist to build and deploy machine learning models.</li></ul>
Assistant Vice President Expectations<ul><li>
To advise and influence decision making, contribute to policy development and take responsibility for operational effectiveness. Collaborate closely with other functions/ business divisions.</li><li>
Lead a team performing complex tasks, using well developed professional knowledge and skills to deliver on work that impacts the whole business function. Set objectives and coach employees in pursuit of those objectives, appraisal of performance relative to objectives and determination of reward outcomes</li><li>
If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L &ndash; Listen and be authentic, E &ndash; Energise and inspire, A &ndash; Align across the enterprise, D &ndash; Develop others.</li><li>
OR for an individual contributor, they will lead collaborative assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will identify new directions for assignments and/ or projects, identifying a combination of cross functional methodologies or practices to meet required outcomes.</li><li>
Consult on complex issues; providing advice to People Leaders to support the resolution of escalated issues.</li><li>
Identify ways to mitigate risk and developing new policies/procedures in support of the control and governance agenda.</li><li>
Take ownership for managing risk and strengthening controls in relation to the work done.</li><li>
Perform work that is closely related to that of other areas, which requires understanding of how areas coordinate and contribute to the achievement of the objectives of the organisation sub-function.</li><li>
Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategy.</li><li>
Engage in complex analysis of data from multiple sources of information, internal and external sources such as procedures and practises (in other areas, teams, companies, etc).to solve problems creatively and effectively.</li><li>
Communicate complex information. 'Complex' information could include sensitive information or information that is difficult to communicate because of its content or its audience.</li><li>
Influence or convince stakeholders to achieve outcomes.</li></ul>
All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship &ndash; our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset &ndash; to Empower, Challenge and Drive &ndash; the operating manual for how we behave.</div>

Commonwealth Bank of Australia

<div><h3 class="jobSectionHeader">Organization : CommBank, we never lose sight of the role we play in other people&rsquo;s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
</h3><h3 class="jobSectionHeader">Job Title : Data Engineer
</h3><h3 class="jobSectionHeader">Location: Bangalore
</h3><h3 class="jobSectionHeader">Business &amp; Team: Retail Technology
</h3><h3 class="jobSectionHeader">Impact &amp; Contribution: Data Engineer, you will be reporting to a Data Engineering Manager Utilizing Big Data technology to solve our customer data centric problems. Working closely with the Senior Data engineer, Solution Designers and Business Analysts to understand and perform Data Ingestion, Enrichment and Egression.
</h3><h3 class="jobSectionHeader">Roles &amp; Responsibilities:
</h3><ul><li><h3 class="jobSectionHeader">Working across the Group Data Warehouse, Big Data Platform, ETL Ab Initio GDE/BRE, Cloud Platform &amp; Snowflake
</h3></li><li><h3 class="jobSectionHeader">Building group data products by integrating diverse data from hundreds of internal and external sources
</h3></li><li><h3 class="jobSectionHeader">Adopting tools, programming languages and templates to improve our data quality and efficiency
</h3></li><li><h3 class="jobSectionHeader">Building and optimizing Big Data pipelines, architecture and data sets
</h3></li><li><h3 class="jobSectionHeader">End to end ownership and accountability of the business requirements, identify technical / performance issues and solve them.
</h3></li><li><h3 class="jobSectionHeader">Learn and adapt to new technologies to solve problems and improve existing solutions
</h3></li><li><h3 class="jobSectionHeader">Required to maintain and build excellent relationships with CDAO peers and stakeholders as well as actively contribute to business outcomes and team culture
</h3></li></ul><h3 class="jobSectionHeader">Essential Skills:
</h3><ul><li><h3 class="jobSectionHeader">Minimum of 5+ years of hands-on experience in Software Engineering or development to build solution in Hadoop, Hive and Spark technologies.
</h3></li><li><h3 class="jobSectionHeader">Minimum 5+ years of hands-on experience in any of the language (Scala/Python) with spark ETL development.
</h3></li><li><h3 class="jobSectionHeader">Minimum 5+ years of hands-on experience in any of them (Teradata / Oracle / SQL Server / MySQL) with strong SQL expertise
</h3></li><li><h3 class="jobSectionHeader">Minimum 5+ years of hands-on experience in any of the CI/CD tools like Bamboo &amp; Intellij teamcity
</h3></li><li><h3 class="jobSectionHeader">Minimum 5+ years of hands-on experience in any of the code maintenance repository like Github &amp; bit bucket
</h3></li><li><h3 class="jobSectionHeader">Minimum of 5+ years of experience on Shell Scripting
</h3></li><li><h3 class="jobSectionHeader">Good to have hands-on experience in any ETL Tool like Datastage or Ab initio GDE/BRE
</h3></li><li><h3 class="jobSectionHeader">Good Understanding of Distributed system and computing
</h3></li><li><h3 class="jobSectionHeader">Good to have hands on experience on Performance Tuning
</h3></li><li><h3 class="jobSectionHeader">Should be well aware of AGILE processes and methodologies
</h3></li><li><h3 class="jobSectionHeader">A natural ability to effectively communicate, educate and influence the different stakeholders/ peers, to solve challenging problems, while working in collaboration with other cross-functional engineering and solution design teams
</h3></li></ul><h3 class="jobSectionHeader">Education Qualifications:
</h3><ul><li><h3 class="jobSectionHeader">Bachelor&rsquo;s degree in Engineering in Computer Science/Information Technology
</h3></li></ul><div><div><div><div><div><div><div>If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We&rsquo;re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
</div></div></div></div></div></div></div>Advertising End Date: 30/01/2026</div>

Exinity

<div>Company Description 
We believe the power of risk-driven investing can help anyone achieve a better life. And we&rsquo;re here to make this potential a reality for an emerging global generation.
We provide individuals in the world&rsquo;s fast-developing economies with guidance, tools, and easy market access so they can trade and invest with confidence. We aim to make our clients their own wealth manager: empowered to create investment strategies and make investment decisions effortlessly, in their own time, on their own terms, in their own way.
Our story goes back to the first days of online Forex trading - a pioneer of the Meta trader platform, Alpari, expanded rapidly in the world&rsquo;s emerging markets and was joined in 2011 by our sister brand, FXTM. Now, we are adding further brands to our portfolio. Together, both brands have built a leading global presence in online trading serving over two million clients in 150 countries from regulated centres across four continents.
Exinity is an energetic and diverse company with offices across Europe, Asia and Africa, and we&rsquo;re always looking for talented individuals to join us. &lsquo;Freedom to Succeed&rsquo; is not just a promise we make to our clients and partners, but to our people too. We&rsquo;ll help you develop a range of skills, take on early responsibility, and enjoy a rewarding and fulfilling career with a fast-growing, dynamic company. 
Job Description 
We are seeking Data Engineer with strong expertise in Azure Databricks. This role will focus on building, supporting, and administering scalable, high-performance data pipelines that power real-time and batch analytics for trading, risk, and operational use cases. The ideal candidate will have a deep background in data bricks data engineering, administration, capital markets data, and thrive in an Agile, fast-paced environment.
Key Responsibilities:<ul><li>
Design, develop, and maintain robust data pipelines using Azure Databricks, Confluent, DLT, Spark pipleline, and Delta Lake to support trading and market data workflows.</li><li>
Self-study the existing pipeline and enhance existing data pipelines, ensuring continuity, scalability, and performance improvements.</li><li>
Production pipeline support services, including job monitoring, incident resolution, and performance tuning in production environments.</li><li>
Administer Databricks workspaces, unity catalog, including cluster configuration, job scheduling, access control, and workspace optimization.</li><li>
Build and maintain CI/CD pipelines using GitLab, enabling automated testing, deployment, and versioning of data engineering code.</li><li>
Follow and enforce best practices in code management, including modular design, code reviews, and documentation using GitLab workflows.</li><li>
Collaborate with fellow team members, business analysts, and data architect to understand data requirements and deliver high-quality solutions.</li><li>
Build reusable components and frameworks to accelerate development and ensure consistency across data platforms.</li><li>
Actively participate in Agile ceremonies (e.g., sprint planning, stand-ups, retrospectives) and contribute to continuous improvement of team processes.</li></ul> 

Qualifications 
<ul><li>
Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Engineering, or a related field.</li><li>
5+ years of experience in data engineering, with at least 2 years working with Azure Databricks.</li><li>
Strong proficiency in PySpark, SQL, and Python.</li><li>
Experience supporting production pipelines, including monitoring, alerting, and troubleshooting.</li><li>
Experience with GitLab CI/CD, including pipeline configuration, runners, and integration with cloud services.</li><li>
Familiarity with financial capital markets domain, such as market data feeds, order books, trade execution, and risk metrics.</li><li>
Proven ability to work effectively in Agile development environments.</li><li>
Azure certifications (e.g., Azure Data Engineer Associate).</li><li>
Experience with real-time data processing using Kafka or Event Hubs.</li></ul> 

Additional Information 
What you will love about Exinity: 
&ldquo;Freedom to succeed&rdquo; is our core belief. It&rsquo;s not just a promise we make to our clients and partners, but to our people too. We want our people to LEAP and so in this role you will&hellip;<ul><li>
[Learn] (e.g., from each other/from new projects).</li><li>
[Exchange] (e.g., information and best practices in an open-minded environment).</li><li>
[Advance] (e.g., by developing skills and accepting greater responsibilities/ your career progression and diversification).</li><li>
[Prosper] (e.g., by acquiring skills/ by nurturing a team of x people).</li></ul>
Exinity is an equal opportunities employer and positively encourages applications from suitably qualified and eligible candidates regardless of gender, sexual orientation, marital or civil partner status, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.</div>

Explore 6454+ Data engineer in India this January. Find roles across top companies and apply now to boost your career.

6454 data engineer jobs IN India

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer