hadoop consultant

Next Gen Software Solutions

<div>Job Title: Data Engineer (Spark, Hadoop, OzoneCH)
Location: Berkley Heights, NJ (5 Days Onsite)
Type: Contract W2 only
Duration: Long term
Role Overview:
We are seeking a highly skilled Big Data Engineer with strong experience in Apache Spark, Hadoop ecosystem, and Apache Ozone. The ideal candidate will design, develop, and optimize large-scale data processing systems, ensuring high performance, scalability, and reliability for enterprise-level applications.
Key Responsibilities:
<ul><li>Design and implement distributed data processing solutions using Apache Spark and Hadoop</li>
<li>Develop and maintain Spark applications for data transformation, aggregation, and ETL processes using Scala, Java, or Python</li>
<li>Utilize Apache Ozone for storing large-scale datasets, ensuring efficient data access and management in a distributed environment</li>
<li>Manage and optimize HDFS and Apache Ozone, Kafka for scalable and fault-tolerant storage.</li>
<li>Develop ETL pipelines for batch and real-time data ingestion and transformation.</li>
<li>Implement and ensure data validation, data security, integrity, and compliance across big data platforms.</li>
<li>Monitor and troubleshoot performance issues in large-scale clusters.</li>
<li>Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.</li>
<li>Automate workflows and improve operational efficiency using scripting and orchestration tools.</li>
</ul>Required Skills &amp; Qualifications:
<ul><li>Strong expertise in Apache Spark (Core, SQL, Streaming).</li>
<li>Hands-on experience with Hadoop ecosystem (HDFS, YARN, MapReduce).</li>
<li>Proficiency in Apache Ozone for object storage and integration with Hadoop.</li>
<li>Solid programming skills in Java, Scala, or Python.</li>
<li>Experience with Hive, HBase, and Kafka is a plus.</li>
<li>Knowledge of cluster management and resource optimization.</li>
<li>Familiarity with Linux/Unix environments and shell scripting.</li>
<li>Understanding of data security, governance, and compliance standards.</li>
</ul><ul><li>Experience with cloud-based big data platforms</li>
<li>Exposure to containerization (Docker, Kubernetes) for big data workloads.</li>
<li>Knowledge of CI/CD pipelines for data engineering projects.</li>
</ul>Behavioral Skills:
<ul><li>Good Communication skills</li>
<li>5 days' Work from Office at Berkley Heights, NJ</li>
<li>Team Player</li>
<li>Ability to work in a changing environment</li>
<li>Strong problem solving and analytical skills</li>
<li>Ability to work independently or within a team</li>
<li>Manage day-to-day challenges and communicate developmental risks with the technical team</li>
</ul>Qualifications:
<ul><li>Bachelor's degree in computer science, Software Engineering, or a related field.</li>
<li>Proficiency in business process modeling and documentation tools.</li>
<li>Product implementation experience is preferred</li>
</ul>About Next Gen Software Solutions LLC:
Next Gen Software Solutions is a trusted provider of IT Staffing and consulting services dedicated to empowering businesses with cutting-edge technology solutions and exceptional talent. We specialize in delivering tailored IT consulting services, innovative software solutions, and connecting businesses with highly skilled IT professionals. Founded and led by a dedicated U.S. Army solider, Next Gen Software Solutions is deeply rooted in the core values of integrity, discipline, commitment, and experience-principles that guide every aspect of our operations.
Equal Employment Opportunity Statement:
Next Gen Software Solutions LLC is an Equal Opportunity Employer. We are committed to fostering an inclusive and diverse workplace where all employees and applicants are treated respect and dignity. We do not discriminate based on race, colour, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, genetic information, veteran status, or any other legally protected characteristic under applicable federal, state, or local laws.</div>

Data Engineer (Spark, Hadoop, OzoneCH) |Berkley Heights, NJ- 5 Days Onsite | Contract W2

Genpact

<div><div><div>Ready to build the future with AI? 
At Genpact, we don&rsquo;t just keep up with technology&mdash;we set the pace. AI and digital innovation are redefining industries, and we&rsquo;re leading the charge. Genpact&rsquo;s AI Gigafactory, our industry-first accelerator, is an example of how we&rsquo;re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies&rsquo; most complex challenges. 
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what&rsquo;s possible, this is your moment. 
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions &ndash; we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. 
Inviting applications for the role of Lead Consultant, Databricks, Pyspark, AWS 
In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. 
Responsibilities 
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products. 
<ul><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have experience in Data Engineering domain.</li></ul>
Qualifications we seek in you! 
Minimum Qualifications 
Bachelor&rsquo;s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience. 
<ul><li>Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.</li><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have excellent coding skills either Python or Scala, preferably Python.</li><li>Must have experience in Data Engineering domain .Must have implemented at least 4 project end-to-end in Databricks.</li><li>Must have at least experience on databricks which consists of various components as below</li><li>Must have skills: Azure data factory, Azure data bricks, Python and Pyspark</li><li>Expert with database technologies and ETL tools.</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.</li><li>Good knowledge of AZURE, AWS, GCP Cloud platform services stack</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks,Delta lake, Databricks workflows orchestration, Python, Pyspark etc.</li><li>Good Knowledge on Unity Catalog implementation.</li><li>Good Knowledge on integration with other tools like &ndash; DBT, other transformation tools.</li><li>Good knowledge on Unity Catalog integration with Snowlflake</li><li>Must be well versed with Databricks Lakehouse concept and its implementation</li></ul>
in enterprise environments. 
<ul><li>Must have good understanding to create complex data pipeline</li><li>Must have good knowledge of Data structure &amp; algorithms.</li><li>Must be strong in SQL and sprak-sql.</li><li>Must have strong performance optimization skills to improve efficiency and reduce cost.</li><li>Must have worked on both Batch and streaming data pipeline.</li><li>Must have extensive knowledge of Spark and Hive data processing framework.</li><li>Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.</li><li>Must be strong in writing unit test case and integration test</li><li>Must have strong communication skills and have worked on the team of size 5 plus</li><li>Must have great attitude towards learning new skills and upskilling the existing skills.</li></ul>
Preferred Qualifications/ Skills 
Good to have Unity catalog and basic governance knowledge. 
<ul><li>Good to have Databricks SQL Endpoint understanding.</li><li>Good To have CI/CD experience to build the pipeline for Databricks jobs.</li><li>Good to have if worked on migration project to build Unified data platform.</li><li>Good to have knowledge of DBT.</li><li>Good to have knowledge of docker and Kubernetes.</li></ul>
Why join Genpact? 
<ul><li>Lead AI-first transformation &ndash; Build and scale AI solutions that redefine industries</li><li>Make an impact &ndash; Drive change for global enterprises and solve business challenges that matter</li><li>Accelerate your career&mdash;Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills</li><li>Grow with the best &ndash; Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace</li><li>Committed to ethical AI &ndash; Work in an environment where governance, transparency, and security are at the core of everything we build</li><li>Thrive in a values-driven culture &ndash; Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress</li></ul>
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up. 
Let&rsquo;s build tomorrow together. 
 
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. 
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.</div></div> 
JobLead Consultant
Primary LocationIndia-Pune
ScheduleFull-time
Education LevelBachelor's / Graduation / Equivalent
Job PostingFeb 18, 2026, 5:41:07 AM
Unposting DateOngoing
Master Skills ListDigital
Job CategoryFull Time</div>

Lead Consultant, Databricks, Pyspark, AWS

<div><div><div>Ready to build the future with AI? 
At Genpact, we don&rsquo;t just keep up with technology&mdash;we set the pace. AI and digital innovation are redefining industries, and we&rsquo;re leading the charge. Genpact&rsquo;s AI Gigafactory, our industry-first accelerator, is an example of how we&rsquo;re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies&rsquo; most complex challenges. 
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what&rsquo;s possible, this is your moment. 
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions &ndash; we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. 
Inviting applications for the role of Lead Consultant, Databricks, Pyspark, AWS 
In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. 
Responsibilities 
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products. 
<ul><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have experience in Data Engineering domain.</li></ul>
Qualifications we seek in you! 
Minimum Qualifications 
Bachelor&rsquo;s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience. 
<ul><li>Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.</li><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have excellent coding skills either Python or Scala, preferably Python.</li><li>Must have experience in Data Engineering domain .Must have implemented at least 4 project end-to-end in Databricks.</li><li>Must have at least experience on databricks which consists of various components as below</li><li>Must have skills: Azure data factory, Azure data bricks, Python and Pyspark</li><li>Expert with database technologies and ETL tools.</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.</li><li>Good knowledge of AZURE, AWS, GCP Cloud platform services stack</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks,Delta lake, Databricks workflows orchestration, Python, Pyspark etc.</li><li>Good Knowledge on Unity Catalog implementation.</li><li>Good Knowledge on integration with other tools like &ndash; DBT, other transformation tools.</li><li>Good knowledge on Unity Catalog integration with Snowlflake</li><li>Must be well versed with Databricks Lakehouse concept and its implementation</li></ul>
in enterprise environments. 
<ul><li>Must have good understanding to create complex data pipeline</li><li>Must have good knowledge of Data structure &amp; algorithms.</li><li>Must be strong in SQL and sprak-sql.</li><li>Must have strong performance optimization skills to improve efficiency and reduce cost.</li><li>Must have worked on both Batch and streaming data pipeline.</li><li>Must have extensive knowledge of Spark and Hive data processing framework.</li><li>Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.</li><li>Must be strong in writing unit test case and integration test</li><li>Must have strong communication skills and have worked on the team of size 5 plus</li><li>Must have great attitude towards learning new skills and upskilling the existing skills.</li></ul>
Preferred Qualifications/ Skills 
Good to have Unity catalog and basic governance knowledge. 
<ul><li>Good to have Databricks SQL Endpoint understanding.</li><li>Good To have CI/CD experience to build the pipeline for Databricks jobs.</li><li>Good to have if worked on migration project to build Unified data platform.</li><li>Good to have knowledge of DBT.</li><li>Good to have knowledge of docker and Kubernetes.</li></ul>
Why join Genpact? 
<ul><li>Lead AI-first transformation &ndash; Build and scale AI solutions that redefine industries</li><li>Make an impact &ndash; Drive change for global enterprises and solve business challenges that matter</li><li>Accelerate your career&mdash;Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills</li><li>Grow with the best &ndash; Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace</li><li>Committed to ethical AI &ndash; Work in an environment where governance, transparency, and security are at the core of everything we build</li><li>Thrive in a values-driven culture &ndash; Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress</li></ul>
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up. 
Let&rsquo;s build tomorrow together. 
 
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. 
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.</div></div> 
JobLead Consultant
Primary LocationIndia-Bangalore
ScheduleFull-time
Education LevelBachelor's / Graduation / Equivalent
Job PostingFeb 18, 2026, 4:38:09 AM
Unposting DateOngoing
Master Skills ListDigital
Job CategoryFull Time</div>

<div><div><div>Ready to build the future with AI? 
At Genpact, we don&rsquo;t just keep up with technology&mdash;we set the pace. AI and digital innovation are redefining industries, and we&rsquo;re leading the charge. Genpact&rsquo;s AI Gigafactory, our industry-first accelerator, is an example of how we&rsquo;re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies&rsquo; most complex challenges. 
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what&rsquo;s possible, this is your moment. 
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions &ndash; we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. 
Inviting applications for the role of Lead Consultant, Databricks, Pyspark, AWS 
In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. 
Responsibilities 
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products. 
<ul><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have experience in Data Engineering domain.</li></ul>
Qualifications we seek in you! 
Minimum Qualifications 
Bachelor&rsquo;s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience. 
<ul><li>Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.</li><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have excellent coding skills either Python or Scala, preferably Python.</li><li>Must have experience in Data Engineering domain .Must have implemented at least 4 project end-to-end in Databricks.</li><li>Must have at least experience on databricks which consists of various components as below</li><li>Must have skills: Azure data factory, Azure data bricks, Python and Pyspark</li><li>Expert with database technologies and ETL tools.</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.</li><li>Good knowledge of AZURE, AWS, GCP Cloud platform services stack</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks,Delta lake, Databricks workflows orchestration, Python, Pyspark etc.</li><li>Good Knowledge on Unity Catalog implementation.</li><li>Good Knowledge on integration with other tools like &ndash; DBT, other transformation tools.</li><li>Good knowledge on Unity Catalog integration with Snowlflake</li><li>Must be well versed with Databricks Lakehouse concept and its implementation</li></ul>
in enterprise environments. 
<ul><li>Must have good understanding to create complex data pipeline</li><li>Must have good knowledge of Data structure &amp; algorithms.</li><li>Must be strong in SQL and sprak-sql.</li><li>Must have strong performance optimization skills to improve efficiency and reduce cost.</li><li>Must have worked on both Batch and streaming data pipeline.</li><li>Must have extensive knowledge of Spark and Hive data processing framework.</li><li>Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.</li><li>Must be strong in writing unit test case and integration test</li><li>Must have strong communication skills and have worked on the team of size 5 plus</li><li>Must have great attitude towards learning new skills and upskilling the existing skills.</li></ul>
Preferred Qualifications/ Skills 
Good to have Unity catalog and basic governance knowledge. 
<ul><li>Good to have Databricks SQL Endpoint understanding.</li><li>Good To have CI/CD experience to build the pipeline for Databricks jobs.</li><li>Good to have if worked on migration project to build Unified data platform.</li><li>Good to have knowledge of DBT.</li><li>Good to have knowledge of docker and Kubernetes.</li></ul>
Why join Genpact? 
<ul><li>Lead AI-first transformation &ndash; Build and scale AI solutions that redefine industries</li><li>Make an impact &ndash; Drive change for global enterprises and solve business challenges that matter</li><li>Accelerate your career&mdash;Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills</li><li>Grow with the best &ndash; Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace</li><li>Committed to ethical AI &ndash; Work in an environment where governance, transparency, and security are at the core of everything we build</li><li>Thrive in a values-driven culture &ndash; Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress</li></ul>
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up. 
Let&rsquo;s build tomorrow together. 
 
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. 
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.</div></div> 
JobLead Consultant
Primary LocationIndia-Kolkata
ScheduleFull-time
Education LevelBachelor's / Graduation / Equivalent
Job PostingFeb 18, 2026, 4:24:13 AM
Unposting DateOngoing
Master Skills ListDigital
Job CategoryFull Time</div>

<div><div><div>Ready to build the future with AI? 
At Genpact, we don&rsquo;t just keep up with technology&mdash;we set the pace. AI and digital innovation are redefining industries, and we&rsquo;re leading the charge. Genpact&rsquo;s AI Gigafactory, our industry-first accelerator, is an example of how we&rsquo;re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies&rsquo; most complex challenges. 
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what&rsquo;s possible, this is your moment. 
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions &ndash; we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. 
Inviting applications for the role of Principal Consultant, Databricks, Pyspark, AWS 
In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. 
Responsibilities 
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products. 
<ul><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have experience in Data Engineering domain.</li></ul>
Qualifications we seek in you! 
Minimum Qualifications 
Bachelor&rsquo;s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience. 
<ul><li>Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.</li><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have excellent coding skills either Python or Scala, preferably Python.</li><li>Must have experience in Data Engineering domain .Must have implemented at least 4 project end-to-end in Databricks.</li><li>Must have at least experience on databricks which consists of various components as below</li><li>Must have skills: Azure data factory, Azure data bricks, Python and Pyspark</li><li>Expert with database technologies and ETL tools.</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.</li><li>Good knowledge of AZURE, AWS, GCP Cloud platform services stack</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks,Delta lake, Databricks workflows orchestration, Python, Pyspark etc.</li><li>Good Knowledge on Unity Catalog implementation.</li><li>Good Knowledge on integration with other tools like &ndash; DBT, other transformation tools.</li><li>Good knowledge on Unity Catalog integration with Snowlflake</li><li>Must be well versed with Databricks Lakehouse concept and its implementation</li></ul>
in enterprise environments. 
<ul><li>Must have good understanding to create complex data pipeline</li><li>Must have good knowledge of Data structure &amp; algorithms.</li><li>Must be strong in SQL and sprak-sql.</li><li>Must have strong performance optimization skills to improve efficiency and reduce cost.</li><li>Must have worked on both Batch and streaming data pipeline.</li><li>Must have extensive knowledge of Spark and Hive data processing framework.</li><li>Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.</li><li>Must be strong in writing unit test case and integration test</li><li>Must have strong communication skills and have worked on the team of size 5 plus</li><li>Must have great attitude towards learning new skills and upskilling the existing skills.</li></ul>
Preferred Qualifications/ Skills 
Good to have Unity catalog and basic governance knowledge. 
<ul><li>Good to have Databricks SQL Endpoint understanding.</li><li>Good To have CI/CD experience to build the pipeline for Databricks jobs.</li><li>Good to have if worked on migration project to build Unified data platform.</li><li>Good to have knowledge of DBT.</li><li>Good to have knowledge of docker and Kubernetes.</li></ul>
Why join Genpact? 
<ul><li>Lead AI-first transformation &ndash; Build and scale AI solutions that redefine industries</li><li>Make an impact &ndash; Drive change for global enterprises and solve business challenges that matter</li><li>Accelerate your career&mdash;Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills</li><li>Grow with the best &ndash; Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace</li><li>Committed to ethical AI &ndash; Work in an environment where governance, transparency, and security are at the core of everything we build</li><li>Thrive in a values-driven culture &ndash; Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress</li></ul>
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up. 
Let&rsquo;s build tomorrow together. 
 
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. 
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.</div></div> 
JobPrincipal Consultant
Primary LocationIndia-Pune
ScheduleFull-time
Education LevelBachelor's / Graduation / Equivalent
Job PostingFeb 18, 2026, 5:29:51 AM
Unposting DateOngoing
Master Skills ListDigital
Job CategoryFull Time</div>

Principal Consultant, Databricks, Pyspark, AWS

<div><div><div>Ready to build the future with AI? 
At Genpact, we don&rsquo;t just keep up with technology&mdash;we set the pace. AI and digital innovation are redefining industries, and we&rsquo;re leading the charge. Genpact&rsquo;s AI Gigafactory, our industry-first accelerator, is an example of how we&rsquo;re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies&rsquo; most complex challenges. 
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what&rsquo;s possible, this is your moment. 
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions &ndash; we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. 
Inviting applications for the role of Principal Consultant, Databricks, Pyspark, AWS 
In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. 
Responsibilities 
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products. 
<ul><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have experience in Data Engineering domain.</li></ul>
Qualifications we seek in you! 
Minimum Qualifications 
Bachelor&rsquo;s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience. 
<ul><li>Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.</li><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have excellent coding skills either Python or Scala, preferably Python.</li><li>Must have experience in Data Engineering domain .Must have implemented at least 4 project end-to-end in Databricks.</li><li>Must have at least experience on databricks which consists of various components as below</li><li>Must have skills: Azure data factory, Azure data bricks, Python and Pyspark</li><li>Expert with database technologies and ETL tools.</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.</li><li>Good knowledge of AZURE, AWS, GCP Cloud platform services stack</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks,Delta lake, Databricks workflows orchestration, Python, Pyspark etc.</li><li>Good Knowledge on Unity Catalog implementation.</li><li>Good Knowledge on integration with other tools like &ndash; DBT, other transformation tools.</li><li>Good knowledge on Unity Catalog integration with Snowlflake</li><li>Must be well versed with Databricks Lakehouse concept and its implementation</li></ul>
in enterprise environments. 
<ul><li>Must have good understanding to create complex data pipeline</li><li>Must have good knowledge of Data structure &amp; algorithms.</li><li>Must be strong in SQL and sprak-sql.</li><li>Must have strong performance optimization skills to improve efficiency and reduce cost.</li><li>Must have worked on both Batch and streaming data pipeline.</li><li>Must have extensive knowledge of Spark and Hive data processing framework.</li><li>Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.</li><li>Must be strong in writing unit test case and integration test</li><li>Must have strong communication skills and have worked on the team of size 5 plus</li><li>Must have great attitude towards learning new skills and upskilling the existing skills.</li></ul>
Preferred Qualifications/ Skills 
Good to have Unity catalog and basic governance knowledge. 
<ul><li>Good to have Databricks SQL Endpoint understanding.</li><li>Good To have CI/CD experience to build the pipeline for Databricks jobs.</li><li>Good to have if worked on migration project to build Unified data platform.</li><li>Good to have knowledge of DBT.</li><li>Good to have knowledge of docker and Kubernetes.</li></ul>
Why join Genpact? 
<ul><li>Lead AI-first transformation &ndash; Build and scale AI solutions that redefine industries</li><li>Make an impact &ndash; Drive change for global enterprises and solve business challenges that matter</li><li>Accelerate your career&mdash;Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills</li><li>Grow with the best &ndash; Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace</li><li>Committed to ethical AI &ndash; Work in an environment where governance, transparency, and security are at the core of everything we build</li><li>Thrive in a values-driven culture &ndash; Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress</li></ul>
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up. 
Let&rsquo;s build tomorrow together. 
 
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. 
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.</div></div> 
JobPrincipal Consultant
Primary LocationIndia-Kolkata
ScheduleFull-time
Education LevelBachelor's / Graduation / Equivalent
Job PostingFeb 18, 2026, 5:22:54 AM
Unposting DateOngoing
Master Skills ListDigital
Job CategoryFull Time</div>

<div><div><div>Ready to build the future with AI? 
At Genpact, we don&rsquo;t just keep up with technology&mdash;we set the pace. AI and digital innovation are redefining industries, and we&rsquo;re leading the charge. Genpact&rsquo;s AI Gigafactory, our industry-first accelerator, is an example of how we&rsquo;re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies&rsquo; most complex challenges. 
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what&rsquo;s possible, this is your moment. 
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions &ndash; we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. 
Inviting applications for the role of Principal Consultant, Databricks, Pyspark, AWS 
In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. 
Responsibilities 
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products. 
<ul><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have experience in Data Engineering domain.</li></ul>
Qualifications we seek in you! 
Minimum Qualifications 
Bachelor&rsquo;s Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience. 
<ul><li>Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.</li><li>Work with architect and lead engineers for solutions to meet functional and non-functional requirements.</li><li>Demonstrated knowledge of relevant industry trends and standards.</li><li>Demonstrate strong analytical and technical problem-solving skills.</li><li>Must have excellent coding skills either Python or Scala, preferably Python.</li><li>Must have experience in Data Engineering domain .Must have implemented at least 4 project end-to-end in Databricks.</li><li>Must have at least experience on databricks which consists of various components as below</li><li>Must have skills: Azure data factory, Azure data bricks, Python and Pyspark</li><li>Expert with database technologies and ETL tools.</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.</li><li>Good knowledge of AZURE, AWS, GCP Cloud platform services stack</li><li>Hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks,Delta lake, Databricks workflows orchestration, Python, Pyspark etc.</li><li>Good Knowledge on Unity Catalog implementation.</li><li>Good Knowledge on integration with other tools like &ndash; DBT, other transformation tools.</li><li>Good knowledge on Unity Catalog integration with Snowlflake</li><li>Must be well versed with Databricks Lakehouse concept and its implementation</li></ul>
in enterprise environments. 
<ul><li>Must have good understanding to create complex data pipeline</li><li>Must have good knowledge of Data structure &amp; algorithms.</li><li>Must be strong in SQL and sprak-sql.</li><li>Must have strong performance optimization skills to improve efficiency and reduce cost.</li><li>Must have worked on both Batch and streaming data pipeline.</li><li>Must have extensive knowledge of Spark and Hive data processing framework.</li><li>Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.</li><li>Must be strong in writing unit test case and integration test</li><li>Must have strong communication skills and have worked on the team of size 5 plus</li><li>Must have great attitude towards learning new skills and upskilling the existing skills.</li></ul>
Preferred Qualifications/ Skills 
Good to have Unity catalog and basic governance knowledge. 
<ul><li>Good to have Databricks SQL Endpoint understanding.</li><li>Good To have CI/CD experience to build the pipeline for Databricks jobs.</li><li>Good to have if worked on migration project to build Unified data platform.</li><li>Good to have knowledge of DBT.</li><li>Good to have knowledge of docker and Kubernetes.</li></ul>
Why join Genpact? 
<ul><li>Lead AI-first transformation &ndash; Build and scale AI solutions that redefine industries</li><li>Make an impact &ndash; Drive change for global enterprises and solve business challenges that matter</li><li>Accelerate your career&mdash;Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills</li><li>Grow with the best &ndash; Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace</li><li>Committed to ethical AI &ndash; Work in an environment where governance, transparency, and security are at the core of everything we build</li><li>Thrive in a values-driven culture &ndash; Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress</li></ul>
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up. 
Let&rsquo;s build tomorrow together. 
 
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. 
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.</div></div> 
JobPrincipal Consultant
Primary LocationIndia-Hyderabad
ScheduleFull-time
Education LevelBachelor's / Graduation / Equivalent
Job PostingFeb 18, 2026, 3:40:13 AM
Unposting DateOngoing
Master Skills ListDigital
Job CategoryFull Time</div>

Search 3153+ Hadoop consultant jobs near you this March. New roles added regularly across leading industries. Apply today.

3153 hadoop consultant jobs Near Me

Data Engineer (Spark, Hadoop, OzoneCH) |Berkley Heights, NJ- 5 Days Onsite | Contract W2

Lead Consultant, Databricks, Pyspark, AWS

Lead Consultant, Databricks, Pyspark, AWS

Lead Consultant, Databricks, Pyspark, AWS

Principal Consultant, Databricks, Pyspark, AWS

Principal Consultant, Databricks, Pyspark, AWS

Principal Consultant, Databricks, Pyspark, AWS