hadoop software engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p><b>Must Have:</b></p>
<div>
<ul><li><b>Hands-on Experience in ETL t</b>esting with knowledge on Data Warehouse, Data Lake ETL Testing application</li></ul>
<ul><li>Solid expertise in working with ETL / Databricks testing, Informatica tools (IDMC)</li></ul>
<ul><li>Experience with big data technologies (Spark, PySpark, Delta Lake).</li></ul>
<ul><li>Knowledge of data modeling, data quality frameworks, and BI tools</li></ul>
<ul><li>Good Knowledge in Test data articulation
</li></ul></div><p>Good to have ETL &amp; SQL work experience, Databricks, Teradata.</p>
<p><b>Worked on design and development of any digital dashboard preferred</b></p>
<p>Experience with Datawarehouse Automation testing, SQL and test data creation.</p>
<div><ul><li>Good experience in Agile Software Testing Lifecycle</li></ul>
<ul><li>Should have worked on data warehouse projects with good exposure to database technologies like Hadoop, Teradata, Snowflake.</li></ul></div><p><br>
</p></div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Engineer</div>
</div><div><div><b>Job Id</b></div>
<div>387014</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python | Spark | ETL Testing</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Databricks Test Engineer

<div><div><div><div>India</div>
</div><div><div>Information Technology (IT)
</div></div><div><div>Group Functions
</div></div><div><p><b>Job Reference #</b></p>
<div>332687BR</div>
</div><div><p><b>City</b></p>
<div>Hyderabad, Pune</div>
</div><div><p><b>Job Type</b></p>
<div>Full Time
</div></div><div><p><b>Your role</b></p>
<div>We&rsquo;re looking for a Reporting/Data engineering software engineer :<br>
<br>
<ul><li>with over 11 years of experience in the field of Apache Spark, Databricks, and PySpark, you will be responsible for leading a team of 5-7 technical experts. Your role will encompass a broad spectrum of technical skills, focusing on big data processing, data engineering, and related technologies. The ideal candidate will possess deep expertise in Spark job optimization, data modeling, and performance tuning within the Databricks environment. Additionally, proficiency in Python programming, advanced data integration, and SDLC (Software Development Life Cycle) processes is crucial.</li></ul>
Qualifications and Skills:<br>
<ul><li>bachelor&rsquo;s/Masters degree in Computer Science, Data Science, or a related field.</li><li>proven experience leading and managing technical teams.</li></ul>
Soft Skills:<br>
<ul><li>excellent leadership and team management abilities.</li><li>effective communication skills to convey technical concepts to both technical and non-technical stakeholders.</li><li>analytical and problem-solving mindset.</li><li>proactive in staying abreast of industry trends and emerging technologies.</li></ul></div>
</div><div><p><b>Your team</b></p>
<div>You&rsquo;ll be working in Finance IT in Pune. We provide excellent exposure to latest technologies and ability to &lsquo;make a mark&rsquo; in our delivery team. It benefits our clients with greater insights into their business and provides extra agility in change. As a Software Engineer you&rsquo;ll play an important role in achieving important change milestones.<br>
<br>
We are results-oriented, multi-cultural group and would welcome you on the Azure World journey with us.</div>
</div><div><p><b>Your expertise</b></p>
<div>&bull; employ Python and PySpark to perform advanced data manipulation, analysis, and distributed processing, handling large volumes of data efficiently across clusters.&bull; &bull; work closely with various Databricks components and services to ensure seamless data integration and operational efficiency across data engineering workflows.<br>
<ul><li>foster a cohesive approach to using Apache Spark and PySpark for large-scale data processing, ensuring smooth integration and optimal performance in data pipelines.</li><li>extensive experience in big data technologies, real-time analytics, data engineering, data science, and large-scale data processing using Apache Spark and Databricks and familiarity with the Hadoop ecosystem, Kafka, and other big data technologies for end-to-end data solutions.</li></ul>
&bull; lead data engineering and machine learning projects using Databricks, leveraging its robust platform capabilities for data integration, transformation, and analytics.&bull; implement and manage security measures within Databricks, including role-based access control (RBAC) and cluster access control for granular data security and compliance.<br>
<ul><li>spearhead initiatives to optimize the performance of Spark jobs, including tuning job configurations, managing resource allocation, and improving job execution efficiency.</li><li>oversee the design, implementation, and management of complex ETL pipelines in Databricks, ensuring reliable, efficient, and scalable data workflows for various data processing needs.</li></ul></div>
</div><div><p><b>About us</b></p>
<div>UBS is a leading and truly global wealth manager and the leading universal bank in Switzerland. We also provide diversified asset management solutions and focused investment banking capabilities. Headquartered in Zurich, Switzerland, UBS is present in more than 50 markets around the globe.<br>
We know that great work is never done alone. That&rsquo;s why we place collaboration at the heart of everything we do. Because together, we&rsquo;re more than ourselves. Want to find out more? Visit ubs.com/careers.</div>
</div><div><p><b>How we hire</b></p>
<div>We may request you to complete one or more assessments during the application process. Learn more</div>
</div><div><p><b>Join us</b></p>
<div>At UBS, we know that it's our people, with their diverse skills, experiences and backgrounds, who drive our ongoing success. We&rsquo;re dedicated to our craft and passionate about putting our people first, with new challenges, a supportive team, opportunities to grow and flexible working options when possible. Our inclusive culture brings out the best in our employees, wherever they are on their career journey. And we use artificial intelligence (AI) to work smarter and more efficiently. We also recognize that great work is never done alone. That&rsquo;s why collaboration is at the heart of everything we do. Because together, we&rsquo;re more than ourselves.<br>
We&rsquo;re committed to disability inclusion and if you need reasonable accommodation/adjustments throughout our recruitment process, you can always contact us.</div>
</div><div><p><b>Contact Details</b></p>
<div>UBS Business Solutions SA<br>
UBS Recruiting</div>
</div><div><p><b>Disclaimer / Policy statements</b></p>
<div>UBS is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills and experiences within our workforce.</div></div></div></div><div></div>

Spark/Databricks/ PySpark-Software Engineer

Sierra Support Centre Pvt. Ltd

<p><b>Job Title:</b> Databricks Engineer<br/><b>Shift:</b> Night Shift<br/><b>Experience:</b> Minimum 8+ Years<br/><b>Location:</b> Coimbatore or Chennai<br/><b>Notice Period:</b> Immediate or Max 30 Days</p><p><b>Skills Needed:</b></p><ul><li>Strong Azure Databricks</li></ul><ul><li>Strong Azure Data Engineer</li></ul><p>Job Types: Full-time, Permanent</p><p>Pay: ₹1,000,000.00 - ₹2,000,000.00 per year</p><p>Application Question(s):</p><ul><li>what is your total work experience in Azure Data?</li><li>Are you fine to work in Night Shift?</li><li>Are you fine to work from Office</li></ul><p>Work Location: In person</p>

Databricks Engineer

EPAM Systems

<div><p><i>EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.</i></p><p>
We are searching for a skilled <b>Senior Data Software Engineer</b> to be part of our innovative team, working on complex projects to advance your expertise and professional growth.</p><p>
As a Senior Engineer, your role will be vital in building and implementing data solutions across diverse initiatives. The right candidate should have substantial expertise in Big Data technologies, especially Apache Spark, Python, Azure, and AWS.</p><p><b>
Responsibilities</b></p><ul><li>
Design end-to-end data solutions to address intricate business demands</li><li>
Collaborate effectively with diverse teams to analyze project requirements and deliver high-quality software solutions</li><li>
Leverage expertise in Apache Spark, Python, Azure, and AWS to develop scalable and optimized data systems</li><li>
Improve the performance, security, and scalability of data applications</li><li>
Monitor industry developments and emerging technologies to promote innovation and growth in development practices</li></ul><p><b>
Requirements</b></p><ul><li>
5-8 years of professional experience in data technologies</li><li>
Knowledge of Apache Spark with advanced proficiency</li><li>
Background in Hadoop and Hive</li><li>
Skills in Python programming</li><li>
Expertise in AWS and Azure Cloud data services</li></ul><p><b>
Technologies</b></p><ul><li>
Hadoop</li><li>
Hive</li></ul><p><b>
We offer</b></p><ul><li>
Opportunity to work on technical challenges that may impact across geographies</li><li>
Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications</li><li>
Opportunity to share your ideas on international platforms</li><li>
Sponsored Tech Talks &amp; Hackathons</li><li>
Unlimited access to LinkedIn learning solutions</li><li>
Possibility to relocate to any EPAM office for short and long-term projects</li><li>
Focused individual development</li><li>
Benefit package:<ul><li>
Health benefits</li><li>
Retirement benefits</li><li>
Paid time off</li><li>
Flexible benefits</li></ul></li><li>
Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)</li></ul></div>

Senior Data Software Engineer

Search 10000+ Hadoop software engineer jobs near you this January. New roles added regularly across leading industries. Apply today.

10000 hadoop software engineer jobs NEAR_ME

Databricks Test Engineer

Spark/Databricks/ PySpark-Software Engineer

Databricks Engineer

Senior Data Software Engineer

Senior Data Software Engineer

Senior Data Software Engineer

Senior Data Software Engineer