hadoop developer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p>Role Hadoop developer</p>
<p>
To develop and maintain robust, scalable, and secure big data infrastructure, enabling organizations to process, analyze, and derive insights from massive datasets efficiently.</p><br>
<p></p>
<p><b>Key Responsibilities:</b></p>
<ul><li><b>Design &amp; Development:</b> Build and implement Hadoop-based applications, data pipelines, and frameworks for large datasets.</li>
<li><b>Data Processing</b><b>:</b> Write MapReduce jobs, Hive/Spark/Scala code, and use tools like Pig/NiFi for data ingestion, transformation, and analysis.</li>
<li><b>Performance Optimization</b><b>:</b> Tune and optimize Hadoop cluster performance, applications, and queries (SQL/Hive).</li>
<li><b>Cluster Management</b><b>:</b> Handle installation, configuration, monitoring, and troubleshooting of Hadoop/HBase clusters.</li>
<li><b>Collaboration:</b> Work with data analysts, scientists, and stakeholders to gather requirements and deliver solutions.</li>
<li><b>Security &amp; Compliance</b><b>:</b> Implement data security measures and ensure compliance with standards.</li>
<li><b>Documentation:</b> Produce detailed technical designs, process documentation, and best practices.</li></ul><br>
<p>
</p><p><b>Key Skills &amp; Requirements:</b></p>
<ul><li><b>Technical Expertise:</b> Strong knowledge of Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, Pig, HBase, Spark).</li>
<li><b>Programming:</b> Proficiency in Java, Scala, Python, and scripting (Pig Latin, HiveQL).</li>
<li><b>Databases:</b> Understanding of SQL, data warehousing, and database theories.</li>
<li><b>Tools:</b> Experience with big data tools like Kafka, NiFi, Elasticsearch.</li>
<li><b>Analytical Skills:</b> Strong problem-solving, analytical, and debugging abilities.</li>
<li><b>Experience:</b> Hands-on experience as a Big Data Engineer or Hadoop Developer.</li>
</ul></div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>396696</div>
</div><div><div><b>Desired Skills</b></div>
<div>Hadoop</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Hadoop developer

<div></div><div><div><div><p><div><div><div><div><p><b>Desired Competencies (Technical/Behavioral Competency</b><b>)</b></p><br>
</div></div><br>
<div><div><p><b>Must-Have**</b></p><br>
</div><div><ul><li> Strong hands-on experience of Hadoop, HIVE, Spark, PySpark, Big Data Eco System Tools.</li></ul>
<ul><li> Strong SQL experience.</li></ul>
<ul><li> Should be able to develop, tweak queries and work on performance enhancement.</li></ul>
<ul><li> Solid understanding of object-oriented programming and HDFS concepts.<br>
</li></ul></div></div><br>
<div><div><p><b>Good-to-Have</b></p><br>
</div><div><ul><li> Preferable to have good DWH/ Data Lake knowledge.</li></ul>
<ul><li> The candidate should have good DevOps and Agile Development Framework knowledge.</li></ul>
</div></div><br>
</div></div></p></div></div><div><div><div><b>Location</b></div>
<div>Bengaluru</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>397932</div>
</div><div><div><b>Desired Skills</b></div>
<div>Hadoop | Apache Spark | Hive</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF COMPUTER SCIENCE</div></div></div><div></div>

Big Data Developer

<div></div><div><div><div><div><p>1. Good understanding of Hadoop concepts including file system and Map Reduce.</p>
<p>2. Hands on experience on Spark framework, Unix scripting, Hive queries, wriring UDF in Hive. Theortical knowledge and POC alone will not suffice.</p>
<p><b>3.</b> Good knowledge in Software Development Life Cycle and Project Development Lifecycle.</p>
<b>4. </b>Associate should be able to work independently and should have strong debugging skill in both Hive and Spark. Associate should have experience developing large scale systems, experience debugging and performance tuning, excellent software design skills, communication skills and ability to work with client partners. Hands on in Apache Spark with Python or any other language (Preferred is Python -PySpark)<b>1. </b>Experience in Banking and Finance Domain.
<p><b>
2. </b>Experience in Agile Methodology</p>
<p><b>3. </b>Knowledge in job scheduling tools like Autosys.</p>
4. Knowledge in Kafka.
</div></div></div><div><div><div><b>Location</b></div>
<div>Bengaluru</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>397945</div>
</div><div><div><b>Desired Skills</b></div>
<div>BigData | Hadoop</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

Bigdata Developer

<div></div><div><div><div><p><div><div><div><div><p><b>Must-Have**</b></p><br>
</div><div><ul><li> Strong hands-on experience of Hadoop, HIVE, Spark, PySpark, Big Data Eco System Tools.</li></ul>
<ul><li> Strong SQL experience.</li></ul>
<ul><li> Should be able to develop, tweak queries and work on performance enhancement.</li></ul>
<ul><li> Solid understanding of object-oriented programming and HDFS concepts.<br>
</li></ul></div></div><br>
<div><div><p><b>Good-to-Have</b></p><br>
</div><div><ul><li> Preferable to have good DWH/ Data Lake knowledge.</li></ul>
<ul><li> &amp;n bsp; The candidate should have good DevOps and Agile Development Framework knowledge.</li></ul>
</div></div><br>
</div></div></p></div></div><div><div><div><b>Location</b></div>
<div>Chennai</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>397923</div>
</div><div><div><b>Desired Skills</b></div>
<div>Big Data | Hadoop | Hive</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Big Data

BV Teck

<div>Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations.<br>
<br>
We leverage cutting-edge big data technologies to design scalable, reliable, and high-performance data platforms. As we continue to grow, we&rsquo;re looking for a skilled <b>Big Data Developer / Engineer</b> to join our dynamic team and contribute to our mission of transforming business processes through technology.<br>
<br>
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.<br>
<br>
We are looking for <b>OPT/CPT/H4 EAD/TN/E3 or any other Non-immigrant visa people</b> who are looking for an <b>H1B sponsorship for the year 2027 quota</b>.<br>
<br>
<b>Company:</b> Bright Vision Technologies ( www.bvteck.com )<br>
<b>Job Title:</b> Big Data Developer / Engineer<br>
<b>Job Location:</b> Bridgewater, New Jersey - 08807<br>
<b>Onsite/Hybrid:</b> Remote<br>
<b>FULL-TIME ROLE WITH BRIGHT VISION</b><br>
<br>
<b>Job Description:</b><br>
<b>Environment:</b><br>
Apache Hadoop, Spark, PySpark, Scala, Kafka, HDFS, Hive, HBase, Airflow, Data Warehousing, ETL pipelines, SQL, NoSQL databases, Cloud Platforms (AWS / Azure / GCP), Big Data services (EMR, Dataproc), Docker, Linux, CI/CD pipelines, Git, Agile methodologies<br>
<br>
<b>BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES. ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE.</b><br>
For every role, a <b>coding test is required</b>, so apply only if you are <b>confident and technically strong</b>.<br>
<br>
We prefer <b>at least 3 to 5 years real time experience</b>.<br>
<br>
If you are a <b>Big Data Developer / Engineer</b> with the above skills and are looking for an <b>H1B sponsorship</b> this year, please send your resume immediately to <b>venkat.r</b><b>@bvteck.com</b>.<br>
<br>
we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know.<br>
<b>Position offered by &ldquo;No Fee agency.&rdquo;</b><p>
Equal Employment Opportunity (EEO) Statement</p>
<p>Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.</p>
<p>BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.</p><p>
</p><p>032tIsxa1F</p></div>

Big Data Developer / Engineer

<div></div><div><div><div><p><div><div><div><div><div>5+ Years of experience with Developing/Fine tuning and implementing programs/applications</div>
<div>Using Python/PySpark/Scala on Big Data/Hadoop Platform.<br>
</div></div></div><br>
<div><div><div><b>Roles and Responsibilities:<br>
</b></div></div></div><br>
<div><div><div>a) Work with a Leading Bank&rsquo;s Risk Management team on specific projects/requirements pertaining to risk Models in</div>
 <div>consumer and wholesale banking</div>
<div>b) Enhance Machine Learning Models using PySpark or Scala
</div><div>c) Work with Data Scientists to Build ML Models based on Business Requirements and Follow ML Cycle to Deploy them all</div>
<div>the way to Production Environment</div>
<div>d) Participate Feature Engineering, Training Models, Scoring and retraining</div>
<div>e) Architect Data Pipeline and Automate Data Ingestion and Model Jobs</div>
</div></div><br>
</div></div></p></div></div><div><div><div><b>Location</b></div>
<div>Bengaluru</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>397933</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python | Spark</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

Pyspark Developer

InfoBeans

<ul><li>Azure Databricks Developer</li></ul><p>Experience Required - 7 to 12 Years<br/>Location - Indore/ Pune/ Bangalore/ Chennai</p><p><b>Key Skills and Competencies</b>Azure Databricks, Python, Azure Data Factory, Azure Functions, Azure Data Lake storage, Azure Event Grid, Azure Log Analytics, Azure Monitor, Azure Service Bus, R, SQL Server, Oracle / PL-SQL, T-SQL and SQL stored procedures, Azure DevOps. <b>Qualifications</b></p><ul><li>Responsible for Administration, Configuration, and Optimization of Azure Databricks platform.</li><li>Provide technical expertise to deploy applications on the platform.</li><li>Work with data engineers, data scientists, and other stakeholders to ensure the platform meets requirements.</li><li>Proficient in Python coding and frameworks knowledge.</li><li>Manage infrastructure and collaborate with teams to integrate with all components, including network, security, and remote access.</li><li>Coordinate with SMBC Platform teams, APIM, Azure DevOps, and Support.</li><li>Configure Databricks Cluster, and Unity Catalog repository.</li><li>Integrate seamlessly with On-prem databases and Power BI reports.</li><li>Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform.</li><li>Partner with architects, engineers, information analysts, business, and technology stakeholders.</li><li>Develop and deploy enterprise grade platforms that enable data-driven solutions.</li><li>Provide technical guidance on technology implementation and architectural changes.</li><li>Analyze and design technical solutions on Azure to address business needs.</li><li>Develop, test, and modify software to improve efficiency of data platforms and applications.</li><li><b>Own projects end to end, work with business stakeholders, IT teams, data stewards, and 3rd parties to ensure accurate and insightful outcomes.</b></li></ul><ul><li>Integrate data from a variety of sources, ensure they adhere to data quality and accessibility standards.</li><li>Enable streaming data use-cases and standard design patterns in a big data environment.</li><li>Collaborate with data scientists to integrate algorithms and models into automated processes.</li><li>Apply expertise, judgment, and precedents to resolve moderately complex problems.</li><li>Review and provide feedback on core code changes and support production deployment.</li><li>Ability to migrate the Data Science models written on native python language to the multi node Databricks compute is desirable.</li><li>IT professional experience in Azure Cloud with over 7+ years of Azure Development.</li><li>Ability to recreate existing legacy application logic and functionality into Azure Databricks/Data Lake, SQL Database, and SQL Datawarehouse.</li><li>Excellent interpersonal and communication skills.</li><li>Experience with software configuration management tools such as Git/Gitlab.</li><li>Experience with continuous integration and deployment (CI/CD) tools such as Azure DevOps.Recommendations:OFFTimeline</li></ul><p>Job Types: Full-time, Permanent</p><p>Benefits:</p><ul><li>Health insurance</li><li>Provident Fund</li></ul><p>Work Location: Hybrid remote in Pune, Maharashtra (Pune)</p>

Databricks Developer

Search 2807+ Hadoop developer jobs near you this March. New roles added regularly across leading industries. Apply today.