big data developer

Tata Consultancy Services (TCS)

<div></div><div><div><div><p><div><div><div><div><p><b>Desired Competencies (Technical/Behavioral Competency</b><b>)</b></p><br>
</div></div><br>
<div><div><p><b>Must-Have**</b></p><br>
</div><div><ul><li> Strong hands-on experience of Hadoop, HIVE, Spark, PySpark, Big Data Eco System Tools.</li></ul>
<ul><li> Strong SQL experience.</li></ul>
<ul><li> Should be able to develop, tweak queries and work on performance enhancement.</li></ul>
<ul><li> Solid understanding of object-oriented programming and HDFS concepts.<br>
</li></ul></div></div><br>
<div><div><p><b>Good-to-Have</b></p><br>
</div><div><ul><li> Preferable to have good DWH/ Data Lake knowledge.</li></ul>
<ul><li> The candidate should have good DevOps and Agile Development Framework knowledge.</li></ul>
</div></div><br>
</div></div></p></div></div><div><div><div><b>Location</b></div>
<div>Bengaluru</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>397932</div>
</div><div><div><b>Desired Skills</b></div>
<div>Hadoop | Apache Spark | Hive</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF COMPUTER SCIENCE</div></div></div><div></div>

Big Data Developer

BV Teck

<div>Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations.<br>
<br>
We leverage cutting-edge big data technologies to design scalable, reliable, and high-performance data platforms. As we continue to grow, we&rsquo;re looking for a skilled <b>Big Data Developer / Engineer</b> to join our dynamic team and contribute to our mission of transforming business processes through technology.<br>
<br>
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.<br>
<br>
We are looking for <b>OPT/CPT/H4 EAD/TN/E3 or any other Non-immigrant visa people</b> who are looking for an <b>H1B sponsorship for the year 2027 quota</b>.<br>
<br>
<b>Company:</b> Bright Vision Technologies ( www.bvteck.com )<br>
<b>Job Title:</b> Big Data Developer / Engineer<br>
<b>Job Location:</b> Bridgewater, New Jersey - 08807<br>
<b>Onsite/Hybrid:</b> Remote<br>
<b>FULL-TIME ROLE WITH BRIGHT VISION</b><br>
<br>
<b>Job Description:</b><br>
<b>Environment:</b><br>
Apache Hadoop, Spark, PySpark, Scala, Kafka, HDFS, Hive, HBase, Airflow, Data Warehousing, ETL pipelines, SQL, NoSQL databases, Cloud Platforms (AWS / Azure / GCP), Big Data services (EMR, Dataproc), Docker, Linux, CI/CD pipelines, Git, Agile methodologies<br>
<br>
<b>BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES. ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE.</b><br>
For every role, a <b>coding test is required</b>, so apply only if you are <b>confident and technically strong</b>.<br>
<br>
We prefer <b>at least 3 to 5 years real time experience</b>.<br>
<br>
If you are a <b>Big Data Developer / Engineer</b> with the above skills and are looking for an <b>H1B sponsorship</b> this year, please send your resume immediately to <b>venkat.r</b><b>@bvteck.com</b>.<br>
<br>
we are committed to providing equal employment opportunities and fostering an inclusive work environment. We encourage applications from all qualified individuals regardless of race, ethnicity, religion, gender identity, sexual orientation, age, disability, or any other protected status. If you require accommodations during the recruitment process, please let us know.<br>
<b>Position offered by &ldquo;No Fee agency.&rdquo;</b><p>
Equal Employment Opportunity (EEO) Statement</p>
<p>Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.</p>
<p>BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.</p><p>
</p><p>032tIsxa1F</p></div>

Big Data Developer / Engineer

ImagineArt

<div><h3 class="jobSectionHeader"><b>Who We Are</b></h3><p>
Vyro is redefining the future of digital creativity. We build cutting-edge content creation tools powered by Artificial Intelligence and Machine Learning, helping millions of creators, designers, and storytellers bring their imagination to life &mdash; effortlessly.</p><p>
With a global user base of over 5 million active creators every month, Vyro&rsquo;s 20+ AI-powered apps are transforming how people design, edit, and express themselves across images, videos, and beyond.</p><p>
From intuitive AI photo editors to next-gen video creation platforms, our products are designed to make creativity accessible, fast, and limitless.</p><p>
At Vyro, we&rsquo;re a team of innovators, builders, and dreamers &mdash; known as Vyronauts &mdash; driven by passion, purpose, and the belief that technology should inspire creativity, not complicate it.</p><p>
If you&rsquo;re excited about shaping the next wave of AI-powered creativity, Vyro is the place to be.<br>
<br>
<b>Overview</b></p><p>
We are seeking a highly experienced <b>Senior Big Data Developer</b> to design, build, and optimize large-scale data systems and backend infrastructure. The ideal candidate will have strong expertise in <b>BigQuery, distributed data processing, and cloud-based data platforms</b>, and will play a critical role in developing scalable data pipelines and backend services that support analytics, AI, and product systems.</p><p>
This role requires deep technical expertise in handling large datasets, optimizing data workflows, and building reliable, production-grade data infrastructure.</p><p></p><h2 class="jobSectionHeader"><b>
Responsibilities</b></h2><ul><li><p>
Design, build, and maintain scalable data pipelines and backend systems for processing large-scale datasets<br>
Develop, optimize, and manage complex queries, datasets, and workflows in BigQuery and data warehouse systems</p></li><li><p>
Build robust ETL/ELT pipelines to ingest, transform, and process data from multiple sources</p></li><li><p>
Develop backend services and data processing systems using languages such as Go, Python.</p></li><li><p>
Ensure high performance, scalability, reliability, and cost efficiency of data systems</p></li><li><p>
Integrate data systems with cloud services, APIs, and distributed systems</p></li><li><p>
Monitor, troubleshoot, and optimize data pipelines and backend infrastructure</p></li><li><p>
Collaborate with data scientists, analysts, and engineering teams to support analytics and AI-driven features</p></li><li><p>
Design clean, efficient, and maintainable system architecture</p></li><li><p>
Mentor junior engineers and contribute to technical leadership and architectural decisions</p></li></ul><p><b>
Requirements</b></p><ul><li><p>
5+ years of experience in Big Data, backend engineering, or data infrastructure roles</p></li><li><p>
Strong hands-on experience with BigQuery or similar data warehouse technologies (Snowflake, Redshift, Databricks, etc.)</p></li><li><p>
Strong proficiency in at least one programming language such as Go, Python, Node.js, or Java</p></li><li><p>
Strong expertise in SQL and query performance optimization</p></li><li><p>
Experience building and maintaining ETL/ELT pipelines</p></li><li><p>
Experience working with large-scale datasets and distributed systems</p></li><li><p>
Experience with cloud platforms such as Google Cloud Platform (preferred), AWS, or Azure</p></li><li><p>
Strong understanding of data architecture, scalability, and performance optimization</p></li><li><p>
Excellent problem-solving and debugging skills</p></li></ul><p><b>
Preferred Qualifications</b></p><ul><li><p>
Experience with GCP services such as BigQuery, Cloud Storage, Pub/Sub, and Cloud Run</p></li><li><p>
Experience with Apache Spark, Kafka, or Airflow</p></li><li><p>
Experience supporting analytics, AI, or machine learning systems</p></li><li><p>
Experience with real-time and batch data processing systems</p></li><li><p>
Experience with microservices architecture</p></li></ul></div><p></p>

Senior Big Data Developer

<div></div><div><div><div><div><p>Role Hadoop developer</p>
<p>
To develop and maintain robust, scalable, and secure big data infrastructure, enabling organizations to process, analyze, and derive insights from massive datasets efficiently.</p><br>
<p></p>
<p><b>Key Responsibilities:</b></p>
<ul><li><b>Design &amp; Development:</b> Build and implement Hadoop-based applications, data pipelines, and frameworks for large datasets.</li>
<li><b>Data Processing</b><b>:</b> Write MapReduce jobs, Hive/Spark/Scala code, and use tools like Pig/NiFi for data ingestion, transformation, and analysis.</li>
<li><b>Performance Optimization</b><b>:</b> Tune and optimize Hadoop cluster performance, applications, and queries (SQL/Hive).</li>
<li><b>Cluster Management</b><b>:</b> Handle installation, configuration, monitoring, and troubleshooting of Hadoop/HBase clusters.</li>
<li><b>Collaboration:</b> Work with data analysts, scientists, and stakeholders to gather requirements and deliver solutions.</li>
<li><b>Security &amp; Compliance</b><b>:</b> Implement data security measures and ensure compliance with standards.</li>
<li><b>Documentation:</b> Produce detailed technical designs, process documentation, and best practices.</li></ul><br>
<p>
</p><p><b>Key Skills &amp; Requirements:</b></p>
<ul><li><b>Technical Expertise:</b> Strong knowledge of Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, Pig, HBase, Spark).</li>
<li><b>Programming:</b> Proficiency in Java, Scala, Python, and scripting (Pig Latin, HiveQL).</li>
<li><b>Databases:</b> Understanding of SQL, data warehousing, and database theories.</li>
<li><b>Tools:</b> Experience with big data tools like Kafka, NiFi, Elasticsearch.</li>
<li><b>Analytical Skills:</b> Strong problem-solving, analytical, and debugging abilities.</li>
<li><b>Experience:</b> Hands-on experience as a Big Data Engineer or Hadoop Developer.</li>
</ul></div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>396696</div>
</div><div><div><b>Desired Skills</b></div>
<div>Hadoop</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Hadoop developer

<div></div><div><div><div><p><div><div><div><div><p><b>Must-Have**</b></p><br>
</div><div><ul><li> Strong hands-on experience of Hadoop, HIVE, Spark, PySpark, Big Data Eco System Tools.</li></ul>
<ul><li> Strong SQL experience.</li></ul>
<ul><li> Should be able to develop, tweak queries and work on performance enhancement.</li></ul>
<ul><li> Solid understanding of object-oriented programming and HDFS concepts.<br>
</li></ul></div></div><br>
<div><div><p><b>Good-to-Have</b></p><br>
</div><div><ul><li> Preferable to have good DWH/ Data Lake knowledge.</li></ul>
<ul><li> &amp;n bsp; The candidate should have good DevOps and Agile Development Framework knowledge.</li></ul>
</div></div><br>
</div></div></p></div></div><div><div><div><b>Location</b></div>
<div>Chennai</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>397923</div>
</div><div><div><b>Desired Skills</b></div>
<div>Big Data | Hadoop | Hive</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Big Data

Kandor people

<p>​<b>Job Title: Scala Developer (4&ndash;10 Years Exp)</b></p><p>​<b>Company:</b> Tata Consultancy Services (TCS)</p><p><b>Location:</b> Bangalore, Chennai, Hyderabad, Pune, Kolkata</p><p><b>Job Type:</b> Full-Time</p><p>​<b>Job Summary</b></p><p>​We are looking for a highly skilled and experienced <b>Scala Developer</b> to join our engineering team. You will be responsible for designing and developing high-performance, distributed applications and big data pipelines. The ideal candidate has a deep understanding of functional programming and experience working within the Hadoop/Spark ecosystem to deliver scalable enterprise solutions.</p><p>​<b>Key Responsibilities</b></p><ul><li>​<b>Design &amp; Development:</b> Build and maintain scalable, high-performance backend services and data pipelines using <b>Scala</b> and <b>Apache Spark</b>.</li><li>​<b>Architecture:</b> Participate in the design of distributed systems, ensuring high availability, reliability, and low latency.</li><li>​<b>Code Quality:</b> Write clean, testable, and maintainable code following functional programming principles. Perform rigorous code reviews and unit testing (using ScalaTest or MUnit).</li><li>​<b>Optimization:</b> Debug and tune Spark jobs and SQL queries to optimize performance for large-scale data processing.</li><li>​<b>Collaboration:</b> Work closely with Data Scientists, Architects, and cross-functional teams in an <b>Agile/Scrum</b> environment to translate business requirements into technical specs.</li></ul><p>​<b>Technical Skills Required</b></p><ul><li>​<b>Core Language:</b> Strong proficiency in <b>Scala</b> (Object-Oriented &amp; Functional Programming).</li><li>​<b>Big Data Stack:</b> Extensive experience with <b>Apache Spark (Spark SQL, Streaming)</b>, Hadoop, Hive, and HDFS.</li><li>​<b>Frameworks:</b> Knowledge of <b>Akka, Play Framework</b>, or effect systems like <b>Cats/ZIO</b> is a plus.</li><li>​<b>Data Stores:</b> Proficiency in SQL (PostgreSQL/Oracle) and NoSQL (Cassandra/HBase/MongoDB).</li><li>​<b>Cloud &amp; DevOps:</b> Experience with <b>AWS/Azure/GCP</b> services. Familiarity with Docker, Kubernetes, and CI/CD pipelines (Jenkins/GitLab).</li><li>​<b>Streaming:</b> Experience with messaging systems like <b>Apache Kafka</b>.</li></ul><p>​<b>Desired Candidate Profile</b></p><ul><li>​<b>Experience:</b> 4 to 10 years of professional software development experience, with at least 3+ years dedicated to Scala.</li><li>​<b>Education:</b> B.E. / B.Tech / M.E. / M.Tech / MCA from a recognized university.</li><li>​<b>Soft Skills:</b> Strong analytical and problem-solving skills; excellent communication and ability to work in a global team environment.</li></ul><p>Job Type: Full-time</p><p>Work Location: In person</p>

Scala Developer

<div></div><div><div><div><p><div><div><div><div><div>5+ Years of experience with Developing/Fine tuning and implementing programs/applications</div>
<div>Using Python/PySpark/Scala on Big Data/Hadoop Platform.<br>
</div></div></div><br>
<div><div><div><b>Roles and Responsibilities:<br>
</b></div></div></div><br>
<div><div><div>a) Work with a Leading Bank&rsquo;s Risk Management team on specific projects/requirements pertaining to risk Models in</div>
 <div>consumer and wholesale banking</div>
<div>b) Enhance Machine Learning Models using PySpark or Scala
</div><div>c) Work with Data Scientists to Build ML Models based on Business Requirements and Follow ML Cycle to Deploy them all</div>
<div>the way to Production Environment</div>
<div>d) Participate Feature Engineering, Training Models, Scoring and retraining</div>
<div>e) Architect Data Pipeline and Automate Data Ingestion and Model Jobs</div>
</div></div><br>
</div></div></p></div></div><div><div><div><b>Location</b></div>
<div>Bengaluru</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>397933</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python | Spark</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

Pyspark Developer

Search 10000+ Big data developer jobs near you this March. New roles added regularly across leading industries. Apply today.