spark developer

BRISKWIN IT SOLUTIONS

<div><div><div>6+yrs</div>
<div></div><div>Chennai, Bangalore, Pune, Mumbai (Immediate Joiners to serving notice up to December).</div>
<div></div><div><div>Java Developer Hadoop, Java, Spark Offshore Key Responsibilities:</div>
<div></div><ul><li>Design and Development:</li></ul>
<div></div><ul><li>Design, develop, and implement scalable and robust data pipelines and applications using Apache Spark with Java.</li></ul>
<div></div><ul><li>Write efficient and optimized code for data processing, transformation, and analysis.</li></ul>
<div></div><ul><li>Develop and maintain APIs and microservices using Java or Python for integrating with various systems.</li></ul>
<div></div><ul><li>Data Management &amp; Analysis:</li></ul>
<div></div><div>&bull; Work extensively with SQL for querying, manipulating, and optimizing relational databases (e.g., PostgreSQL, MySQL, Oracle, MS SQL Server). &bull; Design and implement database schemas, stored procedures, and complex queries.</div>
<div></div><ul><li>Perform data analysis and develop insights from large datasets using Spark and relevant libraries.</li></ul>
<div></div><ul><li>Big Data Ecosystem:</li></ul>
<div></div><ul><li>Utilize and manage components within the Hadoop ecosystem (HDFS, YARN) for distributed storage and processing.</li></ul>
<div></div><ul><li>Implement and manage data ingestion and orchestration workflows (e.g., Apache Airflow, Oozie).</li></ul>
<div></div><ul><li>System Administration &amp; Scripting:</li></ul>
<div></div><ul><li>Work proficiently in Linux/Unix environments, including shell scripting for automation, system monitoring, and deployment tasks.</li></ul>
<div></div><ul><li>Manage and configure servers and cloud resources (e.g., AWS EC2, EMR).</li></ul>
<div></div><ul><li>Collaboration &amp; Best Practices:</li></ul>
<div></div><ul><li>Collaborate with data scientists, analysts, and other engineers to understand requirements and deliver solutions.</li></ul>
<div></div><ul><li>Participate in code reviews, promote best practices, and ensure code quality and maintainability.</li></ul>
<div></div><ul><li>Adhere to Agile/Scrum methodologies for software development.</li></ul>
<div></div><ul><li>Performance Optimization &amp; Troubleshooting:</li></ul>
<div></div><ul><li>Identify and resolve performance bottlenecks in Spark jobs and data pipelines.</li></ul>
<div></div><ul><li>Troubleshoot issues related to data processing, system stability, and application functionality.</li></ul>
</div></div><div><div><div><div><b>Job Location: </b>BangaloreChennaiMumbaiPune</div></div></div></div></div>

Java Spark Developer (Pls avoid big data developer profile)

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><div><b>Experience Range</b><b> - </b>4 to 10 years of experience
</div><div><b>Location</b><b> - </b>Hyderabad
</div><b>Required Technical Skill Set</b>
<div>Bigdata &ndash;Scala/Java, Spark, Hive, Unix Shell Scripting</div><br>
<div><br>
</div><div><b>Must-Have</b>
</div><div><ul><li>Hands on development experience in programming languages such as JAVA,<b>SCALA</b> using Maven, <b>Apache Spark Frameworks</b> and Unix Shell scripting</li>
<li>Should be comfortable with Unix File system as well as HDFS commands</li>
<li>Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB</li>
<li>Should be flexible</li>
<li>Should have good communication and customer management skills</li>
</ul><div><b>Good-to-Have</b>
</div>
</div><p></p><div><ul><li>Should have knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA.</li>
<li>Should be aware of the components in Big Data ecosystem.</li>
<li>Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.</li></ul><br>
</div></div></div></div><div></div><br>
<div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>IT INFRASTRUCTURE SERVICES</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>383013</div>
</div><div><div><b>Desired Skills</b></div>
<div>Big Data | Python | Scala | Spark | Hive</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : Undergraduate</div></div></div><div></div>

Big Data Developer

Cognizant Technology Solutions

<div><p>AIA-Pune<br>
<br>
<b>Experience : </b>5 to 10 Years</p><p><b>
Notice Period :</b> Immediate to 60 days<br>
<b>Mode of Interview - </b>In-Person (Pune - 13th Dec 2025)<br>
</p><p><b>Skillset:
</b></p><ul><li><p>Gen AI Engineer</p></li><li><p>
AIML Data Scientist</p></li><li><p>
MLOPS Engineer</p></li><li><p>
Azure Databricks</p></li><li><p>
MDM Specialists (Stibo / Reltio / Informatica MDM / SAP MDG/Data Quality)</p></li><li><p>
AWS Data Engineer pyspark Developer</p></li><li><p>
Python SQL Developer</p></li><li><p>
Spark, Scala Developer</p></li><li><p>
JasperReports, SQL</p></li><li><p>
OBIEE, PL/SQL Developer</p></li><li><p>
Datastage
</p></li><li><p>Pyspark Developer</p></li><li><p>
GCP Developer</p></li><li><p>
ITIL Framework with AWS</p></li></ul></div>

AIA-Pune

Recruitment Hub 365

<p><b>Job Title:</b> PySpark Developer</p><p><b>Locations:</b> Chennai, Hyderabad, Kolkata<br/><b>Work Mode:</b> Monday&ndash;Friday (5 days WFO)<br/><b>Experience:</b> 5+ years in Backend/Data Engineering<br/><b>Notice Period:</b> Immediate &ndash; 15 days<br/><b>Must-Have:</b> Python, PySpark, Amazon Redshift, PostgreSQL</p><p><b>About the Role</b></p><p>We are seeking an experienced <b>PySpark Developer</b> with strong data engineering expertise to design, develop, and optimize scalable data pipelines for large-scale data processing. The role involves working across distributed systems, ETL/ELT frameworks, cloud data platforms, and analytics-driven architecture. You will collaborate closely with cross-functional teams to ensure efficient ingestion, transformation, and delivery of high-quality data.</p><p><b>Key Responsibilities</b></p><ul><li>Design and develop robust, scalable ETL/ELT pipelines using PySpark to process data from databases, APIs, logs, and file-based sources.</li><li>Convert raw data into analysis-ready datasets for data hubs and analytical data marts.</li><li>Build reusable, parameterized Spark jobs for batch and micro-batch processing.</li><li>Optimize PySpark performance to handle large and complex datasets.</li><li>Ensure data quality, consistency, lineage, and maintain detailed documentation for all ingestion workflows.</li><li>Collaborate with Data Architects, Data Modelers, and Data Scientists to implement data ingestion logic aligned with business requirements.</li><li>Work with AWS services (S3, Glue, EMR, Redshift) for data ingestion, storage, and processing.</li><li>Support version control, CI/CD practices, and infrastructure-as-code workflows as needed.</li></ul><p><b>Must-Have Skills</b></p><ul><li>Minimum <b>5+ years</b> of data engineering experience, with a strong focus on <b>PySpark/Spark</b>.</li><li>Proven experience building ingestion frameworks for relational, semi-structured (JSON, XML), and unstructured data (logs, PDFs).</li><li>Strong Python knowledge along with key data processing libraries.</li><li>Advanced SQL proficiency (Redshift, PostgreSQL, or similar).</li><li>Hands-on experience with distributed computing platforms (Spark on EMR, Databricks, etc.).</li><li>Familiarity with workflow orchestration tools (AWS Step Functions or similar).</li><li>Strong understanding of data lake and data warehouse architectures, including core data modeling concepts.</li></ul><p><b>Good-to-Have Skills</b></p><ul><li>Experience with AWS services: Glue, S3, Redshift, Lambda, CloudWatch, etc.</li><li>Exposure to Delta Lake or similar large-scale storage frameworks.</li><li>Experience with real-time streaming tools: Spark Structured Streaming, Kafka.</li><li>Understanding of data governance, lineage, and cataloging tools (Glue Catalog, Apache Atlas).</li><li>Knowledge of DevOps and CI/CD pipelines (Git, Jenkins, etc.).</li></ul><p>Job Type: Full-time</p><p>Pay: &#8377;1,400,000.00 - &#8377;1,800,000.00 per year</p><p>Application Question(s):</p><ul><li>How many years of experience you have as Pyspark Developer?</li><li>Have you worked with Python, Amazon Redshift, PostgreSQL?</li><li>Mention your Current Location?</li><li>Mention your NP, Current CTC and ECTC.</li></ul><p>Work Location: In person</p>

PySpark Developer

<div></div><div><div><div><div><div><ul><li>Total Experience &gt; 4 Years with 3 Years of relevant Experience</li>
<li>Should have working experience in Spark/Scala</li>
<li>Should have experience in working in Bigdata Environments</li>
<li>Should have experience in AWS/Azure/GCP</li>
</ul></div></div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>383552</div>
</div><div><div><b>Desired Skills</b></div>
<div>Scala</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF ENGINEERING</div></div></div><div></div>

Scala Developer

NTT DATA

<p><b>Req ID:</b> 349373
<br>
<br>
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.<br>
<br>
We are currently seeking a Offshore Data-brics Developer to join our team in Bangalore, Karn&#257;taka (IN-KA), India (IN).<br>
<br>
Job Duties: Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark.<br>
Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver optimized solutions.<br>
Implement data transformations, cleansing, and enrichment for large datasets in cloud environments (Azure/AWS/GCP).<br>
Optimize Spark jobs for performance and cost efficiency in distributed computing environments.<br>
Ensure data security, compliance, and governance standards are met across all workflows.<br>
Troubleshoot and resolve issues related to data processing, integration, and performance bottlenecks.<br>
Develop reusable components and maintain version control using Git or similar tools.<br>
Document technical designs, workflows, and best practices for future reference and team enablement.<br>
<br>
Minimum Skills Required: Strong proficiency in Databricks, Apache Spark, and distributed data processing frameworks.<br>
Hands-on experience with Python or Scala for data engineering tasks.<br>
Solid understanding of SQL for querying and data manipulation.<br>
Experience with cloud platforms (Azure Data Lake, AWS S3, or GCP) and related services.<br>
Knowledge of ETL concepts, data warehousing, and data modeling techniques.<br>
Familiarity with CI/CD pipelines, Git, and DevOps practices for data solutions.<br>
Ability to optimize Spark jobs for performance and troubleshoot complex data issues.<br>
Good communication skills and ability to work independently in a remote environment during 2 PM - 11 PM IST shift.<br>
<br>
<b>About NTT DATA</b><br>
<br>
NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&amp;D.<br>
<br>
Whenever possible, we hire locally to NTT DATA offices or client sites. This ensures we can provide timely and effective support tailored to each client's needs. While many positions offer remote or hybrid work options, these arrangements are subject to change based on client requirements. For employees near an NTT DATA office or client site, in-office attendance may be required for meetings or events, depending on business needs. At NTT DATA, we are committed to staying flexible and meeting the evolving needs of both our clients and employees. NTT DATA recruiters will never ask for payment or banking information and will only use @nttdata.com and @talent.nttdataservices.com email addresses. If you are requested to provide payment or disclose banking information, please submit a contact us form, https://us.nttdata.com/en/contact-us.<br>
<br>
<b>NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. </b><b>This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.</b></p>

Offshore Data-brics Developer

<div><h4 class="jobSectionHeader"><b>AIA hyd drive
</b></h4><h4 class="jobSectionHeader"><b>Key Responsibilities</b></h4><ul><li>
Design, develop, and maintain scalable data pipelines using <b>Databricks</b> and <b>Apache Spark</b>.</li><li>
Write efficient <b>Python</b> code for data processing, transformation, and automation tasks.</li><li>
Integrate data from multiple sources and ensure data quality and consistency.</li><li>
Optimize Spark jobs for performance and cost efficiency in Databricks environment.</li><li>
Collaborate with data scientists, analysts, and business stakeholders to deliver data solutions.</li><li>
Implement best practices for <b>CI/CD</b>, version control, and code deployment in Databricks.</li><li>
Monitor and troubleshoot data workflows and resolve production issues.</li></ul></div>

Databricks Python

Search 4772+ Spark developer jobs near you this December. New roles added regularly across leading industries. Apply today.