big data software engineer

Randstad Türkiye

<div>
 <p>
  We are looking for a
  <strong>
   "Senior - Mid Big Data Engineer
  </strong>
  " on behalf of our global business partner runs in
  <em>
   Telecommunications
  </em>
  Industry.
 </p>
 <p>
  <br/>
 </p>
 <p>
  About Role
 </p>
 <p>
  <br/>
 </p>
 <p>
  We are looking for a
  <strong>
   Senior&ndash;Mid Big Data Engineer
  </strong>
  to join our delivery-focused Big Data team. This role is fully aligned with production data migration and Big Data service deployment activities.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Key Responsibilities
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Execute data migration projects, ensuring data accuracy, performance, and operational stability.
  </li>
  <li>
   Deploy, configure, and operate Big Data services and platforms in live production environments.
  </li>
  <li>
   Install, configure, and maintain Big Data clusters, including Hadoop ecosystem components (HDFS, Hive, Spark, Flink, MapReduce).
  </li>
  <li>
   Perform DWS (Data Warehouse Service) deployments, including setup, configuration, tuning, and post-deployment support.
  </li>
  <li>
   Design, implement, and maintain ETL/ELT pipelines for production Data Warehouses and Data Lakes.
  </li>
  <li>
   Optimize and troubleshoot batch processing workloads using Hive, Spark, and related technologies.
  </li>
  <li>
   Implement and support data ingestion pipelines, including real-time components where applicable.
  </li>
  <li>
   Provide on-site and remote delivery support to international customers during deployment and migration phases.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   Requirements
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <em>
    Required Qualifications
   </em>
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   BSc or MSc degree in Computer Engineering, Computer Science, Software Engineering, or a related technical discipline.
  </li>
  <li>
   4&ndash;8 years of professional experience in Big Data Engineering, with a strong focus on delivery, data migration, and production operations.
  </li>
  <li>
   Strong experience with Spark, Flink, Hadoop, and related Big Data technologies.
  </li>
  <li>
   Proficiency in Python or Java.
  </li>
  <li>
   Solid experience with SQL development (MySQL, PostgreSQL).
  </li>
  <li>
   Hands-on experience with batch processing using Hive and Spark.
  </li>
  <li>
   Strong understanding of Data Warehouse and Data Lake architectures.
  </li>
  <li>
   Experience working in Unix/Linux environments.
  </li>
  <li>
   Ability to work in production environments with high availability and performance requirements.
  </li>
  <li>
   Strong communication skills in international delivery teams.
  </li>
  <li>
   Fluency in written and spoken English is mandatory.
  </li>
  <li>
   Willingness and flexibility to travel internationally.
  </li>
  <li>
   Strong sense of ownership for end-to-end delivery and production stability.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <em>
    Nice to Have
   </em>
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Experience with real-time ingestion systems such as Kafka or RabbitMQ.
  </li>
  <li>
   Experience with monitoring, alerting, and performance tuning of Big Data platforms.
  </li>
  <li>
   Exposure to cloud-native Big Data services.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   <em>
    Seniority Expectations
   </em>
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <ul>
  <li>
   Solid understanding of ETL/ELT methodologies and production best practices.
  </li>
  <li>
   Proven ability to design, deploy, and operate complex data pipelines in live environments.
  </li>
  <li>
   Ability to independently own delivery activities, guide implementation decisions, and mentor junior engineers.
  </li>
 </ul>
</div>


Big Data Engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p><b>Must Have:</b></p>
<div>
<ul><li><b>Hands-on Experience in ETL t</b>esting with knowledge on Data Warehouse, Data Lake ETL Testing application</li></ul>
<ul><li>Solid expertise in working with ETL / Databricks testing, Informatica tools (IDMC)</li></ul>
<ul><li>Experience with big data technologies (Spark, PySpark, Delta Lake).</li></ul>
<ul><li>Knowledge of data modeling, data quality frameworks, and BI tools</li></ul>
<ul><li>Good Knowledge in Test data articulation
</li></ul></div><p>Good to have ETL &amp; SQL work experience, Databricks, Teradata.</p>
<p><b>Worked on design and development of any digital dashboard preferred</b></p>
<p>Experience with Datawarehouse Automation testing, SQL and test data creation.</p>
<div><ul><li>Good experience in Agile Software Testing Lifecycle</li></ul>
<ul><li>Should have worked on data warehouse projects with good exposure to database technologies like Hadoop, Teradata, Snowflake.</li></ul></div><p><br>
</p></div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Engineer</div>
</div><div><div><b>Job Id</b></div>
<div>387014</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python | Spark | ETL Testing</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Databricks Test Engineer

APPTESTIFY GLOBAL SERVICES PVT LTD

<p><b>Role: Databricks Engineer</b></p><p><b>Location:</b> Remote<br/><b>Experience:</b> 5+ Years</p><p><b>About the Role:</b></p><p>We are looking for an experienced <b>Databricks Engineer</b> with strong expertise in big data processing and analytics. The ideal candidate will work closely with data engineers, data scientists, and business stakeholders to design, develop, and optimize scalable data solutions using Databricks.</p><p><b>Key Responsibilities:</b></p><ul><li>Design, develop, and maintain scalable data pipelines using <b>Databricks</b></li><li>Work with <b>Apache Spark (PySpark/Scala)</b> for large-scale data processing</li><li>Optimize Databricks jobs for performance, cost, and reliability</li><li>Integrate data from multiple sources (structured &amp; unstructured)</li><li>Implement data transformation, cleansing, and validation processes</li><li>Collaborate with cross-functional teams to deliver data-driven solutions</li><li>Ensure data quality, security, and governance best practices</li><li>Troubleshoot and resolve data pipeline and performance issues</li></ul><p><b>Required Skills &amp; Qualifications:</b></p><ul><li>5+ years of experience in <b>Data Engineering / Big Data</b> roles</li><li>Strong hands-on experience with <b>Databricks</b></li><li>Proficiency in <b>Apache Spark, PySpark, or Scala</b></li><li>Experience with <b>SQL</b> and data modeling concepts</li><li>Familiarity with cloud platforms (<b>Azure / AWS / GCP</b>)</li><li>Experience working with <b>ETL/ELT pipelines</b></li><li>Knowledge of data lakes, Delta Lake, and big data ecosystems</li><li>Good understanding of data warehousing and analytics concepts</li></ul><p><b>Nice to Have:</b></p><ul><li>Databricks certifications</li><li>Experience with <b>Delta Live Tables</b> and <b>Unity Catalog</b></li><li>Exposure to CI/CD for data pipelines</li><li>Experience supporting analytics and ML workloads</li></ul><p>Job Types: Full-time, Contractual / Temporary<br/>Contract length: 12 months</p><p>Pay: ₹70,000.00 - ₹80,000.00 per month</p><p>Work Location: Remote</p>

Databricks Engineer/5+ years/Remote

<div><div><div><div>India</div>
</div><div><div>Information Technology (IT)
</div></div><div><div>Group Functions
</div></div><div><p><b>Job Reference #</b></p>
<div>332687BR</div>
</div><div><p><b>City</b></p>
<div>Hyderabad, Pune</div>
</div><div><p><b>Job Type</b></p>
<div>Full Time
</div></div><div><p><b>Your role</b></p>
<div>We&rsquo;re looking for a Reporting/Data engineering software engineer :<br>
<br>
<ul><li>with over 11 years of experience in the field of Apache Spark, Databricks, and PySpark, you will be responsible for leading a team of 5-7 technical experts. Your role will encompass a broad spectrum of technical skills, focusing on big data processing, data engineering, and related technologies. The ideal candidate will possess deep expertise in Spark job optimization, data modeling, and performance tuning within the Databricks environment. Additionally, proficiency in Python programming, advanced data integration, and SDLC (Software Development Life Cycle) processes is crucial.</li></ul>
Qualifications and Skills:<br>
<ul><li>bachelor&rsquo;s/Masters degree in Computer Science, Data Science, or a related field.</li><li>proven experience leading and managing technical teams.</li></ul>
Soft Skills:<br>
<ul><li>excellent leadership and team management abilities.</li><li>effective communication skills to convey technical concepts to both technical and non-technical stakeholders.</li><li>analytical and problem-solving mindset.</li><li>proactive in staying abreast of industry trends and emerging technologies.</li></ul></div>
</div><div><p><b>Your team</b></p>
<div>You&rsquo;ll be working in Finance IT in Pune. We provide excellent exposure to latest technologies and ability to &lsquo;make a mark&rsquo; in our delivery team. It benefits our clients with greater insights into their business and provides extra agility in change. As a Software Engineer you&rsquo;ll play an important role in achieving important change milestones.<br>
<br>
We are results-oriented, multi-cultural group and would welcome you on the Azure World journey with us.</div>
</div><div><p><b>Your expertise</b></p>
<div>&bull; employ Python and PySpark to perform advanced data manipulation, analysis, and distributed processing, handling large volumes of data efficiently across clusters.&bull; &bull; work closely with various Databricks components and services to ensure seamless data integration and operational efficiency across data engineering workflows.<br>
<ul><li>foster a cohesive approach to using Apache Spark and PySpark for large-scale data processing, ensuring smooth integration and optimal performance in data pipelines.</li><li>extensive experience in big data technologies, real-time analytics, data engineering, data science, and large-scale data processing using Apache Spark and Databricks and familiarity with the Hadoop ecosystem, Kafka, and other big data technologies for end-to-end data solutions.</li></ul>
&bull; lead data engineering and machine learning projects using Databricks, leveraging its robust platform capabilities for data integration, transformation, and analytics.&bull; implement and manage security measures within Databricks, including role-based access control (RBAC) and cluster access control for granular data security and compliance.<br>
<ul><li>spearhead initiatives to optimize the performance of Spark jobs, including tuning job configurations, managing resource allocation, and improving job execution efficiency.</li><li>oversee the design, implementation, and management of complex ETL pipelines in Databricks, ensuring reliable, efficient, and scalable data workflows for various data processing needs.</li></ul></div>
</div><div><p><b>About us</b></p>
<div>UBS is a leading and truly global wealth manager and the leading universal bank in Switzerland. We also provide diversified asset management solutions and focused investment banking capabilities. Headquartered in Zurich, Switzerland, UBS is present in more than 50 markets around the globe.<br>
We know that great work is never done alone. That&rsquo;s why we place collaboration at the heart of everything we do. Because together, we&rsquo;re more than ourselves. Want to find out more? Visit ubs.com/careers.</div>
</div><div><p><b>How we hire</b></p>
<div>We may request you to complete one or more assessments during the application process. Learn more</div>
</div><div><p><b>Join us</b></p>
<div>At UBS, we know that it's our people, with their diverse skills, experiences and backgrounds, who drive our ongoing success. We&rsquo;re dedicated to our craft and passionate about putting our people first, with new challenges, a supportive team, opportunities to grow and flexible working options when possible. Our inclusive culture brings out the best in our employees, wherever they are on their career journey. And we use artificial intelligence (AI) to work smarter and more efficiently. We also recognize that great work is never done alone. That&rsquo;s why collaboration is at the heart of everything we do. Because together, we&rsquo;re more than ourselves.<br>
We&rsquo;re committed to disability inclusion and if you need reasonable accommodation/adjustments throughout our recruitment process, you can always contact us.</div>
</div><div><p><b>Contact Details</b></p>
<div>UBS Business Solutions SA<br>
UBS Recruiting</div>
</div><div><p><b>Disclaimer / Policy statements</b></p>
<div>UBS is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills and experiences within our workforce.</div></div></div></div><div></div>

Spark/Databricks/ PySpark-Software Engineer

Cognizant Technology Solutions

<div><p><b>Job Title: - GCP Data Engineer with Big Query
</b><br>
<b>Location: - AIA Pune</b><br>
<b>Job Type 3 days from office (Hybrid)</b></p><p><b>
Minimum 6 to 13 years of experience</b></p><p><b>
Mandatory Skills:</b> GCP Services &ndash; Big Query, Cloud SQL, Data flow<br>
Around 7+ years of experience in development in Data warehousing projects in GCP platforms,<br>
Good understanding of dimensional modelling<br>
Expertise in MySQL &amp; SQL/PL<br>
GCP &amp; BigQuery knowledge is must, GCP certification is added advantage<br>
Good experience in Cloud Composer, DAGs , airflow<br>
REST API development experience<br>
Good in analytical and problem solving, efficient communication<br>
Ability to lead the team members, convert requirements into technical solutions, assign the work, coordinate the team and review the deliverables and ensure on schedule.</p></div>

GCP Data Engineer with Big Query

<div></div><div><div><div><div><ul><li>Strong proficiency in <b>Python</b> programming.</li>
<li>Hands-on experience with <b>PySpark</b> and <b>Apache Spark</b>.</li>
<li>Knowledge of <b>Big Data</b> technologies (Hadoop, Hive, Kafka, etc.).</li>
<li>Experience with <b>SQL</b> and relational/non-relational databases.</li>
<li>Familiarity with <b>distributed computing</b> and <b>parallel processing</b>.</li>
<li>Understanding of <b>data engineering</b> best practices.</li>
<li>Experience with <b>REST APIs</b>, <b>JSON/XML</b>, and data serialization.</li></ul><br>
<br>
</div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>385715</div>
</div><div><div><b>Desired Skills</b></div>
<div>Digital : PySpark | Python</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Python/Pyspark, Bigquery with GCP

Siemens

<div><div><div><div><div><div><b>Job ID
</b></div><div>488167
</div></div><div><div><b>Posted since
</b></div><div>18-Dec-2025
</div></div><div><div><b>Organization
</b></div><div>Digital Industries
</div></div><div><div><b>Field of work
</b></div><div>Internal Services
</div></div><div><div><b>Company
</b></div><div>Siemens Industry Software (India) Private Limited
</div></div><div><div><b>Experience level
</b></div><div>Mid-level Professional
</div></div><div><div><b>Job type
</b></div><div>Full-time
</div></div><div><div><b>Work mode
</b></div><div>Office/Site only
</div></div><div><div><b>Employment type
</b></div><div>Permanent
</div></div><div><div><b>Location(s)
</b></div><div><ul><li>Pune - Maharashtra - India
</li></ul></div></div></div></div></div><div><div><div><div><div><div>We are a leading global software company dedicated to the world of computer aided design, 3D modeling and simulation&mdash; helping innovative global manufacturers design better products, faster! With the resources of a large company, and the energy of a software start-up, we have fun together while creating a world class software portfolio. Our culture encourages creativity, welcomes fresh thinking, and focuses on growth, so our people, our business, and our customers can achieve their full potential.<br>
<br>
Are you passionate about designing elegant data architectures that solve complex business challenges? Do you excel at creating unified data ecosystems from disparate sources? Are you a guide in cloud data platforms like Snowflake? Do you enjoy establishing data standards that drive organizational excellence?<br>
<br>
Then you are the perfect candidate to join our Software business as a Data Architect in our innovative data-driven Customer Success team.<br>
<br>
Position Overview<br>
<br>
You will join a newly formed data science team tasked with developing a sophisticated customer health scoring system that provides immediate return on investment by delivering critical insights to our Sales and Customer Success teams. As the Data Engineer, you will be the foundation of this initiative&mdash;designing the data aggregation and storage architecture that allows us to transform fragmented data sources into a unified, reliable platform for analysis and AI-driven automation.<br>
<br>
In this role, you'll work with data scientists and system owners across teams to create a robust infrastructure that supports advanced analytics while ensuring data integrity, security, and scalability. You will apply your expertise in Snowflake to onboard data products that can be easily consumed by various collaborators. And you will help create a robust governance framework that keeps data processes aligned across the business.<br>
<br>
This is the perfect role for you if you have deep expertise in data architecture, particularly with Snowflake, and a passion for creating organized, efficient data structures that enable powerful insights. You'll be establishing the technical foundation upon which our entire Customer Health Index system will be built.<br>
<br>
This role will be instrumental in establishing proper data management practices across our SaaS portfolio. Your work will enable a truly data-driven approach to customer success and set standards for data integration across the organization.<br>
<br>
Responsibilities<br>
<br>
</div><div><ul><li>Design and implement comprehensive data aggregation and storage architecture for a customer health scoring initiative</li><li>Serve as the primary Snowflake expert, optimizing our use of the platform over time</li><li>Establish data integration patterns to bring together disparate data sources into a cohesive structure</li><li>Create data models and schemas that support efficient analytics and reporting</li><li>Develop data governance frameworks to ensure the quality, consistency, and security of our data business processes</li><li>Build scalable data architectures that can accommodate growing volumes of data and changing requirements</li><li>Define naming conventions, metadata standards, and documentation practices</li><li>Work with data owners across the organization to onboard their systems</li><li>Develop a complete deployment pipeline from development to staging to production</li><li>Implement data quality controls and validation processes</li><li>Collaborate with Data Scientists to ensure the architecture supports sophisticated analytical models</li><li>Provide architectural guidance to BI Analysts implementing the integrations and processes</li></ul></div><div><br>
<br>
Work Environment<br>
<br>
</div><div><ul><li>This job is a hybrid role that requires you to be in the Siemens Pune office for at least three days each week.</li><li>You must work according to the US time zones for at least three days each week.</li></ul></div><div><br>
<br>
Required Knowledge/Skills, Education, and Experience<br>
<br>
</div><div><ul><li>Master's degree in Computer Science, Data Engineering, Information Systems, or related field.</li><li>5+ years of proven experience in data architecture, data engineering, or similar roles</li><li>Extensive expertise with Snowflake, including data modeling, performance optimization, and security features</li><li>Strong understanding of data warehouse design principles and dimensional modeling</li><li>Experience designing and implementing ETL/ELT processes for large-scale data integration</li><li>Experience creating infrastructures that connect Snowflake data to AI applications</li><li>Proficiency in SQL and data modeling techniques</li><li>Knowledge of Python or other programming languages for data processing</li><li>Experience with data governance, quality management, and metadata frameworks</li><li>Understanding of SaaS business models and related data structures</li><li>Excellent communication and stakeholder management skills</li><li>Ability to translate business requirements into effective technical solutions</li><li>Self-motivated with strong organizational skills to establish proper data practices from the ground up</li></ul></div><div><br>
<br>
Preferred Qualifications<br>
<br>
</div><div><ul><li>Snowflake certification(s)</li><li>Knowledge of dbt or similar data transformation tools</li><li>Background in implementing data architectures for customer success or sales analytics</li><li>Experience with data virtualization and API-based integration approaches</li><li>Familiarity with Salesforce CRM and Certinia data structures</li><li>Experience working with global, distributed teams</li><li>Background in establishing data architecture practices in organizations with limited data maturity</li></ul></div><div><br>
<br>
We offer a role with responsibility, independence, and the possibility to contribute proactively. You'll be joining an energetic and dynamic team of data and SaaS experts with a highly innovative approach. We foster a teamwork culture with room for individual development and impact, allowing you to establish architectural standards that will shape our data-driven future.<br>
<br>
Why us?<br>
<br>
Working at Siemens Software means flexibility - Choosing between working at home and the office at other times is the norm here. We offer great benefits and rewards, as you'd expect from a world leader in industrial software.<br>
<br>
A collection of over 377,000 minds building the future, one day at a time in over 200 countries. We're dedicated to equality, and we welcome applications that reflect the diversity of the communities we work in. All employment decisions at Siemens are based on qualifications, merit, and business need. Bring your curiosity and creativity and help us shape tomorrow!<br>
<br>
Siemens Software. Transform the Everyday<br>
<br>
#LI-PLM<br>
<br>
#LI-Hybrid<br>
<br>
#SWSaaS</div></div></div></div></div></div></div><p></p>

Snowflake Data Engineer for Customer Success

Search 10000+ Big data software engineer jobs near you this January. New roles added regularly across leading industries. Apply today.