big data software engineer

<div><p>At CGI, we&rsquo;re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve. At CGI, we&rsquo;re a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve results for our clients - and for our members. Come grow with us. Learn more at www.cgi.com.<br>
<br>
This is a great opportunity to join a winning team. CGI offers a competitive compensation package with opportunities for growth and professional development. Benefits for full-time, permanent members start on the first day of employment and include a paid time-off program and profit participation and stock purchase plans. We wish to thank all applicants for their interest and effort in applying for this position, however, only candidates selected for interviews will be contacted. No unsolicited agency referrals please.<br>
<br>
Job Title: Big Data Engineer
<br>
Position: Senior Software Engineer / Lead Analyst
<br>
Experience: 5-10 Years<br>
Category: Software Development/ Engineering<br>
Main location: India, Bangalore / Pune /Hyderabad / Chennai<br>
Position ID: J0725-2122
<br>
Employment Type: Full Time</p><p><b>
Your future duties and responsibilities</b></p><ul><li>Design and develop scalable data engineering solutions using Google Cloud Platform (GCP) and PySpark.</li><li>Optimize Spark jobs for performance, scalability, and efficient resource utilization.</li><li>Develop, maintain, and enhance ETL pipelines using BigQuery, Apache Airflow, and Cloud Composer.</li><li>Collaborate with data scientists, analysts, and DevOps teams to translate business requirements into technical solutions.</li><li>Ensure data integrity and security by implementing data governance, compliance, and security best practices.</li><li>Monitor production workloads, troubleshoot performance issues, and implement enhancements.</li><li>Implement and enforce coding standards, best practices, and performance tuning strategies.</li><li>Support migration activities from on-premises data warehouses to GCP-based solutions.</li><li>Mentor junior developers and contribute to knowledge-sharing within the team.</li><li>Stay up to date with emerging cloud technologies, tools, and best practices in the data engineering ecosystem.</li></ul><p><b>
Required qualifications to be successful in this role</b></p><p>
Skills : 6 years of Experience in Big Data, Hadoop, Spark, Python, PySpark, Hive, SQL<br>
Location : Pune / Bangalore / Chennai / Hyderabad<br>
Education : BE / B.Tech / MCA / BCA</p><p><b>
Together, as owners, let&rsquo;s turn meaningful insights into action.</b><br>
<br>
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you&rsquo;ll reach your full potential because&hellip;<br>
<br>
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That&rsquo;s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company&rsquo;s strategy and direction.<br>
<br>
Your work creates value. You&rsquo;ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.<br>
<br>
You&rsquo;ll shape your career by joining a company built to grow and last. You&rsquo;ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
<br>
<br>
Come join our team&mdash;one of the largest IT and business consulting services firms in the world.</p></div>

Big Data Engineer

Prodapt Solutions

<div>Overview:<div></div><p><br>
We are looking for a highly skilled Big Data Engineer with extensive experience in Spark and Scala to join our team. The ideal candidate will play a crucial role in designing, developing, and optimizing large-scale data processing systems. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions.</p>
Responsibilities:
<p><b>
Key Responsibilities: -</b></p><ul><li>
Design, develop, and maintain scalable data pipelines using Apache Spark and Scala.</li><li>
Collaborate with cross-functional teams to understand data requirements and deliver data solutions that meet business needs.</li><li>
Optimize Spark jobs for performance and cost-efficiency in a distributed computing environment.</li><li>
Implement best practices for data modeling, ETL processes, and data governance.</li><li>
Monitor and troubleshoot data processing workflows to ensure data integrity and availability.</li><li>
Work with cloud platforms (AWS, Azure, or GCP) to implement big data solutions.</li><li>
Stay up to date with industry trends and emerging technologies in big data and analytics.</li></ul><div><div>
</div></div><br>
<div></div>
Requirements:
<ul><li>7-10 years of experience in Big Data technologies, with a strong focus on Apache Spark and Scala.</li><li>
Proficiency in data processing frameworks (Hadoop, Spark) and languages (Scala, Java).</li><li>
Experience with data warehousing solutions (Snowflake, Redshift, etc.) and SQL.</li><li>
Knowledge of data modeling, ETL processes, and data visualization tools (Tableau, Power BI).</li><li>
Familiarity with cloud services (AWS, Azure, Google Cloud) and containerization (Docker, Kubernetes).</li><li>
Strong analytical skills and the ability to work with large datasets.</li><li>
Excellent communication and teamwork skills.</li></ul></div><div></div>

BigData- Spark/Scala

Pennant Technologies

<div><div><b>Job Title:</b> Senior Big Data Engineer</div><div><b>
Department:</b> Data &amp; Analytics</div><div><b>
Employment Type:</b> Full&#8209;time</div><div><b>
Role Overview</b></div><div>
We are seeking an experienced Big Data Engineer to join our growing Data &amp; Analytics team. In this role, you&rsquo;ll design, build, and optimize our modern data platform&mdash;enabling scalable pipelines, reliable data lakes, and robust ML operations. You&rsquo;ll work closely with data scientists, analysts, and stakeholders to turn raw data into actionable insights.</div><div><b>
Key Responsibilities</b></div><ul><li><b>
Data Platform Development &amp; Maintenance</b></li><li>
Design, deploy, and maintain ETL/ELT pipelines using Apache Airflow and dbt/meltano.</li><li>
Architect and manage data lakes on HDFS and object storage (e.g., S3/HDFS).</li><li>
Implement table formats and governance with Apache Iceberg and Unity Catalog/Apache ranger/Atlas.</li><li><b>
Big Data Processing</b></li><li>
Develop distributed data processing jobs in Apache Spark (Scala/Java/Python).</li><li>
Optimize Spark applications for performance, cost, and scalability.</li><li>
Good working knowledge in Databases (Postgres, Mongo, SQL, Sql server etc)</li><li><b>
Collaboration with Data science teams</b></li><li>
Integrate MLflow for experiment tracking, model registry, and seamless deployment.</li><li>
Collaborate with data science teams to operationalize models in production.</li><li><b>
Containerization &amp; Orchestration</b></li><li>
Containerize data services and workflows using Docker/kubenetes.</li><li>
Orchestrate deployments on Kubernetes clusters (EKS/GKE/AKS).</li><li><b>
Center of Excellence &amp; Best Practices</b></li><li>
Contribute to and govern the dbt Center of Excellence: define standards, code reviews, and documentation.</li><li>
Advocate and enforce data engineering best practices: CI/CD, testing, monitoring, and observability.</li><li><b>
Cross&#8209;Functional Collaboration</b></li><li>
Partner with Analytics, Product, and Engineering teams to understand requirements and deliver solutions.</li><li>
Mentor junior engineers and share knowledge through code reviews and technical talks.</li></ul><div><b>
Required Skills &amp; Experience</b></div><ul><li>
5+ years of professional experience in Big Data engineering or similar roles.</li><li><b>
Airflow:</b> Hands&#8209;on experience authoring DAGs, configuring operators/sensors, and managing scheduler/executor backends.</li><li><b>
Apache Spark:</b> Proficient in building and tuning large&#8209;scale ETL jobs (Scala/Python).</li><li><b>
Apache Iceberg &amp; Unity Catalog:</b> Familiarity with table formats, partitioning strategies, and catalog management.</li><li><b>
Data Lake &amp; HDFS:</b> Solid understanding of storage architectures, file formats (Parquet/ORC), and data partitioning.</li><li><b>
MLflow:</b> Working knowledge of experiment tracking, model registry, and deployment workflows.</li><li><b>
Kubernetes:</b> Skilled in deploying, scaling, and debugging containerized applications and stateful workloads.</li><li><b>
dbt COE:</b> Experience with dbt for data modeling, CI/CD integration, and establishing a CoE for standards.</li><li>
Strong programming skills in Python and/or Scala.</li><li>
Experience with version control (Git), CI/CD pipelines (Jenkins/GitHub Actions), and monitoring tools (Prometheus, Grafana).</li></ul><div><b>
Nice&#8209;to&#8209;Have</b></div><ul><li>
Familiarity with cloud platforms (AWS, GCP, or Azure) and managed services (EMR, Dataproc, EKS, GKE).</li><li>
Knowledge of additional data catalogs (e.g., AWS Glue, Hive Metastore).</li><li>
Background in event&#8209;driven architectures (Kafka, Pulsar).</li><li>
Prior involvement in data governance or compliance initiatives.</li></ul><div><b>
Education &amp; Certifications</b></div><ul><li>
Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Engineering, or related field.</li><li>
Relevant certifications (e.g., Any cloud certification AWS/GCP/Azure/Databricks Certified Big Data &ndash; Specialty) are a plus.</li></ul><div><b>
Soft Skills</b></div><ul><li>
Excellent problem&#8209;solving and analytical abilities.</li><li>
Strong written and verbal communication; able to explain technical concepts to non&#8209;technical stakeholders.</li><li>
Proactive mindset with a passion for learning and driving innovation.</li><li>
Collaborative team player who thrives in agile, fast&#8209;paced environments.</li></ul><div><b>
Join us</b> and help shape the future of our data platform&mdash;enabling smarter decisions, faster insights, and transformative business outcomes!</div></div><div></div>

Neurealm

<div><div><div><div><div><div><p>Chennai, Tamil Nadu, India</p></div></div></div><div><p><br>
</p><p>
</p></div></div><div><div><div><div>Department</div><div>
Data Science/Big Data Mining</div></div><div><div>
Job posted on</div><div>
Oct 22, 2025</div></div><div><div>
Employment type</div><div>
Full Time Employee</div></div></div></div></div><div></div><div><div><div><div><div>
A Data Engineer Job Description Samples &amp; Tips in 2025A data engineer designs, builds, and maintains the data infrastructure, such as databases and data pipelines, that collect, store, and process raw data into usable information for data scientists and business analysts.</div></div></div></div></div></div>

Sr. Databricks Engineer

Cognizant Technology Solutions

<div><p><b>Job Title: - GCP Data Engineer with Big Query (</b><b>AIA Kolkata</b><b>)</b><br>
<b>Location: - AIA Kochi</b></p><p><b>
Minimum 6 to 9 years of experience</b></p><p><b>
Mandatory Skills:</b> GCP Services &ndash; Big Query, Cloud SQL, Data flow<br>
Around 7+ years of experience in development in Data warehousing projects in GCP platforms,<br>
Good understanding of dimensional modelling<br>
Expertise in MySQL &amp; SQL/PL<br>
GCP &amp; BigQuery knowledge is must, GCP certification is added advantage<br>
Good experience in Cloud Composer, DAGs , airflow<br>
REST API development experience<br>
Good in analytical and problem solving, efficient communication<br>
Ability to lead the team members, convert requirements into technical solutions, assign the work, coordinate the team and review the deliverables and ensure on schedule.</p></div>

GCP Data Engineer with Big Query

LiveRamp

<div><div>LiveRamp is the data collaboration platform of choice for the world&rsquo;s most innovative companies. A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is setting the new standard for building a connected customer view with unmatched clarity and context while protecting precious brand and consumer trust. LiveRamp offers complete flexibility to collaborate wherever data lives to support the widest range of data collaboration use cases&mdash;within organizations, between brands, and across its premier global network of top-quality partners.</div><div></div><div>
Hundreds of global innovators, from iconic consumer brands and tech giants to banks, retailers, and healthcare leaders turn to LiveRamp to build enduring brand and business value by deepening customer engagement and loyalty, activating new partnerships, and maximizing the value of their first-party data while staying on the forefront of rapidly evolving compliance and privacy requirements.</div><div><br>
LiveRamp is looking for a Senior Backend Engineer (SDE) to join our team focused on building scalable, high-performance backend systems that power our data collaboration platform.
</div><div></div><div>About you:</div><ul><li><div>
5+ years of Java programming experience</div></li><li><div>
3+ years of experience on streaming technologies like Red Panda</div></li><li><div>
High focus on quality, performance and cost of big data systems.</div></li><li><div>
Familiarity with with both batch and stream based data processing.</div></li><li><div>
Familiarity with big data databases like SingleStore / Big Query, relational databases.</div></li><li><div>
Familiarity with cloud computing systems like GCP.</div></li><li><div>
Familiarity with data-observability mechanisms and tools.</div></li><li><div>
Familiarity with big data processing technologies like Apache Spark</div></li></ul><div><br>
Benefits:</div><ul><li><div>
Flexible paid time off, paid holidays, options for working from home, and paid parental leave.</div></li><li><div>
Comprehensive Benefits Package: LiveRamp offers a comprehensive benefits package designed to help you be your best self in your personal and professional lives. Our benefits package offers medical, dental, vision, accident, life and disability, an employee assistance program, voluntary benefits as well as perks programs for your healthy lifestyle, career growth, and more. Your medical benefits extend to your dependents including parents.</div></li></ul><div></div><div>
More about us:</div><div></div><div><i>
LiveRamp&rsquo;s mission is to connect data in ways that matter, and doing so starts with our people. We know that inspired teams enlist people from a blend of backgrounds and experiences. And we know that individuals do their best when they not only bring their full selves to work but feel like they truly belong. Connecting LiveRampers to new ideas and one another is one of our guiding principles&mdash;one that informs how we hire, train, and grow our global team across nine countries and four continents. Click </i><div><i>here </i></div><i>to learn more about Diversity, Inclusion, &amp; Belonging (DIB) at LiveRamp.</i></div><div><br>
To all recruitment agencies: LiveRamp does not accept agency resumes. Please do not forward resumes to our jobs alias, LiveRamp employees or any other company location. LiveRamp is not responsible for any fees related to unsolicited resumes.</div></div>

Senior Backend Engineer (Big Data)

T-Mobile

<div><p>At T-Mobile, we invest in YOU! Our Total Rewards Package ensures that employees get the same big love we give our customers. All team members receive a competitive base salary and compensation package - this is Total Rewards. Employees enjoy multiple wealth-building opportunities through our annual stock grant, employee stock purchase plan, 401(k), and access to free, year-round money coaches. That&rsquo;s how we&rsquo;re UNSTOPPABLE for our employees!</p><p></p>
Are you ready to join the Un-carrier movement?<br>
<br>
The Sr Software Engineer works on building and supporting a platform the manages customer risk and bad debt, working with a team of other software engineers, network and systems engineers to design, implement, and deploy software which meet customer's requirements, scales easily, removes the limitations of traditional networking solutions, and supports deployment in highly available environments. This Engineer actively participates in architecture and design of various software components focused on crafting applications that leverage technologies such as virtualization, micro services, SDN, NFV, and Big Data platforms and technologies. They work on technical assignments that are moderately difficult, requiring judgment in resolving issues or in making recommendations on industry leading products for risk and bad debt management. The assignments require considerable judgment and initiative, understand implications of work and make recommendations for solutions. They normally receive little instruction on daily work, and only require general instructions on newly introduced assignments.<br>
<br>
We are a team that encourages innovation and advocates an agile and open approach, truly working and playing in the Un-carrier way!<p></p><p><b>
Job Responsibilities</b>:</p><p><b>
Technical Engineering Services</b></p><ul><li>
Drives engineering projects by developing software solutions; conducting tests and inspections; preparing reports and calculations. Encouraged to guide base and associate level engineers as needed.</li></ul><p><b>
Technical Leadership</b></p><ul><li>
Collaborates with technical teams and uses system expertise to deliver technical solutions.</li><li>
Continuously learns and teaches others existing and new technologies</li><li>
Contributes to the development of others through mentoring or in house workshops and learning sessions.</li></ul><p><b>
Technology Strategy</b></p><ul><li>
Contributes to new and existing technology options that support business goals.</li><li>
Understands current technology that supports business goals. Understands system protocols, how systems operate and data flows. Aware of current technology benefits. Encouraged to independently develop a full software stack. Understands the building blocks, interactions, dependencies, and tools required to complete software and automation work. Independent study of current technology is expected. Interact with system engineers to define system requirement and/or vital requirements for automation.</li></ul><p><b>
Innovation</b></p><ul><li>
Contributes to designs to implement new ideas which utilize new frameworks to improve an existing or new system/process/service.</li><li>
Review existing designs and processes to highlight more efficient ways to complete existing workload more optimally through industry perspectives.</li><li>
Understands the creation of company IPR.</li></ul><p><b>
Technical Writing</b></p><ul><li>
Writes basic documentation on how technology works. Builds clear documentation for new code and systems used.</li><li>
Documenting systems designs, presentations, and business requirements for consumption and consideration at the Manager and Sr.Manager level.</li></ul><p><b><br>
Education and Work Experience</b>:</p><ul><li>
Bachelor's Degree Computer Science or Engineering or a related field (Required)</li></ul><p><b>
Work Experience:</b></p><ul><li>
4-7 years Technical engineering experience. Required.</li><li>
3+ years experience in developing cloud solutions using Azure platform with Azure resources ADF, Event Hub, App Services, Log Analytics and VMs. Required.</li><li>
3+ years experience in Azure Data Bricks with programming in Python, Scala and Spark SQL. Required.</li><li>
Experience in software development, with a focus on creating scalable and high-availability solutions.</li><li>
Experience with Agile/Scrum methodologies and DevOps practices.</li><li>
Proficiency in Cloud Architecture and advances patterns.</li><li>
Proficiency in Snowflake platform. Preferred.</li></ul><p><b>
Knowledge, Skills and Abilities</b>:</p><ul><li>
Expertise in cloud technologies, microservices architecture, backend system development, and alignment to security standards.</li><li>
Expertise with high-resilience and high-performing system design.</li><li>
Experience with Gitlab/Github CI/CD pipeline, SQL DB, SaaS, PaaS, Private &amp; Public Clouds, distributed system design, microservices, Kubernetes, containerized applications, Splunk, Java, SQL, Python.</li><li>
Strong communication, interpersonal and technical writing skills and the ability to convey technical concepts to a wide range of audiences.</li><li>
Excellent problem-solving skills and the ability to handle complex, high-stakes projects.</li><li>
AI/ML experience is a plus.</li></ul><p></p><ul><li>
At least 18 years of age</li><li>
Legally authorized to work in the United States</li></ul><br>
<b>
Travel</b>:<br>
Travel Required (Yes/No): Yes<br>
<br>
<b>DOT Regulated</b>:<br>
DOT Regulated Position (Yes/No): No<br>
Safety Sensitive Position (Yes/No): No<br>
<p></p>
Base Pay Range: $113,600 - $205,000<p></p>
Corporate Bonus Target: 15%<p></p><p>
The pay range above is the general base pay range for a successful candidate in the role. The successful candidate&rsquo;s actual pay will be based on various factors, such as work location, qualifications, and experience, so the actual starting pay will vary within this range.</p><p></p>
At T-Mobile, employees in regular, non-temporary roles are eligible for an annual bonus or periodic sales incentive or bonus, based on their role. Most Corporate employees are eligible for a year-end bonus based on company and/or individual performance and which is set at a percentage of the employee&rsquo;s eligible earnings in the prior year. Certain positions in Customer Care are eligible for monthly bonuses based on individual and/or team performance. To find the pay range for this role based on hiring location, click here.<p></p><p>
At T-Mobile, our benefits exemplify the spirit of One Team, Together! A big part of how we care for one another is working to ensure our benefits evolve to meet the needs of our team members. Full and part-time employees have access to the same benefits when eligible. We cover all of the bases, offering medical, dental and vision insurance, a flexible spending account, 401(k), employee stock grants, employee stock purchase plan, paid time off and up to 12 paid holidays - which total about 4 weeks for new full-time employees and about 2.5 weeks for new part-time employees annually - paid parental and family leave, family building benefits, back-up care, enhanced family support, childcare subsidy, tuition assistance, college coaching, short- and long-term disability, voluntary AD&amp;D coverage, voluntary accident coverage, voluntary life insurance, voluntary disability insurance, and voluntary long-term care insurance. We don't stop there - eligible employees can also receive mobile service &amp; home internet discounts, pet insurance, and access to commuter and transit programs! To learn about T-Mobile&rsquo;s amazing benefits, check out <i>www.t-mobilebenefits.com</i><i>.</i></p><p></p><p>
Never stop growing!<br>
As part of the T-Mobile team, you know the Un-carrier doesn&rsquo;t have a corporate ladder&ndash;it&rsquo;s more like a jungle gym of possibilities! We love helping our employees grow in their careers, because it&rsquo;s that shared drive to aim high that drives our business and our culture forward. By applying for this career opportunity, you&rsquo;re living our values while investing in your career growth&ndash;and we applaud it. You&rsquo;re unstoppable!<br>
<br>
T-Mobile USA, Inc. is an Equal Opportunity Employer. All decisions concerning the employment relationship will be made without regard to age, race, ethnicity, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, religious affiliation, marital status, citizenship status, veteran status, the presence of any physical or mental disability, or any other status or characteristic protected by federal, state, or local law. Discrimination, retaliation or harassment based upon any of these factors is wholly inconsistent with how we do business and will not be tolerated.<br>
<br>
Talent comes in all forms at the Un-carrier. If you are an individual with a disability and need reasonable accommodation at any point in the application or interview process, please let us know by emailing ApplicantAccommodation@t-mobile.com or calling 1-844-873-9500. Please note, this contact channel is not a means to apply for or inquire about a position and we are unable to respond to non-accommodation related requests.</p></div>

Sr Software Engineer - Databricks

Search 10000+ Big data software engineer jobs near you this October. New roles added regularly across leading industries. Apply today.

10000 big data software engineer jobs NEAR_ME

Big Data Engineer

BigData- Spark/Scala

Big Data Engineer

Sr. Databricks Engineer

GCP Data Engineer with Big Query

Senior Backend Engineer (Big Data)

Sr Software Engineer - Databricks