data software engineer

Apple

<div>Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other&rsquo;s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It&rsquo;s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you&rsquo;ll do more than join something - you&rsquo;ll add something. 
 
As a BigData Software Engineer, you are an integral part of a small data-centric team driving large-scale data infrastructure and processes development, implementation, and improvement. Our organization thrives on collaborative partnerships. Join and play a key role in developing and driving the adoption of Data Mesh and data-centric micro-services. Apple's Manufacturing Systems and Infrastructure (MSI) team is responsible for capturing, consolidating and tracking all manufacturing data for Apple&rsquo;s products and modules worldwide.
 
 
Our tools enable teams to confidently use data to shape the next generation of product manufacturing at Apple. We seek a practitioner with experience building large-scale data platforms, analytic tools, and solutions. If you are passionate about making data easily accessible, trusted, and available across the entire business at scale, we'd love to hear from you. 
 
Description 
As a BigData Engineer, you will lead the development and implementation of our cloud-based data infrastructure. You will work closely with cross-functional teams to understand data requirements, design scalable solutions, and ensure the integrity and availability of our data. The ideal candidate will have a deep understanding of cloud technologies, data engineering best practices, and a proven track record of successfully delivering complex data projects. 
 
<ul><li>Lead the design and implementation of cloud-based data architectures.</li></ul> 
<ul><li>Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.</li></ul> 
<ul><li>Implement data security and privacy best practices.</li></ul> 
<ul><li>Optimize data storage, retrieval, and processing for performance and cost efficiency.</li></ul> 
<ul><li>Lead efforts to ensure data quality, consistency, and accuracy.</li></ul> 
<ul><li>Mentor and provide technical guidance to junior data engineers.</li></ul> 
<ul><li>Stay current with industry trends and emerging technologies in cloud data engineering.</li></ul> 

Preferred Qualifications 
Certification in cloud platforms (AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer, etc.) 
Experience building data streaming solutions using Apache Spark, Storm, Link, Flume 
Experience using ETL tools and technologies like Reltio, Stibo, Informatics, Apache Atlas 
Knowledge of machine learning and data science concepts 
Contributions to the open source community 
Familiarity with data governance and compliance 
Strong problem-solving and analytical skills 
Excellent communication and leadership skills 
 
Minimum Qualifications 
Bachelor&rsquo;s or Master's degree in Computer Science or a related field 
Proven experience as a Big Data developer, with a focus on cloud platforms 
Strong proficiency in cloud services such as AWS, Azure, or Google Cloud 
Expertise in data modelling and data integration 
Experience with big data technologies (Hadoop, Spark, etc.) 
Proficient in programming languages such as Python, Java, Scala, GoLang 
Knowledge of data warehouse solutions (Redshift, BigQuery, Snowflake, Druid) 
Experience with streaming data technologies (Kafka, Kinesis)&quot;,&quot;internalDetails&quot;:null,&quot;eeoContent&quot;:null</div>

Big Data Software Engineer - Manufacturing Systems & Infrastructure

InvoZone

Job descriptionInvoZone is a leading software development company headquartered in the US with offices in Canada, Malaysia and Pakistan. We offer a combination of consulting, outsourcing, and specialized services to a global clientele across all types of web and mobile app development projects. The company was launched by experienced and visionary IT professionals with more than 10 years of industry experience in the fraternity of software development.We take pride in our diversified team that consists of people from both local and international backgrounds working together to strive for excellence. If you think you have the technical skills to contribute to our fast-growing business, feel free to apply. We are seeking a skilled AI/ML Engineer with strong expertise in Data Science and Data Engineering to design, develop, and deploy machine learning models and data pipelines. The ideal candidate will work on extracting actionable insights from large datasets, building scalable data solutions, and contributing to AI-driven products. Key Responsibilities:<ul><li>Develop and deploy machine learning and deep learning models for business use cases.</li><li>Design, implement, and maintain ETL pipelines and large-scale data processing workflows.</li><li>Analyze structured and unstructured data to generate insights and recommendations.</li><li>Collaborate with cross-functional teams to integrate AI/ML models into production systems.</li><li>Optimize algorithms for performance, scalability, and accuracy.</li><li>Implement data governance, validation, and quality standards.</li></ul>Required Skills &amp; Expertise:<ul><li>Proficiency in Python, R, or Scala for AI/ML and data engineering tasks.</li><li>Hands-on experience with ML frameworks (TensorFlow, PyTorch, Scikit-learn).</li><li>Strong knowledge of data engineering tools: SQL, Spark, Hadoop, Airflow, or similar.</li><li>Experience with cloud platforms: AWS, GCP, or Azure.</li><li>Solid understanding of statistical modeling, predictive analytics, and data visualization.</li><li>Familiarity with deploying ML models using APIs or microservices architecture.</li><li>Experience of NLP, Computer Vision, or recommendation systems.</li><li>Experience with real-time data streaming (Kafka, Kinesis).</li><li>Familiarity with MLOps practices and CI/CD for ML pipelines.</li></ul>Job Type: Full-timeJob Type: Full-timeEducation:<ul><li>Bachelor's (Preferred)</li></ul>Experience:<ul><li>AI/ML: 1 year (Preferred)</li></ul>Location:<ul><li>Lahore (Preferred)</li></ul>Work Location: In person

AI/ML/Data Science Engineer

Motive

<div><div>Who we are:

Motive empowers the people who run physical operations with tools to make their work safer, more productive, and more profitable. For the first time ever, safety, operations and finance teams can manage their drivers, vehicles, equipment, and fleet related spend in a single system. Combined with industry leading AI, the Motive platform gives you complete visibility and control, and significantly reduces manual workloads by automating and simplifying tasks.

Motive serves nearly 100,000 customers &ndash; from Fortune 500 enterprises to small businesses &ndash; across a wide range of industries, including transportation and logistics, construction, energy, field service, manufacturing, agriculture, food and beverage, retail, and the public sector.

Visit gomotive.com to learn more.</div><div><h3 class="jobSectionHeader">
About the Role:</h3>

As a Software Engineer - Data Platform, you will be involved and responsible for full ownership and driving key data platform initiatives and life cycle of the data management including data ingestion, data processing, data storage, querying system, cost reduction efforts towards delivering product features to internal and external Motive customers.
We are looking for strong engineers to grow our Data Platform team. This team is responsible for driving the Motive&rsquo;s Data Platform vision. The team works in three areas: build scalable systems and services for data ingestion, access, processing and query to enable data driven product features, collaborate and work closely with the various stakeholders and our backend product teams to improve and add features to the platform.
<h3 class="jobSectionHeader">
What You'll Do:</h3>
<ul><li>Design and develop scalable distributed systems and frameworks for data management</li>
<li>Focus on addressing fault-tolerance and high availability issues, and work on scaling ingestion pipelines, improving and adding features to ETL framework while maintaining SLAs on performance, reliability, and system availability.</li>
<li>Collaborate with engineers across teams to identify and deliver cross-functional features</li>
<li>Participate in all aspects of the software development life cycle, from design to implementation and delivery.</li>
</ul><h3 class="jobSectionHeader">What We're Looking For:</h3>
<ul><li>3+ years Hands-on software engineering experience</li>
<li>Backend programming skills including multi-threading, concurrency, etc and proficient in one or more of Python</li>
<li>Strong CS fundamentals including data structures, algorithms, and distributed systems</li>
<li>Experience in designing, implementing, and operating highly scalable software systems and services</li>
<li>Experience building systems using technologies like Apache Kafka, Apache Spark, Airflow, Kubernetes</li>
<li>Experience with service-oriented architectures</li>
<li>Excellent troubleshooting skills and track record of implementing creative solutions</li>
<li>Hands on experience with containerized platforms like Docker and Kubernetes</li>
<li>BS in Computer Science or a related field; Masters preferred</li>
<li>Excellent verbal and written skills. You collaborate effectively with other teams and communicate clearly about your work.</li>
</ul></div><div>
Creating a diverse and inclusive workplace is one of Motive's core values. We are an equal opportunity employer and welcome people of different backgrounds, experiences, abilities and perspectives. 

The applicant must be authorized to receive and access those commodities and technologies controlled under U.S. Export Administration Regulations. It is Motive's policy to require that employees be authorized to receive access to Motive products and technology.

#LI-Remote</div></div>

Software Engineer - Data Platform

Gruve

<div>
 
 About Gruve
 
 
 
 Gruve is an innovative software services startup dedicated to transforming enterprises to AI powerhouses. We specialize in cybersecurity, customer experience, cloud infrastructure, and advanced technologies such as Large Language Models (LLMs). Our mission is to assist our customers in their business strategies utilizing their data to make more intelligent decisions. As a well-funded early-stage startup, Gruve offers a dynamic environment with strong customer and partner networks.
 
 
 
 Position Summary
 
 
 
 We are seeking a Senior Software Development Engineer &ndash; Data Engineering with 3-5 years of experience to design, develop, and optimize data pipelines and analytics workflows using Snowflake, Databricks, and Apache Spark. The ideal candidate will have a strong background in big data processing, cloud data platforms, and performance optimization to enable scalable data-driven solutions.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Work with cloud-based data solutions (Azure, AWS, GCP).
 </li>
 <li>
 Implement data modeling and warehousing solutions.
 </li>
 <li>
 Developing and maintaining data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
 </li>
 <li>
 Designing and optimizing data storage solutions, including data warehouses and data lakes.
 </li>
 <li>
 Ensuring data quality and integrity through data validation, cleansing, and error handling.
 </li>
 <li>
 Collaborating with data analysts, data architects, and software engineers to understand data requirements and deliver relevant data sets (e.g., for business intelligence).
 </li>
 <li>
 Implementing data security measures and access controls to protect sensitive information.
 </li>
 <li>
 Monitor and troubleshoot issues in data pipelines, notebooks, and SQL queries to ensure seamless data processing.
 </li>
 <li>
 Develop and maintain Power BI dashboards and reports.
 </li>
 <li>
 Work with DAX and Power Query to manipulate and transform data.
 
 
 </li>
 </ul>
 
 Basic Qualifications
 
 
 
 <ul>
 <li>
 Bachelor&rsquo;s or master&rsquo;s degree in computer science or data science
 </li>
 <li>
 3-5 years of experience in data engineering, big data processing, and cloud-based data platforms.
 </li>
 <li>
 Proficient in SQL, Python, or Scala for data manipulation and processing.
 </li>
 <li>
 Proficient in developing data pipelines using Azure Synapse, Azure Data Factory, Microsoft Fabric.
 </li>
 <li>
 Experience with Apache Spark, Databricks and Snowflake is highly beneficial for handling big data and cloud-based analytics solutions.
 
 
 </li>
 </ul>
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Knowledge of streaming data processing (Apache Kafka, Flink, Kinesis, Pub/Sub).
 </li>
 <li>
 Experience in BI and analytics tools (Tableau, Power BI, Looker).
 </li>
 <li>
 Familiarity with data observability tools (Monte Carlo, Great Expectations).
 </li>
 <li>
 Contributions to open-source data engineering projects.
 
 
 </li>
 </ul>
 &zwj;
 
 
 
 Why Gruve
 
 
 
 At Gruve, we foster a culture of innovation, collaboration, and continuous learning. We are committed to building a diverse and inclusive workplace where everyone can thrive and contribute their best work. If you&rsquo;re passionate about technology and eager to make an impact, we&rsquo;d love to hear from you.
 
 
 Gruve is an equal opportunity employer. We welcome applicants from all backgrounds and thank all who apply; however, only those selected for an interview will be contacted.
</div>

Software Development Engineer (Data Engineering)

Amazon.com

<div><h2 class="jobSectionHeader">DESCRIPTION</h2>
Are you excited about the digital media revolution and passionate about designing and delivering advanced analytics that directly influence the product decisions of Amazon's digital businesses. Do you see yourself as a champion of innovating on behalf of the customer by turning data insights into action? 
 
The Amazon Digital Acceleration (DA) org is looking for an analytical and technically skilled data engineer to join our team. In this role, you will play a critical part in developing foundational analytical datasets spanning orders, subscriptions, discovery, promotions, pricing and royalties. Our mission is to enable digital clients to easily innovate with data on behalf of customers and make product and customer decisions faster.
 
 
An ideal individual is someone who has deep data engineering skills around ETL, data modeling, database architecture and big data solutions. This individual should have strong business judgement, excellent written and verbal communication skills. 
 
Key job responsibilities 
1. Develop data products, infrastructure and data pipelines leveraging AWS services (such as Redshift, Kinesis, EMR, Lambda etc.) and internal BDT tools (Datanet, Cradle, QuickSight etc. 
 
2. Improve existing solutions/build solutions to improve scale, quality, IMR efficiency, data availability, consistency &amp; compliance. 
 
3. Partner with Software Developers, Business Intelligence Engineers, MLEs, Scientists, and Product Managers to develop scalable and maintainable data pipelines on both structured and unstructured (text based) data. 
 
4. Drive operational excellence strongly within the team and build automation and mechanisms to reduce operations 
 
About the team 
The MIDAS team operates within Amazon's Digital Analytics (DA) engineering organization, building analytics and data engineering solutions that support cross-digital teams. Our platform delivers a wide range of capabilities, including metadata discovery, data lineage, customer segmentation, compliance automation, AI-driven data access through generative AI and LLMs, and advanced data quality monitoring. Today, more than 100 Amazon business and technology teams rely on MIDAS, with over 20,000 monthly active users leveraging our mission-critical tools to drive data-driven decisions at Amazon scale.<h2 class="jobSectionHeader">
BASIC QUALIFICATIONS</h2><ul><li>1+ years of data engineering experience</li><li>Experience with SQL</li><li>Experience with data modeling, warehousing and building ETL pipelines</li><li>Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)</li><li>Experience with one or more scripting language (e.g., Python, KornShell)</li></ul><h2 class="jobSectionHeader">
PREFERRED QUALIFICATIONS</h2><ul><li>Experience with big data technologies such as: Hadoop, Hive, Spark, EMR</li></ul> 
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner.</div>

Data Engineer, MIDAS, Digital Acceleration

Technology Next

Cloud Data Engineer + QALocation: Noida, Pune, Chennai, Bangalore, Hyderabad Work Mode: Hybrid Working Hours: 11:00 AM &ndash; 8:30 PMPosition Overview:We are seeking a skilled and experienced Cloud Data Engineer + QA to join our team for a Cloud Data Modernization project. The ideal candidate will play a key role in migrating our on-premises Enterprise Data Warehouse (SQL Server) to a modern cloud-based data platform utilizing Azure Cloud data tools and Snowflake. This role requires strong technical expertise in data engineering, ETL, and QA for ensuring data integrity, accuracy, and seamless migration.Key Responsibilities:* Design, develop, and implement data platform solutions using Azure Data Factory (ADF), Self-Hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), Blob Storage, and Snowflake. * Review and analyze existing on-premises ETL processes developed in SSIS and T-SQL to plan and execute migration to cloud environments. * Implement DevOps practices and CI/CD pipelines using Git Actions. * Collaborate with cross-functional teams to ensure efficient data flow and integration between systems. * Optimize, monitor, and troubleshoot data pipelines and workflows for performance and reliability. * Ensure data security, governance, and compliance with organizational and industry standards. * Perform data validation testing/QA to ensure consistency between on-premises SQL Server and cloud-based (Azure/Snowflake) data environments. * Conduct unit testing and document results to maintain data quality and integrity throughout the migration process.Required Qualifications:* 4+ years of experience as a Cloud Data Engineer, including experience in data migration and quality assurance. * Hands-on experience with Azure Cloud data tools (ADF, SHIR, Logic Apps, ADLS Gen2, Blob Storage) and Snowflake. * Strong experience in ETL development using SQL Server, SSIS, and T-SQL. * Proficiency in Python or other scripting languages for data processing and validation. * Solid understanding of DevOps and CI/CD pipelines using Git Actions. * Experience working in Agile development environments. * Proven experience in data validation, unit testing, and QA processes in data migration projects. * Strong analytical and problem-solving skills with attention to detail. * Excellent communication and collaboration abilities across teams. * Ability to learn and adapt quickly to new technologies.Job Type: Contractual / Temporary Contract length: 6-12 monthsPay: &#8377;70,000.00 - &#8377;90,000.00 per monthExperience:<ul><li>Quality assurance: 4 years (Required)</li><li>Data migration: 4 years (Required)</li></ul>Work Location: In person

Cloud Data Engineer + QA

The Trade Desk

<div>The Trade Desk is a global technology company with a mission to create a better, more open internet for everyone through principled, intelligent advertising. Handling over 1 trillion queries per day, our platform operates at an unprecedented scale. We have also built something even stronger and more valuable: an award-winning culture based on trust, ownership, empathy, and collaboration. We value the unique experiences and perspectives that each person brings to The Trade Desk, and we are committed to fostering inclusive spaces where everyone can bring their authentic selves to work every day.

Do you have a passion for solving hard problems at scale? Are you eager to join a dynamic, globally- connected team where your contributions will make a meaningful difference in building a better media ecosystem? Come and see why Fortune magazine consistently ranks The Trade Desk among the best small- to medium-sized workplaces globally.

What we do

This specialized role is within the Technology operations group of The Trade Desk's Engineering. This group is focused on delivering world-class solutions for Enterprise needs within The Trade Desk.
We are seeking a skilled and motivated Software Engineer II - Data Engineer to join our growing data team. In this mid-level role, you will be instrumental in developing, building, and maintaining the data pipelines and architecture that enable our organization to turn raw data into actionable insights. You will work on complex data problems, collaborate with cross-functional teams, and help ensure the reliability, efficiency, and quality of our data systems.

What you'll do:
<ul>
<li>Data Pipeline Development: Design, build, and optimize scalable ETL/ELT pipelines for both batch and real-time data processing from disparate sources.</li>
<li>Infrastructure Management: Assist in the design and implementation of data storage solutions, including data warehouses and data lakes (e.g., Snowflake, S3, Spark), ensuring they are optimized for performance and cost efficiency.</li>
<li>Data Quality and Governance: Implement data quality checks, monitor data pipeline performance, and troubleshoot issues to ensure data accuracy, reliability, and security, adhering to compliance standards (e.g., GDPR, CCPA).</li>
<li>Collaboration: Work closely with product managers, data scientists, business intelligence analysts, and other software engineers to understand data requirements and deliver robust solutions.</li>
<li>Automation and Optimization: Automate data engineering workflows using orchestration tools (e.g., Apache Airflow, Dagster, Azure Data Factory) and implement internal process improvements for greater scalability.</li>
<li>Mentorship: Participate in code reviews and provide guidance or mentorship to junior team members on best practices and technical skills.</li>
<li>Documentation: Produce comprehensive and usable documentation for datasets, data models, and pipelines to ensure transparency and knowledge sharing across teams.</li>
</ul>
Who you are:
<ul>
<li>Bachelor's degree in computer science, information security, or a related field, or equivalent work experience. Masters degree preferred.</li>
<li>4+ years of experience in a Data engineering role and have a broad understanding of Data Modeling, SQL, OLAP, and ETL required. Experience working with data pipelines including data modeling at petabyte scale is a bonus.</li>
<li>4+ years of experience working with multiple database platforms by designing and implementing data and analytics solutions using technologies such as Snowflake, Databricks, Vertica, SQL Server, andMySQL required.</li>
<li>4+ years of experience required in one or more programming languages,particularly SQL. Proficiency in the following programming languages also required: PL/SQL, Python, C#, Scala or Java.</li>
<li>Experience with workflow technologies like Spark, Airflow, Glue, Prefect or Dagster required</li>
<li>Experience with version control systems, specifically Git required.</li>
<li>Familiarity with DevOps best practices and automation of processes like building, configuration, deployment, documentation, testing, and monitoring.</li>
<li>Understanding BI and reporting platforms required, awareness of industry trends in the BI/reporting space, and how it can apply to an organization's product strategies.</li>
<li>AdTech industry and its trends preferred.</li>
<li>Experience with containerization tools like Docker and Kubernetes preferred.</li>
<li>Familiarity with data modeling and data warehousing concepts preferred.</li>
<li>Basic understanding of machine learning concepts and how models work.</li>
<li>Strong analytical and problem-solving skills with attention to detail.</li>
<li>Excellent communication and collaboration skills to work effectively with diverse teams and stakeholders.</li>
<li>A proactive and continuous learning mindset.</li>
</ul>
#LI-TP1

The Trade Desk does not accept unsolicited resumes from search firm recruiters. Fees will not be paid in the event a candidate submitted by a recruiter without an agreement in place is hired; such resumes will be deemed the sole property of The Trade Desk. The Trade Desk is an equal opportunity employer. All aspects of employment will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law.

[LA JOBS ONLY] The Trade Desk will consider qualified applicants with criminal histories for employment in a manner consistent with the requirements of the Los Angeles Fair Chance Initiative for Hiring, Ordinance No. 184652.

[SF JOBS ONLY] Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.<div>

As an Equal Opportunity Employer, The Trade Desk is committed to creating an inclusive hiring experience where everyone has the opportunity to thrive.

Please reach out to us at accommodations@thetradedesk.com to request an accommodation or discuss any accessibility needs you may require to access our Company Website or navigate any part of the hiring process.

When you contact us, please include your preferred contact details and specify the nature of your accommodation request or questions. Any information you share will be handled confidentially and will not impact our hiring decisions.</div></div>

Software Engineer II - Data Engineer

Search 10000+ Data software engineer jobs near you this November. New roles added regularly across leading industries. Apply today.