big data engineer

SAIC

<div>Job ID: T2511987
Location: Chantilly, VA, US
Date Posted: 2026-03-05
Category: Information Technology
Subcategory: Big Data Engineer
Schedule: Full-Time
Shift: Day Job
Travel: No
Minimum Clearance Required: TS.SCI_wPoly
Clearance Level Must Be Able to Obtain: None
Potential for Remote Work: ORA_ON_SITE 
Description
﻿
SAIC is seeking a Big Data Engineer to join our team of professionals providing technical and program services to the Air Force, Space and Intelligence Business Group (AFSI). SAIC provides research, engineering, design, analysis, acquisition, development, integration, test, and operations support to USG Intelligence Community (IC) and Department of Defense (DoD) customers. We support development and delivery of next generation and generation after next national security systems based on land, at sea, in air, and in space.

The Big Data Engineer will support the NRO&rsquo;s Advanced Systems and Technology (AS&amp;T) Directorate, which researches and develops the nation&rsquo;s most advanced technology for space-based Intelligence, Surveillance and Reconnaissance (ISR) systems. This individual will provide comprehensive technical support across multiple domains, with a focus on data architecture, ETL processes, and data storage solutions. This role is integral to enhancing AS&amp;T&rsquo;s technological capabilities and strategic decision-making processes.

The primary functions of the candidate will include, but are not limited to:
<ul>
<li>Designs scalable data architectures, leading ETL processes, and oversees the implementation of data storage solutions to include creating, manipulating, and maintaining large databases</li>
<li>Support the development, integration, and visualization of advanced analytics tools, ensuring efficient data access and insights generation</li>
<li>Optimize system performance and scalability, implementing continuous improvement initiatives</li>
<li>Architect, deploy, and maintain multiple, fast-turnaround capabilities used to perform various highly-visible and high-priority collection efforts</li>
<li>Strategically apply AI/ML to extract, format, and expose in indexed search tools relevant content such as raw text, tabular (CSV, Parquet, Avro) or nested (JSON, JSONL, XML), and other structured /unstructured data types. Data is expected to be of varying formats, schemas, and structures</li>
<li>Provide Data Engineering support to include cleaning, modeling, and formatting data of unknown formats</li>
<li>Move data between different cloud storage environments for critical requests</li>
<li>Coordinate with multiple entities, including mission partners, to ensure capabilities and deliverables meet defined requirements and tradecraft needs</li>
<li>Create and maintain collection capabilities and deliverables within the Customer&rsquo;s Amazon Web Services environment utilizing Customer approved AWS services</li>
<li>Validate collected data to ensure it meets data format requirements</li>
<li>Document all source code, including how to execute the code</li>
<li>Perform operations and maintenance on the collection capabilities and deliverables to adapt to changes in collection target, technologies, data formats, and naming conventions</li>
</ul>
Qualifications
﻿<ul><li>
Active TS/SCI with CI Polygraph</li><li>
Bachelors and fourteen (14) years or more experience; Masters and twelve (12) years or more experience; PhD or JD and nine (9) years or more experience.</li><li>
Bachelor's degree in Information Technology, Cybersecurity, Computer Science, Information Systems, Data Science, or Software Engineering and 9 years or more experience; Masters 7 years or more experience</li><li>
Demonstrated experience with Python</li><li>
Ability to maintain SQL and NO-SQL databases</li><li>
Demonstrated experience with Tableau or Salesforce</li><li>
Ability to create and manage AWS resources, including provisioning EC2 instances, writing and deploying Lambda functions, creating and writing to S3, and managing authorization appropriately across resources with IAM policies</li><li>
One Active Certification: CCISO, CISM, CISSP, GSLC, SSCP, Sec+ or GSEC</li><li>
Proven experience optimizing data pipelines, performing large-scale data processing, and ensuring data quality</li><li>
Strong knowledge of data warehousing concepts, ETL processes, and distributed computing environments</li></ul></div>

Big Data Engineer

Muller's Solutions

<div>M&uuml;ller&rsquo;s Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.
Key Responsibilities:<ul>
<li>Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka.</li>
<li>Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs.</li>
<li>Ensure high data quality and integrity by implementing robust data validation and testing processes.</li>
<li>Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments.</li>
<li>Monitor and troubleshoot data processing workflows to ensure timely data delivery.</li>
<li>Document data architectures, processes, and workflows for knowledge sharing and compliance.</li>
<li>Stay ahead of industry trends and best practices in big data technologies and methodologies.</li> 
</ul> 
 
Requirements 
Requirements:<ul>
<li>Bachelor's degree in Computer Science, Information Technology, or a related field.</li>
<li>3+ years of experience as a Big Data Engineer or in a similar data engineering role.</li>
<li>Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka.</li>
<li>Strong coding skills in programming languages like Java, Scala, or Python.</li>
<li>Familiarity with data processing frameworks and ETL tools.</li>
<li>Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery).</li>
<li>Analytical mindset and excellent problem-solving abilities.</li>
<li>Strong communication skills to collaborate effectively with technical and non-technical stakeholders.</li>
<li>A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines.</li>
</ul>Preferred Qualifications:<ul>
<li>Experience with machine learning frameworks and algorithms is a plus.</li>
<li>Knowledge of data governance and security best practices.</li>
<li>Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes.</li> 
</ul> 
 
Benefits 
1- Attractive Package.
2- Family Benefits.
3- Visa.
4-Air Tickets.</div>

Müller's Solutions

<div>
 M&uuml;ller's Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.
 
 
 
 Key Responsibilities:
 
 
 
 <ul>
 <li>
 Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka
 </li>
 <li>
 Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs
 </li>
 <li>
 Ensure high data quality and integrity by implementing robust data validation and testing processes
 </li>
 <li>
 Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments
 </li>
 <li>
 Monitor and troubleshoot data processing workflows to ensure timely data delivery
 </li>
 <li>
 Document data architectures, processes, and workflows for knowledge sharing and compliance
 </li>
 <li>
 Stay ahead of industry trends and best practices in big data technologies and methodologies
 
 
 </li>
 </ul>
 
 Requirements
 
 
 
 
 Requirements:
 
 
 
 <ul>
 <li>
 Bachelor's degree in Computer Science, Information Technology, or a related field
 </li>
 <li>
 3+ years of experience as a Big Data Engineer or in a similar data engineering role
 </li>
 <li>
 Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka
 </li>
 <li>
 Strong coding skills in programming languages like Java, Scala, or Python
 </li>
 <li>
 Familiarity with data processing frameworks and ETL tools
 </li>
 <li>
 Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery)
 </li>
 <li>
 Analytical mindset and excellent problem-solving abilities
 </li>
 <li>
 Strong communication skills to collaborate effectively with technical and non-technical stakeholders
 </li>
 <li>
 A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines
 
 
 </li>
 </ul>
 
 Preferred Qualifications:
 
 
 
 <ul>
 <li>
 Experience with machine learning frameworks and algorithms is a plus
 </li>
 <li>
 Knowledge of data governance and security best practices
 </li>
 <li>
 Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes
 
 
 </li>
 </ul>
 
 Benefits
 
 
 
 1- Attractive Package.
 
 
 2- Family Benefits.
 
 
 3- Visa.
 
 
 4-Air Tickets.
</div>

Hexaware Technologies

Big Data Engineer Required Experience: 6+ years of Industry Experience with key engagements including Integration Architecture, Solution, Design &amp; end-to-end implementation Responsibilities: &bull; Define the Integration architecture landscape, including technology, information, data, security, and integration &bull; Implement large-scale, innovative IT solutions to drive business transformation. &bull; Define and deliver the Integration Technology aspects of the projects, including the timely production of architectural designs and documentation &bull; Being a key contributor to architect &amp; design Microservice, API Management, process automations &amp; frameworks in project &bull; Working with customers&rsquo; business and the Architecture team on large integration transformation programs that include multiple technology streams and complex architecture &bull; Propose, Architecture, design and guide building reusable components, Able to drive the Architecture discussions with the end-customer &bull; Communicating the implementation approach and design methodology to the offshore development team &bull; Participating in a Technical Design Authority to assess and quantify the risks associated with design decisions and communicate these to the relevant parties &bull; Develop technology strategy and planning deliverables to address IT risks and improve the effectiveness of the IT organization, especially in business application integration. &bull; Produce target-state solution architecture, and perform assessments and gap analysis. &bull; Help formulate the overall solution strategy. Must Have Skills :- (a) Databricks, Pyspark, Medallion Arch, CTE Queries (b) Python, ADL, ADF, Azure Cloud Storage &amp; Container Exp (c) SQL, Stored Procedures, Views, User Defined Functions (d) SQL Server (e) Data Analysis Exp Nice To Have :- (a) Collibra (b) Alteryx work flow

S&P Global

About the Role: 
Grade Level (for internal use): 12 The Team: 
You will be an expert contributor and part of the Rating Organization's Data Services Team. This team, who has a broad and expert knowledge on Ratings organization's critical data domains, technology stacks and architectural patterns, fosters knowledge sharing and collaboration that results in a unified strategy. All Data Services team members provide leadership, innovation, timely delivery, and the ability to articulate business value. Be a part of a unique opportunity to build and evolve S&P Ratings next gen analytics platform.
 
Responsibilities and Impact: 
Design and develop efficient and scalable data pipelines between enterprise systems and analytics platform
 
Work closely with Data Science team and participate in development of feature engineering pipelines
 
Provide technical expertise in the areas of design and implementation of Ratings Integrated Data Facility with modern AWS cloud technologies such as S3, Redshift, EMR, and distributed computing frameworks
 
Build and maintain a data environment for speed, accuracy, consistency and 'up' time
 
Support analytics by building a world-class data lake environment that empowers analysts to determine insights into revenue and power products across the organization
 
Work with the machine learning engineering team to build a data eco system that supports AI products at scale
 
Ensure data governance principles adopted, data quality checks and data lineage implemented in each hop of the data
 
Partner with the chief data office, enterprise architecture organization to ensure best use of standards for the key data domains and use cases
 
Be in tune with emerging trends in Big data and cloud technologies and participate in evaluation of new technologies
 
Ensure compliance through the adoption of enterprise standards and promotion of best practice / guiding principles aligned with organization standards
 
What We're Looking For: Basic Required Qualifications: 
BS or MS degree in Computer Science or Information Technology
 
8+ years of experience as data engineer at an innovative organization
 
4+ years of hands-on experience in implementing data lake systems using AWS cloud technologies such as S3, Redshift, EMR, and distributed computing frameworks (such as Spark, Hadoop, or Flink)
 
Expert managing AWS services (EC2, S3, Route 53, ELB, VPC, CloudWatch, Lambda) in a multi-account production environment
 
Experience with development frameworks and data integration technologies (such as Informatica, Talend, or Apache NiFi) and programming languages including Python, Scala, Java, or similar
 
Expert knowledge of Agile approaches to software development and able to put key Agile principles into practice to deliver solutions incrementally
 
Additional Preferred Qualifications: 
Experience with machine learning libraries and frameworks (such as TensorFlow, PyTorch, Scikit-learn, or MLlib) is an added advantage
 
Exposure to R, SparklyR, and other R packages is a plus
 
Monitors industry trends and directions; develops and presents substantive technical recommendations to senior management
 
Financial services industry experience
 
Excellent analytical thinking, interpersonal, oral and written communication skills with strong ability to influence both IT and business partners
 
Ability to prioritize and manage work to critical project timelines in a fast-paced environment
 
Compensation/Benefits Information (US Applicants Only): 
S&P Global states that the anticipated base salary range for this position is $149,302 – $202,267. Final base salary for this role will be based on the individual’s geographical location as well as experience and qualifications for the role.
 In addition to base compensation, this role is eligible for an annual incentive plan. This role is not eligible for additional compensation such as an annual incentive bonus or sales commission plan.
 
This role is eligible to receive additional S&P Global benefits. For more information on the benefits we provide to our employees, please click here .
 
About S&P Global Ratings
 At S&P Global Ratings, our analyst-driven credit ratings, research, and sustainable finance opinions provide critical insights that are essential to translating complexity into clarity so market participants can uncover opportunities and make decisions with conviction. By bringing transparency to the market through high-quality independent opinions on creditworthiness, we enable growth across a wide variety of organizations, including businesses, governments, and institutions.
 S&P Global Ratings is a division of S&P Global (NYSE: SPGI). S&P Global is the world’s foremost provider of credit ratings, benchmarks, analytics and workflow solutions in the global capital, commodity and automotive markets. With every one of our offerings, we help many of the world’s leading organizations navigate the economic landscape so they can plan for tomorrow, today.
 
For more information, visit www.spglobal.com/ratings
 
What’s In It For You?
 
Our Mission: 
Advancing Essential Intelligence.
 
Our People: 
We're more than 35,000 strong worldwide—so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We’re committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. Join us and help create the critical insights that truly make a difference.
 
Our Values: 
Integrity, Discovery, Partnership
 
Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of integrity in all we do, bring a spirit of discovery to our work, and collaborate in close partnership with each other and our customers to achieve shared goals.
 
Benefits: 
We take care of you, so you can take care of business. We care about our people. That’s why we provide everything you—and your career—need to thrive at S&P Global.
 
Our benefits include: 
Health & Wellness: Health care coverage designed for the mind and body.
 Flexible Downtime: Generous time off helps keep you energized for your time on.
 Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
 Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
 Family Friendly Perks: It’s not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
 Beyond the Basics: From retail discounts to referral incentive awards—small perks can make a big difference.
 For more information on benefits by country visit: https://spgbenefits.com/benefit-summaries
 
Global Hiring and Opportunity at S&P Global: 
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
 
S&P Global has a Securities Disclosure and Trading Policy (“the Policy”) that seeks to mitigate conflicts of interest by monitoring and placing restrictions on personal securities holding and trading. The Policy is designed to promote compliance with global regulations. In some Divisions, pursuant to the Policy’s requirements, candidates at S&P Global may be asked to disclose securities holdings. Some roles may include a trading prohibition and remediation of positions when there is an effective or potential conflict of interest. Employment at S&P Global is contingent upon compliance with the Policy.
 
Recruitment Fraud Alert: 
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to reportfraud@spglobal.com . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, “pre-employment training” or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here .
 
-----------------------------------------------------------
 
Equal Opportunity Employer
 S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
 
If you need an accommodation during the application process due to a disability, please send an email to: EEO.Compliance@spglobal.com and your request will be forwarded to the appropriate person.
 
US Candidates Only: Know Your Rights: Workplace discrimination is illegal
 
----------------------------------------------------------- 20 - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority – Ratings - (Strategic Workforce Planning)
 
Job ID: 324302
 Posted On: 2026-03-09
 Location: New York, New York, United States

Big Data Engineer Lead

Chuwa America

Job Title: Big Data EngineerExperience: 10+ Years Location: RemoteJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Hadoop ecosystem, Apache Spark, Python, and Scala programming. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and big data solutions. This role requires strong hands-on experience with distributed data processing frameworks, cloud platforms, and data engineering tools.Key Responsibilities<ul><li>Design, develop, and maintain scalable big data pipelines and data processing systems.</li><li>Work with large-scale data using Hadoop ecosystem tools such as Hive, Pig, and Oozie.</li><li>Develop distributed data processing applications using Apache Spark and Scala.</li><li>Build and optimize ETL pipelines for structured and unstructured data.</li><li>Work with RDD APIs in Spark for large-scale data transformations and analytics.</li><li>Implement data streaming solutions using Kafka for real-time data processing.</li><li>Collaborate with cross-functional teams including data analysts, architects, and business stakeholders.</li><li>Deploy and manage big data solutions on AWS or GCP cloud platforms.</li><li>Ensure performance optimization, scalability, and reliability of data systems.</li><li>Maintain documentation, follow best practices, and ensure high-quality code standards.</li></ul>Required Skills<ul><li>10+ years of experience in Big Data and Data Engineering.</li><li>Strong hands-on experience with Hadoop ecosystem (Hive, Pig, Oozie).</li><li>Expertise in Apache Spark and Scala programming.</li><li>Hands-on programming experience in Python and Core Java.</li><li>Strong understanding of Spark RDD APIs and distributed computing.</li><li>Experience with Kafka or other streaming frameworks.</li><li>Solid understanding of Data Warehousing concepts and Data Modeling techniques.</li><li>Strong proficiency in SQL and working with large datasets.</li><li>Experience working in Linux/Unix environments.</li><li>Experience with AWS or GCP cloud platforms.</li><li>Knowledge of ETL design and development.</li></ul>Good to Have<ul><li>Experience with data visualization and analytics tools such as Tableau or R.</li><li>Experience with real-time data processing architectures.</li><li>Exposure to CI/CD pipelines and DevOps practices.</li><li>Experience with performance tuning and optimization in Spark/Hadoop environments.</li></ul>Pay: $55.00 - $60.00 per hourApplication Question(s):<ul><li>Are you comfortable to come on our W2?</li></ul>Work Location: Remote

Lead Big Data Engineer - Only USC or GC

Search 10000+ Big data engineer jobs near you this March. New roles added regularly across leading industries. Apply today.

10000 big data engineer jobs Near Me

Big Data Engineer

Big Data Engineer

Big Data Engineer

Big Data Engineer

Big Data Engineer

Big Data Engineer Lead

Lead Big Data Engineer - Only USC or GC