big data engineer

Tech Interacts Inc

<p><b>Big Data Engineer</b></p><p><b>Charlotte, NC(Hybrid) </b></p><p><b>W2 | Local only </b></p><p><b>NO OPT/CPT/H1</b></p><p><b>Job Description:</b></p><ul><li>Experience with Big Data platforms/tools (Linux, HDFS, Hive, Hortonworks, Spark, Scala, Python, Java, Kafka, etc.)</li><li>Experience with API&rsquo;s, reading from and/or designing new</li><li>Ability to write SQL and interact with data</li><li>Data processing experience (Join, Merge, Transform, Summarize, etc.)</li><li>Ability to design and create data control checks and</li><li>Experience with scheduler tools like Autosys</li><li>Familiar with the Banking Financial Crimes domain</li></ul><p><b>Required Skills:</b></p><p><b>Over 10+ years </b></p><p>Top Skills: Big Data Developer (Spark, Scala, Python, AutoSys, Git, etc.)</p><ul><li>Years of Experience: 5 years of Big Data process development and job scheduling</li><li>Education: Bachelor&rsquo;s degree in Science or higher</li><li>Work Environment: Daily Agile Scrum team stand-ups</li><li>Communication: Strong verbal and written communication skills</li><li>Accountability: Ability to lead initiatives end to end, including solution design, development, testing, and deployment</li></ul><p><b>Desired Skills:</b></p><ul><li>Good‑to‑Have Skills: General Data Development experience (SQL, ETL, Linux scripting, etc.)</li><li>Domain Expertise: Experience with Financial Crime Compliance and related data processing.</li></ul><p>Pay: From $60.00 per hour</p><p>Work Location: Hybrid remote in Charlotte, NC 28202</p>

Big Data Engineer

Hexaware Technologies

Role Big Data Engineer Responsibilities Implement Data integration and Data Warehouse based solutions using Big Data Technologies. Should be highly proficient in the use of Big Data / Open Source Technologies and standard techniques of Data Integration; Data Manipulation with hands-on contribution. Should be able to develop cost efficient and performant data pipelines in the cloud platform In-depth understanding of modern big data technology; including Data modeling and machine learning skills Knowledge of real time data streaming and aggregation architectural patterns and practice Essential Skills: 3+ Years hands on knowledge on SQL as well as SQL/NoSQL databases Proficient in programming languages such as Python and PySpark/Scala/Java Experience with Apache Spark in On-prem / Cloud (Databricks / EMR / DataProc HDInsight) Working knowledge of API development Experience in building data pipelines in ETL/ELT methods Experience with integration of data from multiple data sources Experience in one of the NoSQL databases; such as HBase; Cassandra; MongoDB

SAS Mexico (Kuwait Data Center)

<p>Job Opportunity: Senior Big Data Engineer</p><p><b>Location:</b> Kuwait City, Kuwait<br/><b>Company:</b> SAS Mexico (Kuwait Data Center)</p><p>About Us</p><p>SAS Mexico is a global leader in advanced analytics and data-driven solutions. With our Kuwait Data Center, we deliver cutting-edge big data platforms and services to empower organizations with actionable insights. To strengthen our data engineering team in Kuwait City, we are seeking an experienced <b>Senior Big Data Engineer</b> to design, build, and optimize large-scale data systems.</p><p>Role Overview</p><p>The <b>Senior Big Data Engineer</b> will be responsible for architecting and managing big data pipelines, ensuring scalability, reliability, and performance. This role requires deep technical expertise, strong problem-solving skills, and the ability to collaborate with data scientists, analysts, and business stakeholders.</p><p>Key Responsibilities</p><ul><li>Design and implement scalable big data architectures and pipelines.</li><li>Manage data ingestion, transformation, and storage across distributed systems.</li><li>Collaborate with data science and analytics teams to deliver high-quality datasets.</li><li>Optimize performance of big data platforms (Hadoop, Spark, Kafka, etc.).</li><li>Ensure compliance with data governance, security, and privacy standards.</li><li>Monitor system performance and recommend improvements.</li><li>Lead integration of cloud-based big data solutions (AWS, Azure, GCP).</li><li>Mentor junior engineers and promote best practices in data engineering.</li></ul><p>Qualifications</p><ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Data Engineering, or related field.</li><li>7+ years of experience in big data engineering, with at least 3 years in a senior role.</li><li>Strong knowledge of Hadoop ecosystem, Apache Spark, Kafka, and NoSQL databases.</li><li>Proficiency in programming languages (Python, Java, Scala).</li><li>Experience with cloud platforms and containerization (Docker, Kubernetes).</li><li>Familiarity with data governance, ETL processes, and real-time analytics.</li><li>Excellent analytical, organizational, and communication skills.</li><li>Ability to manage multiple priorities in a dynamic environment.</li><li>Fluency in English; Arabic is a strong advantage.</li></ul><p>Why Join Us?</p><ul><li>Be part of a respected global analytics provider expanding in Kuwait.</li><li>Lead high-impact big data initiatives with regional and international exposure.</li><li>Competitive salary and benefits package.</li><li>Opportunities for professional growth and career advancement.</li><li>Collaborative, innovative, and data-driven work culture.</li></ul><p>Pay: Up to KD2,700.000 per month</p><p>Work Location: In person</p>

Senior Big Data Engineer

<div><p><b>Title:</b></p>
Big Data Systems Engineer<p></p><p><b>
Belong, Connect, Grow, with KBR!</b></p><p>
KBR&rsquo;s National Security Solutions (NSS) team provides high-end engineering and advanced technology solutions to our customers in the intelligence and national security communities. In this position, your work will have a profound impact on the country&rsquo;s most critical role &ndash; protecting our national security.</p><p></p><p>
KBR is seeking a Big Data Systems Engineer to join our team. The successful candidate will be part of the KBR team supporting the Test Resource Management Center&rsquo;s (TRMC) Big Data (BD) and Knowledge Management (KM) Team deploying BD and KM systems for DoD testing Ranges and various acquisition programs.</p><p></p><p><b>
Responsibilities:
</b></p><ul><li>The Big Data Systems Engineer will work on the deployment and integration of a highly visible data analytic project called Cloud Hybrid Edge-to-Enterprise Evaluation Test &amp; Analysis Suite (CHEETAS) at multiple DoD ranges and labs.</li><li>
As a Big Data Systems Engineer, you will be a critical part of our technical team responsible for deploying CHEETAS within customer environments. You will be the frontline interface that customers will have when first experiencing CHEETAS within their DoD Range and lab environments.</li><li>
This position will require you to work closely with system administrators and software developers to communicate, document and ultimately resolve deployment issues as they arise.</li><li>
You will deploy CHEETAS within disparate DoD testing Ranges and acquisition programs environments (on different non-standard hardware stacks and integrated into different existing ecosystems) sometimes located within DoD vaults with no outside internet connectivity.</li><li>
Work on the deployment and integration of a highly visible data analytic project called Cloud Hybrid Edge-to-Enterprise Evaluation Test &amp; Analysis Suite (CHEETAS) at multiple DoD ranges and labs</li><li>
Deploy CHEETAS within customer environments</li><li>
Work closely with system administrators and software developers to communicate, document and ultimately resolve deployment issues as they arise</li><li>
Deploy CHEETAS within disparate DoD testing Ranges and acquisition programs environments (on different non-standard hardware stacks and integrated into different existing ecosystems) sometimes located within DoD vaults with no outside internet connectivity</li></ul><p></p><p><b>
Work Environment:
</b></p><ul><li><b>Location:</b> Remote - The candidate can either work in one of KBR&rsquo;s facilities or work from home, with a stable internet connection.</li><li><b>
Travel Requirements:</b> This position is anticipated to require travel of 25% with surges possible up to 50% to support end users located at various DoD Ranges and Labs across the US (including Alaska and Hawaii).</li><li><b>
Working Hours:</b> Standard</li></ul><p></p><p><b>
Basic Qualifications/Knowledge:</b></p><ul><li>
Must have an active TS/SCI Security Clearance to be considered for this position.</li><li>
This position requires a bachelor's degree in a STEM Computer Science, Data Science, Statistics or related, technical field, and 10 years of DoD experience. <b>Entry level Big Data Engineers will NOT be considered due to the breadth of knowledge necessary to be successful in the position.</b></li><li>
Previous experience must include three (3) years of hands-on experience in the integration with and configuration of: SQL Server Big Data Cluster, CentOS, Ubuntu, RedHat, Windows Server, VMWare, etc.)</li><li>
Previous experience must include five (5) years of hands-on experience in big data environments.</li><li>
Must be adept at deploying and configuring Big Data and Knowledge Management tools in an enterprise environment.</li><li>
Must have extensive technical expertise in the configuration and troubleshooting of big data ecosystems.</li><li>
Must have excellent written and verbal communication skills and be comfortable assisting customers with installation and configuration of their big data infrastructure.</li><li>
Must have strong troubleshooting skills and the ability to become a CHEETAS deployment subject matter expert.</li><li>
Must be comfortable working with a wide range of stakeholders and functional teams at various levels of experience.</li><li>
Excellent interpersonal skills, oral and written communication skills, and strong personal motivation are necessary to succeed within this position.</li><li>
Experience with installation, configuration, integration with and usage of the following tools and technologies: NFS, SMB, S3, SQL Server, Windows Server, Windows 10/11, Linux (CentOS, Ubuntu, RedHat).</li><li>
Must be prepared to learn new business processes or CHEETAS application nuances every Agile sprint release (roughly every 6 weeks) prior to deploying to customer sites.</li><li>
Ability to problem solve, debug, and troubleshoot while under pressure and time constraints is required.</li><li>
Ability to communicate effectively about technical topics to both experts and non-experts at both the management and technical level is required.</li><li>
Ability to work independently and provide appropriate recommendations for optimal design, analysis, and development.</li><li>
Excellent verbal communications skills are required, as the Integration Engineer will be in frequent contact with the project technical lead, be taking direction from various government leads, and will frequently be interacting with end users to gather requirements and implement solutions while away from other team members.</li><li>
Excellent testing, debugging and problem-solving skills are required to be successful in this position.</li><li>
Experience designing, building, integrating with and maintaining both new and existing big data systems and solutions.</li><li>
Ability to speak and present findings in front of large groups.</li><li>
Ability to document and repeat procedures.</li><li>
This position is anticipated to require travel of 25% with surges possible up to 50% to support end users located at various DoD Ranges and Labs across the United States.</li></ul><p></p><p><b>
Preferred Qualifications:
</b></p><ul><li>Experience working in government/defense labs and their computing restrictions.</li><li>
Experience working with major DoD acquisition programs.</li><li>
Knowledge of the Test and Training Enabling Architecture (TENA), the Joint Mission Environment Testing Capability (JMETC) and distributed testing and training.</li><li>
Experience with working in distributed team environment.</li><li>
Ability to teach and mentor engineers with a variety of skill levels and backgrounds.</li><li>
Knowledge of DoD cybersecurity policies.</li></ul><p></p><p><b>
Basic Compensation:
</b></p><p><b>$142,400 - $180,000 (For the Denver, CO Area only)</b></p><p><b>
$148,900 - $200,000 (For the Los Angeles, CA Area Only)</b></p><p><b>
$148,900 - $200,00 (For the Washington, DC Area Only)</b></p><p></p><p>
The offered rate will be based on the selected candidate&rsquo;s working location, knowledge, skills, abilities and/or experience, clearance level, contract affordability and in consideration of internal parity.</p><p></p><p><b>
Additional Compensation:</b></p><p>
KBR may offer bonuses, commissions, or other forms of compensation to certain job titles or levels, per internal policy or contractual designation. Additional compensation may be in the form of a sign on bonus, relocation benefits, short-term incentives, long-term incentives, or discretionary payments for exceptional performance.</p><p></p><p>
Belong, Connect and Grow at KBR<br>
<br>
At KBR, we are passionate about our people and our Zero Harm culture. These inform all that we do and are at the heart of our commitment to, and ongoing journey toward being a People First company. That commitment is central to our team of team&rsquo;s philosophy and fosters an environment where everyone can Belong, Connect and Grow. We Deliver &ndash; Together.</p><p></p><p>
KBR is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, disability, sex, sexual orientation, gender identity or expression, age, national origin, veteran status, genetic information, union status and/or beliefs, or any other characteristic protected by federal, state, or local law.</p></div><p></p>

Big Data Systems Engineer

InterEx Group

<div>
 <p>
  A big client of ours in New York is currently searching for a AWS Data Engineer.
 </p>
 <p>
  <br/>
 </p>
 <p>
  They are one of the largest Retail businesses globally with over 100,000 employees whereby they are working extensively with AWS and are looking to build a team of AWS Data Engineers to support the build-out of a brand new data platform on AWS Data Lake. They are looking to hire 5 people for this team and are open to hiring both Contract and Full Time Employees.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Role Essentials:
 </p>
 <ul>
  <li>
   AWS Experience
  </li>
  <li>
   Data Modernization
  </li>
  <li>
   Data Bricks
  </li>
  <li>
   Data Lake
  </li>
  <li>
   Data Factory
  </li>
  <li>
   AWS certifications are a plus
  </li>
 </ul>
 <p>
 </p>
</div>


AWS St Data Engineer

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p>TCS Hiring Azure Data Engineer at PAN India locations!!</p>
<p>
Experience Range- 5 to12 Years</p>
<p>
Key Technical Skillsets-</p>
<p>
</p><ul><li>Strong proficiency in Python, Pyspark.</li>
<li>Data Ingestion and Integration: Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure. For example, you could use Azure Data Factory to orchestrate the extraction, transformation, and loading (ETL) of data from an on-premises SQL Server database to Azure Blob Storage.
</li><li>Data Transformation and Processing: Perform data transformation and processing tasks to prepare the data for analysis and reporting. Azure Databricks or Azure Synapse Analytics can be used for large-scale data transformations using tools like Apache Spark.</li>
<li>Data Storage and Management: Select and manage the appropriate storage solutions for your data. For instance, you could use Azure SQL Database or Azure Cosmos DB for structured data, Azure Data Lake Storage for big data and unstructured data, or Azure Blob Storage for file storage.</li>
<li>Data Warehousing: Implementing data warehousing solutions is a common use case for Azure Data Engineers. Azure Synapse Analytics (formerly Azure SQL Data Warehouse) offers scalable and distributed analytics capabilities for handling large datasets.</li>
<li>Data Modeling and Analysis: Collaborate with data scientists and analysts to design and implement data models for analytical workloads. Azure Analysis Services or Azure Databricks can be used for building and deploying models to support interactive data analysis.</li></ul><p><br>
</p></div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>CONSULTANCY</div>
</div><div><div><b>Role</b></div>
<div>Engineer</div>
</div><div><div><b>Job Id</b></div>
<div>404819</div>
</div><div><div><b>Desired Skills</b></div>
<div>Azure | Big Data | SQL</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Azure Data Engineer

Ascendion

<div><div><p><b>About Ascendion
</b></p><p>Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients. Headquartered in New Jersey, our workforce of 6,000+ Ascenders delivers solutions from around the globe. Ascendion is built differently to engineer the next.
</p><p><b>Ascendion | Engineering to elevate life
</b></p><ul><li>We have a culture built on opportunity, inclusion, and a spirit of partnership. Come, change the world with us:
</li><li>Build the coolest tech for the world&rsquo;s leading brands
</li><li>Solve complex problems &ndash; and learn new skills
</li><li>Experience the power of transforming digital engineering for Fortune 500 clients
</li><li>Master your craft with leading training programs and hands-on experience
</li><li>Experience a community of change makers!
</li></ul><p>Join a culture of high-performing innovators with endless ideas and a passion for tech. Our culture is the fabric of our company, and it is what makes us unique and diverse. The way we share ideas, learning, experiences, successes, and joy allows everyone to be their best at Ascendion.
</p><p><b>About the Role:
</b></p><p><b>Job Title: </b>Data Engineer
</p><p><b>Job Overview:
</b></p><p>We are looking for a skilled Data Engineer with strong experience in Python, GenAI/LLM technologies, and modern cloud-based data platforms. The ideal candidate will have hands-on expertise in building scalable data pipelines, working with large datasets, integrating AI/LLM frameworks, and developing data solutions using AWS and big data technologies. This role requires experience with both batch and real-time data processing, along with strong knowledge of databases, workflow orchestration, and vector database/RAG concepts.
</p><p><b>Key Responsibilities
</b></p><ul><li>Design, develop, and maintain scalable ETL/ELT and data pipeline solutions
</li><li>Build and optimize batch and real-time data processing systems
</li><li>Develop GenAI/LLM-powered applications using frameworks such as LangChain or LangGraph
</li><li>Implement RAG architectures and manage vector database indexing solutions
</li><li>Work with structured and unstructured data across multiple database technologies
</li><li>Integrate and manage big data solutions using Spark, Kafka, and cloud-native tools
</li><li>Create and maintain workflow orchestration pipelines using Apache Airflow
</li><li>Collaborate with cross-functional teams including Data Engineering, AI/ML, and Cloud teams
</li><li>Ensure data quality, scalability, security, and performance across data platforms
</li><li>Utilize AWS services such as S3, Glue, and Redshift for cloud-based data solutions
</li><li>Support and optimize data platforms like Databricks and Snowflake for analytics and AI use cases
</li></ul><p><b>Required Qualifications
</b></p><ul><li>Strong programming experience in Python
</li><li>Hands-on experience with GenAI/LLMs such as OpenAI or similar models
</li><li>Experience with LLM application frameworks like LangChain or LangGraph
</li><li>Understanding of RAG (Retrieval-Augmented Generation) concepts and Vector Database indexing
</li><li>Strong knowledge of SQL, Relational Databases, PostgreSQL, NoSQL, and MPP databases
</li><li>Experience building ETL/ELT pipelines and data processing workflows
</li><li>Hands-on experience with batch and real-time data processing
</li><li>Experience with Apache Spark and Apache Kafka
</li><li>Workflow orchestration experience using Apache Airflow
</li><li>Experience with Databricks or Snowflake data platforms
</li><li>Strong AWS experience including S3, Glue, Redshift, and secure cloud data pipelines
</li></ul><p><b>Location: </b>Plano, TX (Onsite role)
</p><p><b>Salary and Other Compensation: </b>The annual [salary/hourly rate] for this position is between [$90,000&ndash; 100,000 annually]/[$50.00- $55.00 per hour]. Factors which may affect pay within this range may include geography/market, skills, education, experience and other qualifications of the successful candidate.
</p><p><b>Benefits: </b>The Company offers the following benefits for this position, subject to applicable eligibility requirements: [medical insurance] [dental insurance] [vision insurance] [401(k) retirement plan] [long-term disability insurance] [short-term disability insurance] [5 personal days accrued each calendar year. The Paid time off benefits meet the paid sick and safe time laws that pertains to the City/ State] [10-15 days of paid vacation time] [6 paid holidays and 1 floating holiday per calendar year]
</p><p><b>Want to change the world? Let us know.
</b></p><p>Tell us about your experiences, education, and ambitions. Bring your knowledge, unique viewpoint, and creativity to the table. Let&rsquo;s talk!</p></div></div><div></div>
<br><div><div><h4 class="jobSectionHeader"><b>Preferred Skills
</b></h4><div><div>AWS
<ul><li><div>Python
</div></li><li><div>SQL AWS
</div></li><li><div>SQL
</div></li><li><div>AI/ML
</div></li></ul></div></div></div><div><h4 class="jobSectionHeader"><b>Job details
</b></h4><div><div><h6 class="jobSectionHeader"><b>Job ID
</b></h6><p>332142
</p></div><div><h6 class="jobSectionHeader"><b>Job Requirements
</b></h6><p>Data Engineer
</p></div><div><h6 class="jobSectionHeader"><b>Location
</b></h6><p>Plano, Texas, US
</p></div><div><h6 class="jobSectionHeader"><b>Recruiter
</b></h6><p>Rahul
</p></div><div><h6 class="jobSectionHeader"><b>Email
</b></h6><p>rahul.mandal@ascendion.com
</p></div></div></div><div><h4 class="jobSectionHeader"><b>About Ascendion
</b></h4><div><h6 class="jobSectionHeader"><b>Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees.
</b></h6><p>Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients. Headquartered in New Jersey, our workforce of 6,000+ Ascenders delivers solutions from around the globe. Ascendion is built differently to engineer the next.</p></div></div></div>

Data Engineer

Search 10000+ Big data engineer jobs near you this May. New roles added regularly across leading industries. Apply today.

10000 big data engineer jobs Near Me

Big Data Engineer

Big Data Engineer

Senior Big Data Engineer

Big Data Systems Engineer

AWS St Data Engineer

Azure Data Engineer

Data Engineer