big data software engineer

Hexaware Technologies

Role Big Data Engineer Responsibilities Implement Data integration and Data Warehouse based solutions using Big Data Technologies. Should be highly proficient in the use of Big Data / Open Source Technologies and standard techniques of Data Integration; Data Manipulation with hands-on contribution. Should be able to develop cost efficient and performant data pipelines in the cloud platform In-depth understanding of modern big data technology; including Data modeling and machine learning skills Knowledge of real time data streaming and aggregation architectural patterns and practice Essential Skills: 3+ Years hands on knowledge on SQL as well as SQL/NoSQL databases Proficient in programming languages such as Python and PySpark/Scala/Java Experience with Apache Spark in On-prem / Cloud (Databricks / EMR / DataProc HDInsight) Working knowledge of API development Experience in building data pipelines in ETL/ELT methods Experience with integration of data from multiple data sources Experience in one of the NoSQL databases; such as HBase; Cassandra; MongoDB

Big Data Engineer

<div><p><b>Title:</b></p>
Big Data Systems Engineer<p></p><p><b>
Belong, Connect, Grow, with KBR!</b></p><p>
KBR&rsquo;s National Security Solutions (NSS) team provides high-end engineering and advanced technology solutions to our customers in the intelligence and national security communities. In this position, your work will have a profound impact on the country&rsquo;s most critical role &ndash; protecting our national security.</p><p></p><p>
KBR is seeking a Big Data Systems Engineer to join our team. The successful candidate will be part of the KBR team supporting the Test Resource Management Center&rsquo;s (TRMC) Big Data (BD) and Knowledge Management (KM) Team deploying BD and KM systems for DoD testing Ranges and various acquisition programs.</p><p></p><p><b>
Responsibilities:
</b></p><ul><li>The Big Data Systems Engineer will work on the deployment and integration of a highly visible data analytic project called Cloud Hybrid Edge-to-Enterprise Evaluation Test &amp; Analysis Suite (CHEETAS) at multiple DoD ranges and labs.</li><li>
As a Big Data Systems Engineer, you will be a critical part of our technical team responsible for deploying CHEETAS within customer environments. You will be the frontline interface that customers will have when first experiencing CHEETAS within their DoD Range and lab environments.</li><li>
This position will require you to work closely with system administrators and software developers to communicate, document and ultimately resolve deployment issues as they arise.</li><li>
You will deploy CHEETAS within disparate DoD testing Ranges and acquisition programs environments (on different non-standard hardware stacks and integrated into different existing ecosystems) sometimes located within DoD vaults with no outside internet connectivity.</li><li>
Work on the deployment and integration of a highly visible data analytic project called Cloud Hybrid Edge-to-Enterprise Evaluation Test &amp; Analysis Suite (CHEETAS) at multiple DoD ranges and labs</li><li>
Deploy CHEETAS within customer environments</li><li>
Work closely with system administrators and software developers to communicate, document and ultimately resolve deployment issues as they arise</li><li>
Deploy CHEETAS within disparate DoD testing Ranges and acquisition programs environments (on different non-standard hardware stacks and integrated into different existing ecosystems) sometimes located within DoD vaults with no outside internet connectivity</li></ul><p></p><p><b>
Work Environment:
</b></p><ul><li><b>Location:</b> Remote - The candidate can either work in one of KBR&rsquo;s facilities or work from home, with a stable internet connection.</li><li><b>
Travel Requirements:</b> This position is anticipated to require travel of 25% with surges possible up to 50% to support end users located at various DoD Ranges and Labs across the US (including Alaska and Hawaii).</li><li><b>
Working Hours:</b> Standard</li></ul><p></p><p><b>
Basic Qualifications/Knowledge:</b></p><ul><li>
Must have an active TS/SCI Security Clearance to be considered for this position.</li><li>
This position requires a bachelor's degree in a STEM Computer Science, Data Science, Statistics or related, technical field, and 10 years of DoD experience. <b>Entry level Big Data Engineers will NOT be considered due to the breadth of knowledge necessary to be successful in the position.</b></li><li>
Previous experience must include three (3) years of hands-on experience in the integration with and configuration of: SQL Server Big Data Cluster, CentOS, Ubuntu, RedHat, Windows Server, VMWare, etc.)</li><li>
Previous experience must include five (5) years of hands-on experience in big data environments.</li><li>
Must be adept at deploying and configuring Big Data and Knowledge Management tools in an enterprise environment.</li><li>
Must have extensive technical expertise in the configuration and troubleshooting of big data ecosystems.</li><li>
Must have excellent written and verbal communication skills and be comfortable assisting customers with installation and configuration of their big data infrastructure.</li><li>
Must have strong troubleshooting skills and the ability to become a CHEETAS deployment subject matter expert.</li><li>
Must be comfortable working with a wide range of stakeholders and functional teams at various levels of experience.</li><li>
Excellent interpersonal skills, oral and written communication skills, and strong personal motivation are necessary to succeed within this position.</li><li>
Experience with installation, configuration, integration with and usage of the following tools and technologies: NFS, SMB, S3, SQL Server, Windows Server, Windows 10/11, Linux (CentOS, Ubuntu, RedHat).</li><li>
Must be prepared to learn new business processes or CHEETAS application nuances every Agile sprint release (roughly every 6 weeks) prior to deploying to customer sites.</li><li>
Ability to problem solve, debug, and troubleshoot while under pressure and time constraints is required.</li><li>
Ability to communicate effectively about technical topics to both experts and non-experts at both the management and technical level is required.</li><li>
Ability to work independently and provide appropriate recommendations for optimal design, analysis, and development.</li><li>
Excellent verbal communications skills are required, as the Integration Engineer will be in frequent contact with the project technical lead, be taking direction from various government leads, and will frequently be interacting with end users to gather requirements and implement solutions while away from other team members.</li><li>
Excellent testing, debugging and problem-solving skills are required to be successful in this position.</li><li>
Experience designing, building, integrating with and maintaining both new and existing big data systems and solutions.</li><li>
Ability to speak and present findings in front of large groups.</li><li>
Ability to document and repeat procedures.</li><li>
This position is anticipated to require travel of 25% with surges possible up to 50% to support end users located at various DoD Ranges and Labs across the United States.</li></ul><p></p><p><b>
Preferred Qualifications:
</b></p><ul><li>Experience working in government/defense labs and their computing restrictions.</li><li>
Experience working with major DoD acquisition programs.</li><li>
Knowledge of the Test and Training Enabling Architecture (TENA), the Joint Mission Environment Testing Capability (JMETC) and distributed testing and training.</li><li>
Experience with working in distributed team environment.</li><li>
Ability to teach and mentor engineers with a variety of skill levels and backgrounds.</li><li>
Knowledge of DoD cybersecurity policies.</li></ul><p></p><p><b>
Basic Compensation:
</b></p><p><b>$142,400 - $180,000 (For the Denver, CO Area only)</b></p><p><b>
$148,900 - $200,000 (For the Los Angeles, CA Area Only)</b></p><p><b>
$148,900 - $200,00 (For the Washington, DC Area Only)</b></p><p></p><p>
The offered rate will be based on the selected candidate&rsquo;s working location, knowledge, skills, abilities and/or experience, clearance level, contract affordability and in consideration of internal parity.</p><p></p><p><b>
Additional Compensation:</b></p><p>
KBR may offer bonuses, commissions, or other forms of compensation to certain job titles or levels, per internal policy or contractual designation. Additional compensation may be in the form of a sign on bonus, relocation benefits, short-term incentives, long-term incentives, or discretionary payments for exceptional performance.</p><p></p><p>
Belong, Connect and Grow at KBR<br>
<br>
At KBR, we are passionate about our people and our Zero Harm culture. These inform all that we do and are at the heart of our commitment to, and ongoing journey toward being a People First company. That commitment is central to our team of team&rsquo;s philosophy and fosters an environment where everyone can Belong, Connect and Grow. We Deliver &ndash; Together.</p><p></p><p>
KBR is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, disability, sex, sexual orientation, gender identity or expression, age, national origin, veteran status, genetic information, union status and/or beliefs, or any other characteristic protected by federal, state, or local law.</p></div><p></p>

Big Data Systems Engineer

Akina, Inc.

<div><p><b>TS/SCI - Polygraph required</b><br>
02-491-SWE2<br>
<b>Telework: No</b><br>
<br>
<b>LCAT Description:</b><br>
The Software Engineer designs, develops, tests, deploys, documents, maintains, and enhances complex and diverse software systems based upon documented requirements. These systems might include, but are not limited to, processing intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, business management information systems, and systems which incorporate data repositories, data transport services, and application and systems development and monitoring. Works individually or as part of a team. Reviews and tests software components for adherence to the design requirements and documents test results. Resolves software problem reports. Utilizes software development and software design methodologies appropriate to the development environment. Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Open-Source Software (OSS) and/or Commercial Off-The-Shelf (COTS) Government Off-The-Shelf (GOTS) software in place of new development, and requirements analysis and synthesis from system level to individual software components. Experience developing in Unix. Ability to perform shell scripting. Working knowledge of Configuration Management (CM) tools and Web Services implementation.<br>
<br>
<b>The Level II Software Engineer (SWE) shall possess the following capabilities:</b></p>
<ul><li>Analyze user requirements to derive software design and performance requirements.</li>
<li>Debug existing software and correct defects.</li>
<li>Design and code new software or modify existing software to add new features.</li>
<li>Write or review software and system documentation.</li>
<li>Integrate existing software into new or modified systems or operating environments.</li>
<li>Develop simple data queries for existing or proposed databases or data repositories.</li>
<li>Software development using languages such as C, C++, Python, Ruby, Perl, JavaScript, etc.</li>
<li>Has experience with agile development processes.</li>
<li>Has experience with source code control systems, such as Git.</li>
<li>Serve as team lead at the level appropriate to the software development process being used on any particular project.</li>
<li>Design and development of relational and non-relational database applications.</li>
<li>Use of orchestration frameworks such as Spring and Kafka.</li>
<li>Familiarization with queue management systems</li>
<li>Develop or implement algorithms to meet or exceed system performance and functional standards.</li>
<li>Develop and execute test procedures for software components.</li>
<li>Develop software solutions by analyzing system performance standards and conferring with users or system engineers; analyzing systems flow, data usage and work processes; and investigating problem areas.</li>
<li>Modify existing software to adapt to new hardware or to improve its performance</li>
<li>Design, develop, and modify software systems using scientific analysis and mathematical models to predict and measure outcomes and consequences of design decisions</li>
<li>Java development using the Eclipse IDE (Integrated Development Environment).</li>
<li>Development of Java 2 Enterprise Edition (J2EE) applications</li>
<li>Experience using collaboration and software development tools (i.e. Atlassian).</li>
<li>Software development using continuous integration practices</li>
<li>Experience with container technologies (i.e. Docker).</li>
<li>Unix shell scripting</li>
<li>Development of event driven, or data driven analytics</li>
<li>Development of cloud-based solutions and technologies.</li>
<li>Design or implement complex algorithms requiring adherence to strict timing, system resource, or interface constraints. Perform quality control on team products.</li>
<li>Recommend and implement suggestions for improving documentation and software development process standards.</li>
<li>Oversee one or more software development teams and ensure the work is completed in accordance with the constraints of the software development process being used on any particular project.</li>
<li>Confer with system engineers and hardware engineers to derive software requirements and to obtain information on project limitations and capabilities, performance requirements, and interfaces.</li>
<li>Coordinate software installation on a system and monitor performance to ensure operational specifications are met.</li>
</ul><b>Position Description
</b><br>
The Software Engineer shall be responsible for identifying ways to create consistent and repeatable capabilities including transforming raw, complex, and often unstructured data into clean, reliable, and high-quality analysis-ready datasets that support advanced analytics, predictive modeling, and data-driven decision-making across the organization.
<br>
<b>Position Required Skills
</b><ul><li>Experience using the Linux CLI and Linux tools</li>
<li>Experience developing Bash scripts to automate manual processes</li>
<li>Recent software development experience using Python</li>
<li>Familiar with Distributed Big Data processing engines including Apache Spark
</li><li>Experience using Jupyter Notebook</li>
<li>Experience with data wrangling and preprocessing tools such as pandas and NumPy</li>
<li>Experience working with structured, semi-structured, and unstructured data
</li><li>Familiarity with data quality concepts, data validation, and anomaly detection</li>
<li>Experience with Git Source Control System</li>
</ul><b>Position Desired Skills
</b><ul><li>Familiar with Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows</li>
<li>Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets</li>
<li>Familiar with HPC Job Scheduling tools including Slurm</li>
<li>Experience using the Atlassian Tool Suite (JIRA, Confluence)
</li></ul><p><b>S</b><b>WE</b><b>-</b><b>2</b><b> Qualifications</b>:
<br>
Master&rsquo;s degree in computer science or related discipline from an accredited college or university, plus three (3) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.<br>
OR<br>
Bachelor&rsquo;s degree in computer science or related discipline from an accredited college or university, plus five (5) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity<br>
OR<br>
Seven (7) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.<br>
<br>
<br>
<b><i>Salary Range:
</i></b><br>
$190k-$230k (Annually)*<br>
<b><i>*</i></b> <i>*The range displayed above is a likely salary range for this position. This is not, however, a guarantee of compensation or salary. Rather, salary will be set based on experience, geographic location and possible contractual requirements and could fall outside of this range.</i><br>
<br>
<b><i>Akina is a Woman Owned, Service Disabled, Veteran Owned, Small Business, looking for talented and ambitious individuals to join our team. We offer a generous compensation package that includes 24 days PTO accrued annually and 11 federal holidays. Our 401k is 100% vested on your start date and the company makes a direct contribution worth 10% of your salary. Akina covers 100% of healthcare costs for employees and 50% toward dependents. We offer educational assistance towards college classes and will cover costs associated with job related training and certifications Akina is committed to excellence and creating innovative and flexible solutions for our clients. We are a small company with an open ear to our employees' needs in order to attract and retain quality talent that enables our customer's mission.</i></b><br>
<b><i>We are an equal employment opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.</i></b><br>
<b><i>www.akina-inc.com/careers</i></b></p></div>

Software Engineer - 2 (Big Data, Linux, Bash)

Apple

<p>The Apple Services Engineering team is one of the most exciting examples of Apple&rsquo;s long-held passion for combining art and technology. This team powers the App Store, Apple TV, Apple Music, Apple Podcasts, and Apple Books, operating at massive scale and meeting Apple&rsquo;s high standards for performance and quality to deliver entertainment in over 35 languages across more than 150 countries.<br>
<br>
We are seeking a Software Engineer to join Apple Services Engineering (ASE) who brings a deep passion for building large-scale distributed data processing systems, frameworks, and platforms using big data technologies.<br>
<br>
<b>Description</b><br>
<br>
As a team member of the ASE Analytics &amp; Data Engineering team, you will have significant responsibility and influence in shaping the team&rsquo;s future direction. This role is inherently cross-functional, and the ideal candidate will work closely across disciplines. We are looking for someone with a strong love for data and the ability to iterate quickly across all stages of the data pipeline lifecycle.<br>
<br>
This position involves working on a small, highly collaborative team to develop large-scale data pipelines and analytical solutions using big data technologies. Successful candidates will demonstrate strong engineering and communication skills, along with a belief that data-driven processes lead to exceptional products. You should have a passion for quality and an ability to understand and evolve sophisticated systems.<br>
<br>
&quot;,&quot;responsibilities&quot;:&quot;You will have the opportunity to:<br>
<br>
Work with a cross-functional team, collaborating with partners across product, engineering, operations, and business, and closely partner with stakeholders to translate requirements into scalable engineering solutions<br>
<br>
Help drive architectural vision to support future growth and opportunities<br>
<br>
Design, build, and maintain data pipelines and datasets that power key product features and insights, while protecting user privacy<br>
<br>
Own data quality, scalability, and SLAs for assigned datasets and pipelines<br>
<br>
Champion technical excellence and cultivate team spirit by contributing to best practices, documentation, shared tools, and solutions to common problems<br>
<br>
<b>Preferred Qualifications</b><br>
<br>
Experience with GDPR compliance and best practices for collecting, processing, and sharing data responsibly.<br>
<br>
Excellent collaboration and communication skills, with the ability to listen, influence, and drive solutions cohesively.<br>
<br>
<b>Minimum Qualifications</b><br>
<br>
Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Statistics, a related quantitative field, or equivalent practical experience.<br>
<br>
3+ years of experience building production systems using Java and/or Scala, with strong proficiency in Java and/or Scala for large-scale distributed data processing and familiarity with functional programming paradigms.<br>
<br>
Strong computer science fundamentals with proven problem-solving skills.<br>
<br>
Deep understanding of distributed batch and streaming data processing systems such as Spark, Flink, and Kafka.<br>
<br>
Experience with big data ecosystem technologies such as HDSF, Hadoop, S3, MPP database, Kubernetes and Airflow.<br>
<br>
Proven track record of designing, launching, and scaling production-quality data pipelines that power product features.<br>
<br>
Strong data intuition, backed by solid SQL and data analysis skills.<br>
<br>
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .<br>
<br>
<b>Pay &amp; Benefits</b><br>
<br>
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $147,400 and $272,100, and your base pay will depend on your skills, qualifications, experience, and location.<br>
<br>
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.<br>
<br>
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.</p>

Software Engineer, Big Data - Apple Services Engineering

<p>Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you can accomplish.<br>
<br>
Would you like the stimulation and challenges of building world-class, extraordinary scalable systems that power App Store, Music, TV+, Fitness+, Arcade, Payments and many more? Then this is the opportunity for you at Apple! We strive to provide a flawless experience for millions of customers and developers.<br>
<br>
We are seeking a Software Engineer to join Apple Services Engineering (ASE) who brings deep passion for building distributed large scale data processing systems, frameworks and platforms using big data technologies.<br>
<br>
<b>Description</b><br>
<br>
Data is our first class citizen and the foundation of any AI features. The volume of the data is on petabytes scale. And we are software engineers who build distributed systems to generate data analytics. The systems should scale well, be highly available and provide consistent results.<br>
<br>
The systems we build have significant impact on our stakeholders. And most importantly, we are deeply committed to Apple&rsquo;s privacy policy, which forms Apple&rsquo;s core values. You will have important responsibility and influence in designing and building the data platform to empower businesses, operations, data analytics and AI feature. &quot;,&quot;responsibilities&quot;:&quot;Join a fast growing team of data engineers to develop and iterate quickly on all stages of data processing.<br>
<br>
Lead, design, develop, and drive the unique solutions necessary to scale to Apple Service&rsquo;s diverse data requirements.<br>
<br>
Innovate and inspire a scalable data vision for current and extension to support AI needs. Influence internal teams, partners, and stakeholders to execute on that vision.<br>
<br>
Drive for quality, scalability and a strong collaborative environment.<br>
<br>
<b>Preferred Qualifications</b><br>
<br>
Strong analytical skills with solid understanding of data structures and algorithms.<br>
<br>
Excellent communicator, able to explain complex concepts clearly.<br>
<br>
Strong interest in processing data to power embedded and AI features.<br>
<br>
<b>Minimum Qualifications</b><br>
<br>
BS/MS in Computer Science or related field with 8+ years of experience.<br>
<br>
Strong programming skills in Java, Scala, SQL, with hands-on experience in distributed compute/storage systems like Spark, Iceberg, Cassandra, Hadoop/HDFS, AWS/S3.<br>
<br>
Multi-year experience in big data processing of batch and streaming using Flink and Spark.<br>
<br>
Proven ability to lead engineering projects from design to production across teams.<br>
<br>
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .<br>
<br>
<b>Pay &amp; Benefits</b><br>
<br>
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location.<br>
<br>
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.<br>
<br>
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.</p>

Sr. Software Engineer, Big Data - Apple Services Engineering

Tata Consultancy Services (TCS)

<div></div><div><div><div><div><p>TCS Walk-in Drive at Hyderabad- Synergy Park</p>
<p>
Date- 11-Apr-26</p>
<p>
JD</p>
<p>
</p><div><div><div><div><div>Skills and Experience Required</div><br>
</div><div><ul><li> 3+ years of hands-on experience working with Databricks, Apache Spark, or related big data platforms</li></ul>
<ul><li> Proficiency in programming languages such as Python, Scala, or SQL for data transformation and pipeline development</li></ul>
<ul><li> Hands-on experience with Spark SQL, Delta Lake, Lakeflow Spark Declarative Pipelines and Unity Catalog</li></ul>
<ul><li> Strong understanding of ETL/ELT workflows, data modeling, and data warehousing concepts</li></ul>
<ul><li> Experience with cloud platforms (Azure, AWS, or GCP)</li></ul>
<ul><li> Familiarity with CI/CD practices and version control tools such as Git</li></ul>
<ul><li> Knowledge of data governance, data quality, and security best practices</li></ul>
<ul><li> Excellent problem-solving, analytical, and communication skills.</li></ul>
<ul><li> Ability to work collaboratively in an agile team environment</li></ul>
<ul><li> Databricks certifications are preferred</li></ul><br>
</div></div><br>
<div><div><div>Responsibilities</div><br>
</div><div><ul><li> Implement data ingestion, transformation, and integration processes from various structured and unstructured data sources</li></ul>
<ul><li> Develop, maintain, and optimize scalable data pipelines and workflows on the Databricks platform</li></ul>
<ul><li> Collaborate with analysts and business stakeholders to understand data requirements and deliver solutions</li></ul>
<ul><li> Ensure data reliability, quality, and security across all data engineering processes</li></ul>
<ul><li> Troubleshoot, debug, and resolve data pipeline issues and performance bottlenecks</li></ul>
<ul><li> Document data engineering workflows and technical designs</li></ul>
<ul><li> Monitor and maintain data pipeline health, proactively addressing any potential issues</li></ul>
<ul><li> Stay up-to-date with emerging data engineering technologies and best practices, especially within the Databricks ecosystem</li></ul><br>
</div></div><br>
</div></div><br>
</div></div></div><div><div><div><b>Location</b></div>
<div>Hyderabad</div>
</div><div><div><b>Job Function</b></div>
<div>TECHNOLOGY</div>
</div><div><div><b>Role</b></div>
<div>Developer</div>
</div><div><div><b>Job Id</b></div>
<div>405018</div>
</div><div><div><b>Desired Skills</b></div>
<div>Python | Scala | SQL | Apache Spark</div>
</div></div><p>Desired Candidate Profile
</p><div><div><b>Qualifications</b> : BACHELOR OF TECHNOLOGY</div></div></div><div></div>

Databricks Engineer

Amazon.com

<div><h2 class="jobSectionHeader"><b>DESCRIPTION</b></h2><div>
We are looking for a Data Platform Engineer to build the foundational data systems that power our robotics and machine learning development. In this role, you will design and implement the infrastructure for collecting, storing, processing, and transforming the vast amounts of data generated by our robots&mdash;from sensor telemetry and video streams to operational logs and performance metrics.
<br>
You'll work closely with ML teams to ensure data is accessible, well-structured, and ready for training. Your work will enable research teams to iterate faster and operations teams to monitor fleet performance as we scale.
<br>
<br>
Key job responsibilities<br>
<ul><li>Design and build scalable data pipelines for ingesting and processing robotics data (sensor streams, video, telemetry, logs)
</li><li>Develop and maintain data storage solutions optimized for diverse data types and access patterns
</li><li>Create tools and APIs for researchers and engineers to efficiently query and analyze large datasets
</li><li>Build real-time data processing systems for monitoring robot fleet performance
</li><li>Build and maintain data transformation pipelines that prepare robotics data for ML training
</li><li>Collaborate with ML and robotics teams to ensure data platforms meet their evolving needs
</li></ul><br>
About the team<br>
Fauna Robotics, an Amazon company, is building capable, safe, and genuinely delightful robots for everyday life. Our goal is simple: make robots people actually want to live and interact with in everyday human spaces.<br>
We believe that future won&rsquo;t arrive until building for robotics becomes far more accessible. Today, too much effort is spent reinventing the fundamentals. We&rsquo;re changing that by developing tightly integrated hardware and software systems that make it faster, safer, and more intuitive to create real-world robotic products.<br>
Our work spans the full stack: mechanical design, control systems, dynamic modeling, and intelligent software. The focus is not just functionality, but experience. We&rsquo;re building robots that feel responsive, expressive, and genuinely useful.<br>
At Fauna, you&rsquo;ll work at the frontier of this space, helping define how robots move, manipulate, and interact with people in natural environments. It&rsquo;s an opportunity to solve hard problems across hardware and software with a team focused on making robotics accessible and joyful to build.<br>
If you care about making robotics real for everyone and building systems that are as delightful as they are capable, we&rsquo;re interested in hearing from you.</div><h2 class="jobSectionHeader"><b>
BASIC QUALIFICATIONS</b></h2><ul><li>Bachelor's degree or above in computer science, computer engineering, or related field, or experience in data science, machine learning or data mining</li><li>3+ years of data engineering experience</li><li>Experience in scripting for automation (e.g. Python) and advanced SQL skills.</li><li>Experience in Kafka, or experience in Hive/Spark/Hbase/Yarn and experience in software development</li><li>Experience with cloud computing technologies</li><li>Knowledge of distributed systems as it pertains to data storage and computing</li><li>Proficiency with data storage technologies (e.g., PostgreSQL, object storage)</li></ul><h2 class="jobSectionHeader"><b>
PREFERRED QUALIFICATIONS</b></h2><ul><li>Experience working with robotics or IoT data (time-series, video, point clouds)</li><li>Knowledge of streaming architectures and real-time analytics</li><li>Familiarity with ML techniques and how data preparation impacts model training</li><li>Experience with data cataloging, metadata management, and data discovery tools</li></ul><br>
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.<br>
<br>
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner.<p><br>
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.</p><br>
USA, NY, New York - 145,300.00 - 196,600.00 USD annually</div><p></p>

Data Platform Engineer, Fauna

Search 10000+ Big data software engineer jobs near you this April. New roles added regularly across leading industries. Apply today.