big data developer

Data Based Development Systems

<div>
 <p>
  **Must be able to be onsite in Farmington, CT 2 days a week for collaboration**
 </p>
 <p>
  <br/>
 </p>
 <p>
  The Opportunity: We are seeking a software engineer/developer or ETL/data integration/big data developer with experience in projects emphasizing data processing and storage. This person will be responsible for supporting the data ingestion, transformation, and distribution to end consumers. Candidate will perform requirements analysis, design/develop process flow, unit and integration tests, and create/update process documentation.
 </p>
 <p>
  <br/>
 </p>
 <p>
  &middot; Work with the Business Intelligence team and operational stakeholders to design and implement both the data presentation layer available to the user community, as well as the underlying technical architecture of the data warehousing environment. &middot; Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes. &middot; Design and develop database objects, tables, stored procedures, views, etc. &middot; Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end &middot; Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases &middot; Understands the concept of Data marts and Data lakes and experience with migrating legacy systems to data marts/lake &middot; Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server) &middot; Maintain comprehensive project documentation &middot; Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement. &middot; Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members. &middot; Manage multiple projects, responsibilities and competing priorities.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Requirements Experience Needed: &middot; Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, and VB &middot; Database platforms such as: Oracle, SQL Server, MySQL &middot; Big data concepts and technologies such as Synapse &amp; Databricks &middot; AWS and Azure cloud computing &middot; HVR data replication
 </p>
</div>


Databricks Data Engineer

Amazon Web Services

<div><h2 class="jobSectionHeader"><b>DESCRIPTION</b></h2><div>
Want to change the world with Big Data and Analytics? Come join us on the Amazon EMR team in Amazon Web Services!<br>
<br>
Amazon EMR is a web service which enables customers to run massive clusters with open-source data processing frameworks like Apache Hadoop, Spark, Hive, Presto, HBase and more, with the ability to effortlessly scale up and down as needed. We run large number of customer clusters, enabling a variety of customer use cases including analytics and web-scale machine learning.<br>
<br>
We are developing innovative new features including our next-generation cluster management system, improvements for real-time processing of big data, and ways to enable customers to more easily interact with their data. We&rsquo;re looking for top engineers to build them from the ground up.<br>
<br>
Key job responsibilities<br>
You will work backwards from the customer needs and you will get to do everything from designing and building large scale systems and features for the savviest customers in the business. You will have a chance to work with the open source community and contribute significant portions its software to open source projects including Hadoop, Spark, Hive, Presto and HBase. You need to not only be a top software developer with excellent programming skills, an understanding of distributed systems and parallel data processing, and a stellar record of delivery but also excel at leadership and customer obsession and have a real passion for massive-scale computing. If you want to truly test your mettle against the hardest challenges in distributed systems to build solutions for large scale problems in a wide variety of domains, come join our group. Your responsibilities will include:<br>
<br>
<ul><li>Designing and building the next-generation technologies that will make EMR the best environment to run large-scale data processing workloads.</li><li>Working on complex problems in distributed systems and query engines.</li><li>Translation of complex functional and technical requirements into detailed architecture and design.</li><li>Deliver systems and features with top-notch quality, on time.</li><li>Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production EMR systems.</li></ul><br>
About the team<br>
By joining our team, you will get to work with a minimum of technical supervision, while playing a variety of roles as needed to respond efficiently to multiple program priorities. You will get to collaborate with some of the best and brightest minds in the industry. You'll enjoy a competitive salary, great benefits, a creative and agile work environment, and the exciting opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies - but most of all, you will get the satisfaction of making products that millions use everyday to great effect!<br>
For more information:<br>
<br>
AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/<br>
AWS EMR: https://aws.amazon.com/emr/<br>
<br>
About AWS
<br>
AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn&rsquo;t followed a traditional path, or includes alternative experiences, don&rsquo;t let it stop you from applying.
<br>
<br>
Why AWS? Amazon Web Services (AWS) is the world&rsquo;s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating &mdash; that&rsquo;s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
<br>
<br>
Inclusive Team Culture Here at AWS, it&rsquo;s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness.
<br>
<br>
Mentorship &amp; Career Growth We&rsquo;re continuously raising our performance bar as we strive to become Earth&rsquo;s Best Employer. That&rsquo;s why you&rsquo;ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
<br>
<br>
Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there&rsquo;s nothing we can&rsquo;t achieve in the cloud.</div><h2 class="jobSectionHeader"><b><br>
BASIC QUALIFICATIONS</b></h2><ul><li>2+ years of non-internship professional software development experience</li><li>Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design</li><li>1+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling) experience</li></ul><h2 class="jobSectionHeader"><b>
PREFERRED QUALIFICATIONS</b></h2><ul><li>Master's degree in Computer Science, Engineering, Mathematics, or a related field, or 5+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience</li><li>Knowledge of Big Data application such as Spark and Presto</li><li>Knowledge of Container Platforms such as Docker and related technologies</li></ul><br>
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.<br>
<br>
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you&rsquo;re applying in isn&rsquo;t listed, please contact your Recruiting Partner.<p><br>
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life &amp; AD&amp;D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.</p><br>
USA, WA, Redmond - 143,700.00 - 194,400.00 USD annually</div><p></p>

Software Development Engineer – Big Data, AWS Elastic MapReduce (EMR)

Muller's Solutions

<div><p>M&uuml;ller&rsquo;s Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.</p>
Key Responsibilities:<ul>
<li>Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka.</li>
<li>Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs.</li>
<li>Ensure high data quality and integrity by implementing robust data validation and testing processes.</li>
<li>Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments.</li>
<li>Monitor and troubleshoot data processing workflows to ensure timely data delivery.</li>
<li>Document data architectures, processes, and workflows for knowledge sharing and compliance.</li>
<li>Stay ahead of industry trends and best practices in big data technologies and methodologies.</li><br>
</ul><br>
<br>
<b>Requirements</b><p><b><br>
Requirements:</b></p><ul>
<li>Bachelor's degree in Computer Science, Information Technology, or a related field.</li>
<li>3+ years of experience as a Big Data Engineer or in a similar data engineering role.</li>
<li>Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka.</li>
<li>Strong coding skills in programming languages like Java, Scala, or Python.</li>
<li>Familiarity with data processing frameworks and ETL tools.</li>
<li>Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery).</li>
<li>Analytical mindset and excellent problem-solving abilities.</li>
<li>Strong communication skills to collaborate effectively with technical and non-technical stakeholders.</li>
<li>A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines.</li>
</ul><p><b>Preferred Qualifications:</b></p><ul>
<li>Experience with machine learning frameworks and algorithms is a plus.</li>
<li>Knowledge of data governance and security best practices.</li>
<li>Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes.</li><br>
</ul><br>
<br>
<b>Benefits</b><p><br>
1- Attractive Package.
</p><p>2- Family Benefits.
</p><p>3- Visa.</p><p>
4-Air Tickets.</p></div><p></p>

Big Data Engineer

Müller's Solutions

<div>
 M&uuml;ller's Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.
 <br/>
 <br/>
 <strong>
  Key Responsibilities:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka
  </li>
  <li>
   Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs
  </li>
  <li>
   Ensure high data quality and integrity by implementing robust data validation and testing processes
  </li>
  <li>
   Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments
  </li>
  <li>
   Monitor and troubleshoot data processing workflows to ensure timely data delivery
  </li>
  <li>
   Document data architectures, processes, and workflows for knowledge sharing and compliance
  </li>
  <li>
   Stay ahead of industry trends and best practices in big data technologies and methodologies
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Requirements
  <br/>
  <br/>
 </strong>
 <strong>
  Requirements:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Bachelor's degree in Computer Science, Information Technology, or a related field
  </li>
  <li>
   3+ years of experience as a Big Data Engineer or in a similar data engineering role
  </li>
  <li>
   Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka
  </li>
  <li>
   Strong coding skills in programming languages like Java, Scala, or Python
  </li>
  <li>
   Familiarity with data processing frameworks and ETL tools
  </li>
  <li>
   Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery)
  </li>
  <li>
   Analytical mindset and excellent problem-solving abilities
  </li>
  <li>
   Strong communication skills to collaborate effectively with technical and non-technical stakeholders
  </li>
  <li>
   A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Preferred Qualifications:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Experience with machine learning frameworks and algorithms is a plus
  </li>
  <li>
   Knowledge of data governance and security best practices
  </li>
  <li>
   Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Benefits
  <br/>
  <br/>
 </strong>
 1- Attractive Package.
 <br/>
 <br/>
 2- Family Benefits.
 <br/>
 <br/>
 3- Visa.
 <br/>
 <br/>
 4-Air Tickets.
</div>


Wipro

<div>Job Description<p></p><div><div><ul><li><div><b><br>
</b><br>
</div></li></ul></div></div><div><div><div><div>Job Title: Big Data Engineer
</div></div></div></div><div><div><div><div>City: Pennington
</div></div></div></div><div><div><div><div>State/Province: New Jersey
</div></div></div></div><div><div><div><div>Posting Start Date: 3/17/26
</div></div></div></div><div><div><div><div>Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients&rsquo; most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at www.wipro.com.
</div></div></div></div><div><div><div><div>Job Description:
<div><div><div><h2 class="jobSectionHeader"><b>Job Description
</b></h2></div><div><div><b>Role: Big Data Engineer
</b></div><div><b>Location: Pennington, NJ (3 Day onsite/Week)<br>
</b></div><div></div><div><b>Job Description:
</b></div><div>Strong problem-solving skills with an emphasis on product development.
</div><div>Experience using statistical computer languages (Python, SQL, hive, etc.) to manipulate data and draw insights from large data sets.
</div><div>Experience working with and creating data architectures.
</div><div>Knowledge of a variety of machine learning techniques (clustering, decision tree learning, artificial neural networks, etc.) and their real-world advantages/drawbacks.
</div><div>Knowledge of advanced statistical techniques and concepts (regression, properties of distributions, statistical tests and proper usage, etc.) and experience with applications.
</div><div>Excellent written and verbal communication skills for coordinating across teams.
</div><div>Experience with distributed data/computing tools: Hadoop, Hive, MySQL, etc
</div></div></div></div></div></div></div></div><div><div><div><div>Mandatory Skills: Big Data .<br>
<p></p>Experience: 5-8 Years .<br>
<p></p>The expected compensation for this role ranges from $60,000 to $135,000 .<br>
<p></p>Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.<br>
<p></p>Applicants are advised that employment in some roles may be conditioned on successful completion of a post-offer drug screening, subject to applicable state law.<br>
<p></p>Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome.<br>
<p></p>Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.</div></div></div></div></div><p></p>

Search 10000+ Big data developer jobs near you this March. New roles added regularly across leading industries. Apply today.

10000 big data developer jobs Near Me

Databricks Data Engineer

Software Development Engineer – Big Data, AWS Elastic MapReduce (EMR)

Big Data Engineer

Big Data Engineer

Big Data Engineer

Big Data Engineer

Big Data Engineer