data infrastructure engineer

Anblicks

<div><div><b>Job Role: Data Engineer</b></div><div><b>
Location: India</b></div><div><b>
Experince: 3 Yrs
</b></div><div></div><div><b>Role Summary:</b> Experienced Data Engineer with a strong background in working with large sets of data, data warehousing tools, and software development methodology. In this role, you&rsquo;ll participate directly in designing, building, and maintaining our data infrastructure, data products, and collaborating with operations and product management teams to ensure business success and pursue new product opportunities..</div><div><b>
Key Responsibilities:</b></div><div>
Design, develop, and maintain scalable data workflows and pipelines using big data technologies, including Map/Reduce, Spark, Databricks and Acxiom proprietary tools</div><div>
Collaborate with data analysts, product managers, and other stakeholders to understand and develop product requirements</div><div>
Tune workflows to enhance processing efficiency and optimize use of resources</div><div>
Write well-crafted, tested, readable, and maintainable code</div><div>
Participate in code reviews to ensure code quality and distribute knowledge</div><div>
Drive innovation. Stay up to date with advancements in data engineering tools, cloud services, and generative AI; seeking opportunities to drive leaps in value creation for Acxiom&rsquo;s clients</div><div><b>
Requirements:</b></div><div>
Bachelor's (or better) degree in Computer Science, Engineering, Information Systems, or a related field</div><div>
1 year of prior experience in data engineering, Databricks experience preferred.</div><div>
Proficiency in Python / PySpark</div><div>
Proficiency with big data technologies including SQL, Spark, Hadoop</div><div>
Experience designing data models to optimize storage and retrieval</div><div>
Experience working with AWS based solutions</div><div>
Experience with CICD (shift left) development practices
</div><div>Strong problem-solving skills and a commitment to excellence</div><div>
Strong written and oral communication skills with an ability to work collaboratively in a fast-paced, team-oriented environment</div><div><b>
Bonus Points:</b></div><div>
Prior experience with IaC and Terraform</div><div>
Prior experience developing in Scala</div><div>
ML skills and experience deploying AI models into solutions</div></div><div></div>

Data Engineer

Insight Global

<div>
 <p>
  Full Time Role
 </p>
 <p>
  <br/>
 </p>
 <p>
  Salary: $150k-$210k/yr
 </p>
 <p>
  <br/>
 </p>
 <p>
  Required Skills &amp; Experience
 </p>
 <p>
  <br/>
 </p>
 <p>
  -3&ndash;5 years of professional experience designing and operating production data pipelines at scale.
 </p>
 <p>
  Containerization &amp; Orchestration: Expertise with Docker, Kubernetes, and Helm.
 </p>
 <p>
  -Workflow Management: Hands-on experience building DAG-based pipelines in Apache Airflow.
 </p>
 <p>
  -Programming: Strong proficiency in Python for data engineering tasks.
 </p>
 <p>
  -Distributed Frameworks: Practical experience with Dask or Apache Spark for large-scale data processing.
 </p>
 <p>
  -Cloud Fundamentals: Familiarity with deploying and managing services in a cloud environment.
 </p>
 <p>
  -GCP Proficiency: Hands-on with Google Cloud services (e.g., Pub/Sub, Big Query, Cloud Storage, GKE). Equivalent experience in other public cloud providers is fine.
 </p>
 <p>
  -ML Pipelines: Exposure to deploying cross-cluster model-training workflows using Ray or similar frameworks.
 </p>
 <p>
  Infrastructure as Code: Familiarity with Terraform for deployment.
 </p>
 <p>
  -Security &amp; Compliance: Knowledge of data governance, encryption, and role-based access control.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Nice to Have Skills &amp; Experience
 </p>
 <p>
  <br/>
 </p>
 <p>
  &bull; Experience with Go programming language.
 </p>
 <p>
  &bull; Familiarity with acceleration frameworks such as RAPIDS or Spark.
 </p>
 <p>
  &bull; Knowledge of cloud platforms (AWS, GCP, Azure).
 </p>
 <p>
  Experience with data version control and MLOps practices.
 </p>
 <p>
  <br/>
 </p>
 <p>
  Job Description
 </p>
 <p>
  <br/>
 </p>
 <p>
  We&rsquo;re seeking a highly skilled Data Engineer to design, build, and maintain production-grade data pipelines that process and transform terabytes of data. In this role, you&rsquo;ll collaborate closely with data scientists and other SWEs to ensure that our data infrastructure is scalable, reliable, and cost-effective.
 </p>
 <p>
 </p>
</div>


Ad Hoc

<div><h1 class="jobSectionHeader"><b>Data Engineer III</b></h1>
<p><b>This is a remote position.</b></p>
<p>Ad Hoc is a technology company that empowers organizations to deliver scalable, impactful digital services. Using modern, agile methods, our team creates products that meet people&rsquo;s needs and transform their experience of government.</p>
<p><b>Work on things that matter</b></p>
<p>Our collaborations have shaped some of the defining moments in public-sector service delivery. We&rsquo;ve helped build products that connect Veterans to tailored services, help millions access affordable health care, and support important programs like Head Start. As we work with agencies to deliver critical services, we&rsquo;re also changing how the government approaches technology.
</p><p><b>Built for a remote life</b></p>
<p>Our culture, communications, and tools are built for remote work, enabling us to bring together top talent nationwide. At Ad Hoc, remote life empowers our teams to design work environments that fit their lives and that foster flexibility and collaboration to achieve positive outcomes for our customers.
</p><p><b>Committed to high expectations and a welcoming culture</b></p>
<p>Ad Hoc values acceptance, accountability, and humility. We aren&rsquo;t heroes. We learn from our mistakes and improve the process for the next time. We build small, inclusive teams to collaborate closely with our partners to solve the right problems and deliver software that works.</p>
<p>The <b>Federal Civilian </b>business unit supports many customers spanning the federal, commercial, and nonprofit space. Our customers include NASA, the General Services Administration, Office of Personnel Management, the Library of Congress, Health &amp; Human Services, and the FDIC. We partner with these agencies to build new capabilities, deliver products, establish data as a strategic asset for informed decision-making, modernize legacy systems, and build the digital service infrastructure necessary to scale their mission impact.</p>
<p><b>Primary Responsibilities:
</b></p><p>Data Engineer III serves as an emerging individual contributor within a team, expanding your leadership, guidance and mentoring skills. With the support and guidance of leadership, you will be responsible for supporting the goal of meeting scope, schedule and delivery requirements. You will interact with stakeholders and utilize influential skills to drive improvements in data engineering processes and practices. Primary expectations of a Data Engineer III include:
</p><ul><li><p>Builds data infrastructure, pipelines, systems, and tools with a little feedback and guidance from their team</p>
</li><li><p>Intermediate understanding of data management and transformation of raw data into interpretable information</p>
</li><li><p>Ability to create accurate and accessible datasets for Data Analysts and Scientists to interpret and use</p>
</li><li><p>Own maintenance of data architectures and systems</p>
</li><li><p>Practices technical and communications skills to improve context knowledge and mentor junior data engineers</p>
</li><li><p>Presents on and writes about their work to both internal and external parties</p>
</li><li><p>Participates in planning sessions, building an understanding of data architectures and infrastructure</p>
</li><li><p>Supports recruiting efforts by evaluating homework assignments and potentially assisting with interviews</p><br>
</li></ul><p><br>
<b>Basic Qualifications:</b></p>
<ul><li><p>Bachelor&rsquo;s degree and 5+ years of experience</p>
<ul><li><p>Relevant years of experience may be substituted for education</p>
</li></ul></li><li><p>Proficient with at least one family of data ingestion systems, cloud database services, and visualization software</p>
</li><li><p>Background in key data concepts including constructing databases, processing big data, improving data accuracy, etc.</p>
</li><li><p>Strong experience with Python / Apache Spark.
</p></li><li><p>Solid understanding of data modeling, ETL process, and distributed computing.</p>
</li><li><p>Strong understanding of software design patterns, data structures, and algorithms.</p>
</li><li><p>Related experience in analytic programming, data extraction, querying databases/data warehouses and data analysis.</p><br>
</li></ul><p><br>
<b>Preferred Qualifications:</b></p>
<ul><li><p>AWS Experience (S3, EC2, Glue, Lambda, etc)</p>
</li><li><p>R experience</p>
</li><li><p>Professional Databricks/Apache Spark Certification(s)</p>
</li><li><p>SAS experience</p>
</li></ul><p><b>To learn more about working at Ad Hoc, please visit:</b>https://adhocteam.us/join</p>
<p><b>Benefits:</b></p>
<ul><li>Company-subsidized health, dental, and vision insurance</li><br>
<br>
<li>Flexible PTO</li><br>
<br>
<li>401K with employer match</li><br>
<br>
<li>Paid parental leave after one year of service</li><br>
<br>
<li>Employee Assistance Program</li>
</ul>
<p>Ad Hoc LLC is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, national origin, ancestry, sex, sexual orientation, gender identity or expression, religion, age, pregnancy, disability, work-related injury, covered veteran status, political ideology, marital status, or any other factor that the law protects from employment discrimination.</p>
<p>In support of various state and city equal pay transparency laws, Ad Hoc job descriptions feature the starting range we reasonably expect to pay to candidates who would join our team with little to no need for training on the responsibilities we've outlined above. Actual compensation is influenced by a wide range of factors including but not limited to skill set, level of experience, and responsibility. The range of starting pay for this role is $120,000-130,000. Our recruiters will be happy to answer any questions you may have, and we look forward to learning more about your salary requirements.
</p><p>job reference:</p>
<p></p><p>https://adhoc.team/</p></div>

Data Engineer III

Bizimply

<div><h3 class="jobSectionHeader"><b>Description</b></h3><div><b><br>
About Bizimply</b></div><div></div><div><br>
Bizimply is a workforce management platform designed to streamline operations for businesses in the hospitality, retail, and leisure industries. The Bizimply platform provides a comprehensive suite of tools that enable businesses to efficiently manage their workforce, including scheduling, time and attendance tracking, task management, HR and performance reporting. By centralising these functions in one user-friendly interface, Bizimply helps businesses save time, reduce administrative overhead, and improve overall operational efficiency.</div><div></div><div><br>
We&rsquo;re looking for a <b>Data Engineer</b> to help us extend the foundational data infrastructure that will power the next phase of growth, including our AI initiatives. You&rsquo;ll be joining a small, enthusiastic team so we&rsquo;re looking for someone who can both build and support, excited by the challenge of laying down best practices and helping shape our new data stack.<br>
</div><div>Your primary focus will be on extending Bizimply&rsquo;s <b>Data Store (ODS)</b> and laying the groundwork for a future <b>Data Warehouse</b>. You'll work closely with our senior data engineer, as well as software engineering and product teams to enable better decision-making and intelligent automation.</div><h3 class="jobSectionHeader"><b><br>
Key Responsibilities</b></h3><br>
<ul>
<li>
Build and maintain robust, scalable data pipelines using <b>Airflow,</b> <b>Python</b>, and <b>SQL</b>.</li>
<li>Design, build, optimize data pipelines using <b>dbt</b>, or <b>sqlmesh</b>.</li>
<li>Develop and manage the <b>ODS</b> and support the eventual rollout of a modern <b>Data Warehouse</b>.</li>
<li>Integrate data from internal systems and external APIs to create clean, reliable datasets.</li>
<li>Work closely with engineers to operationalize machine learning workflows.</li>
<li>Ensure high data quality through monitoring, validation, and error handling.</li>
<li>Provide guidance to less experienced team members and champion data engineering best practices.</li>
<li>Deploy and manage infrastructure in the <b>cloud (AWS, GCP, or Azure)</b> using modern DevOps tooling.</li>
<li>Implement monitoring and alerting to ensure data pipelines are reliable and maintainable.</li></ul><br>
<h3 class="jobSectionHeader"><b>
Skills, Knowledge and Expertise</b></h3><br>
<ul>
<li>
At least 5 years of experience in data engineering or related roles.</li>
<li>Strong skills in Python, SQL, and Airflow or similar orchestration tools.</li>
<li>Experience working with cloud infrastructure and data warehousing tools (e.g., Snowflake, BigQuery, Redshift).</li>
<li>Exposure to ML pipelines or collaboration with ML/AI teams.</li>
<li>Ability to work independently while supporting a less-experienced team.</li>
Strong communication skills and an eagerness to mentor and share knowledge<br>
<li>
</li></ul><ul><li>Experience building an ODS or Data Warehouse from scratch.</li>
<li>Familiarity with event-driven systems or streaming tools (e.g., Kafka, Pub/Sub).</li>
<li>DevOps experience or infrastructure-as-code (e.g., Terraform, CloudFormation).</li></ul><br>
<h3 class="jobSectionHeader"><b>
Benefits</b></h3><br>
<ul>
<li>
Competitive compensation aligned with relevant experience.</li>
<li>Remote-friendly, flexible work environment.</li>
<li>Budget for learning, courses, and conferences.</li>
<li>A supportive, mission-driven team eager to grow and learn together.</li></ul><br>
<h3 class="jobSectionHeader"><b>
About Bizimply</b></h3><div>
Bizimply is a multi-platform solution <b>born in the world of cafes, bars, restaurants and pubs, where getting your wage spend right is crucial</b>. We&rsquo;ve been transforming hospitality scheduling in the UK and Ireland for over a decade. Our shared experience gave us the expertise to help create spot-on staff rotas and keep everything compliant, giving our customers more bandwidth to focus on what&rsquo;s important.<br>
Our intuitive design ensures that every manager has the tools to hit their <b>sales per labour hour</b> <b>goals</b>, with a complete view of their day-to-day operations. From streamlined scheduling to effortless compliance, we make every shift run like clockwork.<br>
At Bizimply, you'll have the opportunity to grow your career, gain hands-on experience, and be part of a team that&rsquo;s revolutionising the hospitality industry.</div></div>

Moreton Capital Partners

<div><h3 class="jobSectionHeader"><b>Data Engineer - Systematic Commodities Hedge Fund</b></h3><p>
Moreton Capital Partners is a systematic commodities hedge fund preparing to launch live trading across global futures markets. Our research and trading systems rely on robust, scalable data infrastructure. We are looking for Data Engineers to help us design, build, and optimize that infrastructure alongside senior engineers and the CIO.</p><p></p><p><b>
Key Responsibilities</b><br>
You&rsquo;ll work on projects such as:</p><ul>
<li>
Designing and maintaining data pipelines to collect, clean, and transform market and alternative datasets (e.g., futures, options, weather, satellite, fundamentals).</li>
<li>Building ETL workflows using Python (pandas/polars) and orchestration tools such as Airflow or Prefect.</li>
<li>Structuring data warehouses and APIs (SQL, Snowflake, or similar) for efficient query and analysis.</li>
<li>Developing data quality and monitoring systems for latency, completeness, and integrity.</li>
<li>Assisting in cloud deployments (AWS, Docker) and automation for data ingestion and versioning.</li>
<li>Collaborating with Quant Researchers to make research datasets reproducible and production-ready.</li>
<li>Contributing to internal documentation and code standards to ensure long-term maintainability.</li>
</ul><p><b>
Requirements</b></p><ul><li>
Strong programming skills in Python and familiarity with SQL.</li></ul><ul>
<li>Understanding of data structures, algorithms, and software engineering best practices.</li>
<li>Interest in large-scale data systems, cloud computing, or distributed processing.</li>
<li>Self-starter with curiosity and attention to detail.</li>
</ul><p></p><p>
Bonus points for:</p><br>
<ul>
<li>
Experience with Airflow, Docker, or AWS.</li>
<li>Familiarity with Snowflake, Polars, or Pandas workflows.</li>
<li>Exposure to financial or time-series data.</li>
<li>Understanding of CI/CD, version control, or testing frameworks.</li>
</ul><p><b>
Benefits</b></p><ul>
<li>
Real-world impact: Help build data systems that directly feed institutional-grade trading research and live execution.</li>
<li>Technical depth: Gain hands-on experience with distributed data pipelines, cloud infrastructure, and production data engineering.</li>
<li>Mentorship: Work closely with senior engineers, the CIO, and Quant Researchers on live projects.</li>
<li>Collaborative culture: Inclusive, high-trust team that values initiative and learning.</li>
<li>Compensation: Competitive stipend/salary based on experience.</li></ul></div>

Data Engineer - Systematic Commodities Hedge Fund

Careem

<div>
 <strong>
  About the Company
  <br/>
  <br/>
 </strong>
 Careem is building the Everything App for the greater Middle East &mdash; making it easy to move around, order food and groceries, manage payments, and more. Our purpose is simple: to simplify and improve people&rsquo;s lives and build an awesome organisation that inspires.
 <br/>
 <br/>
 Since 2012, Careem has enabled earnings for over 2.5 million Captains, simplified the lives of more than 70 million customers, and built a platform where the region&rsquo;s best talent and entrepreneurs thrive. We operate in 70+ cities across 10 countries, from Morocco to Pakistan.
 <br/>
 <br/>
 <strong>
  <em>
   We&rsquo;re now entering our next chapter &mdash; one powered by AI. We&rsquo;re looking for AI talent: curious problem-solvers who know how to apply AI to build tools, automate workflows, and create real impact. Whether it&rsquo;s streamlining operations, enhancing customer experience, or reimagining internal systems &mdash; we want people who can make Careem work smarter and move faster.
   <br/>
   <br/>
  </em>
 </strong>
 <strong>
  About The Role
  <br/>
  <br/>
 </strong>
 We are seeking a highly skilled and motivated Data Warehouse Engineer to join our team. As a Data Warehouse Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure, ensuring the availability, scalability, and reliability of our data systems. You will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to support data-driven decision-making and enable the efficient processing of large-scale data.
 <br/>
 <br/>
 <strong>
  What You'll Do
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Design and develop robust, scalable, and high-performance data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake.
  </li>
  <li>
   Collaborate with stakeholders to understand their data requirements, and design and implement appropriate data models and database schemas to support their needs.
  </li>
  <li>
   Optimize data pipelines and ETL processes for performance and efficiency, ensuring timely and accurate data delivery to end-users.
  </li>
  <li>
   Monitor, troubleshoot, and resolve issues related to data quality, data consistency, and data integrity, ensuring the reliability and correctness of our data systems.
  </li>
  <li>
   Implement and maintain data governance practices and policies, ensuring compliance with data privacy and security regulations.
  </li>
  <li>
   Collaborate with data scientists and analysts to provide them with the necessary data infrastructure and tools for conducting advanced analytics and deriving insights.
  </li>
  <li>
   Stay up-to-date with the latest trends and technologies in data engineering and recommend innovative solutions to improve data engineering processes and systems.
  </li>
  <li>
   Document data engineering processes, data flows, and system architectures to ensure knowledge sharing and maintain an up-to-date repository of technical documentation.
  </li>
  <li>
   Work closely with cross-functional teams, including software engineers and infrastructure teams, to optimize data infrastructure and ensure its seamless integration with other systems.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  What You'll Need
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Bachelor's degree in Computer Science, Engineering, or a related field.
  </li>
  <li>
   At least 6 years of experience as a Data Warehouse] Engineer or in a similar role, working with large-scale data processing and ETL pipelines.
  </li>
  <li>
   Strong programming skills in languages such as Python, Java, or Scala, with experience in data manipulation and processing frameworks like Apache Spark.
  </li>
  <li>
   Experience with SQL and database technologies (e.g., relational databases, SQL queries, data modeling).
  </li>
  <li>
   Proficiency in working with big data technologies such as Hadoop, Hive and knowledge of distributed systems and cloud computing platforms (e.g., AWS, Azure, GCP).
  </li>
  <li>
   Familiarity with data integration and workflow management tools such as Apache Airflow
  </li>
  <li>
   Knowledge of data warehousing concepts and experience with data warehousing solutions is highly desirable.
  </li>
  <li>
   Strong analytical and problem-solving skills, with the ability to analyze complex data-related issues and propose effective solutions.
  </li>
  <li>
   Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
  </li>
  <li>
   Attention to detail and a strong commitment to delivering high-quality work within established timelines.
  </li>
  <li>
   Join our dynamic team and contribute to building scalable data infrastructure that powers data analytics and decision-making processes. Apply your expertise in data engineering to help us unlock the full potential of our data assets and drive meaningful insights for our organization.
  </li>
 </ul>
</div>


Senior Data Warehouse Engineer I

Search 10000+ Data infrastructure engineer jobs near you this March. New roles added regularly across leading industries. Apply today.

10000 data infrastructure engineer jobs Near Me

Data Engineer

Data Engineer

Data Engineer III

Data Engineer

Data Engineer - Systematic Commodities Hedge Fund

Senior Data Warehouse Engineer I

Data Engineer III