etl engineer

GovCIO

<div>Overview:
<div>
GovCIO is currently hiring a highly skilled Senior ETL Engineer to design, develop, and maintain enterprise data integration solutions that combine data from multiple sources into unified, analytics-ready views.</div><div>
The position is fully remote within the United States.
</div>Responsibilities:
<h2 class="jobSectionHeader"><b>Responsibilities</b></h2><div>
This role will focus on building scalable ETL/ELT pipelines, ensuring data integrity and compliance, and supporting advanced troubleshooting across complex VA systems.</div><div>
This position transforms raw data into structured formats suitable for analysis and reporting while loading it into target databases or data warehouses.</div><ul><li>
Design and implement scalable ETL/ELT pipelines to support enterprise data integration, analytics, and reporting initiatives.</li><li>
Combine data from multiple heterogeneous sources into unified, reliable data views.</li><li>
Transform and load data into target databases or data warehouses using best practices for performance and scalability.</li><li>
Ensure the highest possible standards of data quality, consistency, and accuracy across systems.</li><li>
Monitor and report on data processes to ensure data consistency, integrity, and compliance with applicable privacy and regulatory requirements (e.g., HIPAA and federal data security standards).</li><li>
Oversee daily operations, including incident management and production support.</li><li>
Troubleshoot and debug complex data integration and transformation issues, performing root cause analysis across systems and pipelines.</li><li>
Manage coordination between systems, teams, and stakeholders to resolve integration issues efficiently.</li><li>
Support and enhance existing ETL processes and data distribution workflows.</li><li>
Perform ongoing VistA table configuration and related healthcare data tasks.</li><li>
Develop new data domains and optimize existing data models.</li><li>
Solve complex technical challenges with innovative and strategic solutions</li></ul>
Qualifications:
<h2 class="jobSectionHeader"><b>Required Skills and Experience</b></h2><ul><li>
Bachelor&rsquo;s degree with 12+ years of relevant experience (or equivalent combination of education and experience).</li><li>
Proven experience designing and implementing scalable ETL/ELT data pipelines in enterprise environments.</li><li>
Strong experience ensuring data quality, integrity, and regulatory compliance.</li><li>
Demonstrated ability to troubleshoot, debug, and resolve complex data issues across integrated systems.</li><li>
Experience working with enterprise databases and data warehouses.</li><li>
Strong analytical and problem-solving skills.</li><li>
Ability to communicate technical findings to both technical and non-technical audiences.</li></ul><h2 class="jobSectionHeader"><b>
Preferred Skills and Experience</b></h2><ul><li>
Experience working in healthcare environments (e.g., VistA, clinical or healthcare data systems).</li><li>
Familiarity with Agile methodologies and project management tools.</li><li>
Certifications in relevant data engineering or database technologies.</li></ul><div></div><div><br>
Clearance Required: Ability to obtain and maintain a suitability/Public Trust</div><br>
<div></div>
Company Overview:
<div>
GovCIO is a team of transformers-people who are passionate about transforming government IT. Every day, we make a positive impact by delivering innovative IT services and solutions that improve how government agencies operate and serve our citizens.<br>
<br>
But we can't do it alone. We need great people to help us do great things - for our customers, our culture, and our ability to attract other great people. We are changing the face of government IT and building a workforce that fuels this mission. Are you ready to be a transformer?</div><div></div><div><b><br>
What You Can Expect</b></div><div></div><div><b><br>
Interview &amp; Hiring Process</b></div><div>
If you are selected to move forward through the process, here&rsquo;s what you can expect:</div><ul><li>
During the Interview Process</li><li><ul><li>
Virtual video interview conducted via video with the hiring manager and/or team</li><li>
Camera must be on</li><li>
A valid photo ID must be presented during each interview</li></ul></li></ul><ul><li>
During the Hiring Process</li><li><ul><li>
Enhanced Biometrics ID verification screening</li><li>
Background check, to include:</li><li><ul><li>
Criminal history (past 7 years)</li><li>
Verification of your highest level of education</li><li>
Verification of your employment history (past 7 years), based on information provided in your application</li></ul></li></ul></li></ul><div><b>
Employee Perks</b></div><div>
At GovCIO, we consistently hear that meaningful work and a collaborative team environment are two of the top reasons our employees enjoy working here. In addition, our employees have access to a range of perks and benefits to support their personal and professional well-being, beyond the standard company offered health benefits, including:</div><ul><li>
Employee Assistance Program (EAP)</li><li>
Corporate Discounts</li><li>
Learning &amp; Development platform, to include certification preparation content</li><li>
Training, Education and Certification Assistance*</li><li>
Referral Bonus Program</li><li>
Internal Mobility Program</li><li>
Pet Insurance</li><li>
Flexible Work Environment</li><li>Available to full-time employees</li></ul><div></div><div><br>
Our employees&rsquo; unique talents and contributions are the driving force behind our success in supporting our customers, which ultimately fuels the success of our company. Join us and be a part of a culture that invests in its people and prioritizes continuous enhancement of the employee experience.</div><div></div><div><b><br>
We are an Equal Opportunity Employer.</b> All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, disability, or status as a protected veteran. EOE, including disability/vets.</div><div></div><div><b><br>
Posted Pay Range</b></div><div>
The posted pay range, if referenced, reflects the range expected for this position at the commencement of employment, however, base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, education, experience, and internal equity. The total compensation package for this position may also include other compensation elements, to be discussed during the hiring process. If hired, employee will be in an &ldquo;at-will position&rdquo; and the GovCIO reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, GovCIO or individual department/team performance, and market factors.</div>
Posted Salary Range: USD $150,000.00 - USD $185,000.00 /Yr.</div>

Senior ETL Engineer (Remote)

Empower

<div><div>Our vision for the future is based on the idea that transforming financial lives starts by giving our people the freedom to transform their own. We have a flexible work environment, and fluid career paths. We not only encourage but celebrate internal mobility. We also recognize the importance of purpose, well-being, and work-life balance. Within Empower and our communities, we work hard to create a welcoming and inclusive environment, and our associates dedicate thousands of hours to volunteering for causes that matter most to them.</div><div>
Chart your own path and grow your career while helping more customers achieve financial freedom. Empower Yourself.</div><div>
The Senior Software Engineer - Data / ETL is a seasoned, hands-on engineer responsible for designing and implementing complex backend data pipelines and ETL solutions. This role leads technical delivery for key components, provides guidance to other engineers, and helps shape the data architecture on AWS. The senior engineer is a key contributor to the reliability, scalability, and performance of data platforms that support analytics, reporting, and downstream applications.</div><div>
What you will do:</div><ul><li>
Lead the design, development, and enhancement of ETL pipelines and backend data workflows using Python and SQL.</li><li>
Design and optimize large-scale data processing solutions on AWS using services such as Glue, EMR, Lambda, and S3.</li><li>
Lead the implementation and improvement of CI/CD pipelines to automate build, test, and deployment for data and application code.</li><li>
Collaborate with architects, product owners, and business partners to refine requirements and translate them into scalable, secure data solutions that follow approved architecture patterns.</li><li>
Write high quality, maintainable, and well-tested code, and set a strong example for coding and design practices.</li><li>
Investigate and resolve complex technical issues, data quality problems, and performance bottlenecks across environments.</li><li>
Participate in and often lead code reviews, helping to maintain high standards for code quality, testing, and documentation.</li><li>
Mentor junior and mid-level engineers through pairing, feedback, and knowledge sharing.</li><li>
Contribute to the evolution of data and application architecture, development processes, and engineering best practices.</li><li>
Collaborate with cross-functional teams to debug, improve, and support data products and services in production.</li><li>
Continuously learn and adopt modern technologies, tools, and development practices relevant to data engineering and cloud platforms.</li></ul><div>
What you will bring:</div><ul><li>
Bachelor&rsquo;s degree in Computer Science or related field, or equivalent practical experience.</li><li>
5+ years of experience in software development, with substantial experience in backend or data engineering.</li><li>
Strong proficiency in Python for backend development and data processing.</li><li>
Strong proficiency in SQL, including performance tuning and working with large or complex datasets.</li><li>
Hands-on experience with AWS services, ideally including Glue, EMR, Lambda, and S3, and Kafka topics</li><li>
Demonstrated experience designing and maintaining CI/CD pipelines and related tooling.</li><li>
Deep understanding of software architecture and design principles for data-intensive systems.</li><li>
Strong problem-solving, debugging, and analytical skills, with a track record of resolving complex issues.</li><li>
Proven experience providing technical leadership on features or projects and influencing technical decisions within a team.</li><li>
Experience working in Agile or iterative delivery environments.</li></ul><div></div><div>
What will set you apart:</div><ul><li>
Experience with Java or JavaScript is a plus, but not required.</li></ul><div></div><div>
This job description is not intended to be an exhaustive list of all duties, responsibilities and qualifications of the job. The employer has the right to revise this job description at any time. You will be evaluated in part based on your performance of the responsibilities and/or tasks listed in this job description. You may be required perform other duties that are not included on this job description. The job description is not a contract for employment, and either you or the employer may terminate employment at any time, for any reason, as per terms and conditions of your employment contract.</div><div></div><div>
We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics, are encouraged to apply. All qualified applicants will receive consideration for employment without regard to age, race, color, national origin, ancestry, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, religion, physical or mental disability, military or veteran status, genetic information, or any other status protected by applicable state or local law.</div></div>

Senior ETL Data Engineer

Genpact

<p></p><div><div><div>Ready to build the future with AI?<br>
At Genpact, we don&rsquo;t just keep up with technology&mdash;we set the pace. AI and digital innovation are redefining industries, and we&rsquo;re leading the charge. Genpact&rsquo;s AI Gigafactory, our industry-first accelerator, is an example of how we&rsquo;re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies&rsquo; most complex challenges.<br>
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what&rsquo;s possible, this is your moment.<br>
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions &ndash; we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook.<br>
Inviting applications for the role of Principal Consultant, ETL Data Engineer and Python<br>
We are seeking a seasoned ETL Data Engineer to join our dynamic team and play a pivotal role in designing, developing, and maintaining robust ETL pipelines that extract, transform, and load data into our Snowflake data warehouse. You will collaborate with cross-functional teams to ensure data quality accuracy, and consistency, enabling informed decision-making and driving business insights.<br>
Responsibilities<br>
<ul><li>Analyze and understand complex business requirements to design and develop efficient ETL pipelines</li></ul>
using Informatica ETL tools.<br>
<ul><li>Collaborate with data architects, analysts, and business users to gather and define data requirements.</li><li>Develop, test, and implement ETL pipelines for data extraction, transformation, and loading into</li></ul>
Snowflake.<br>
<ul><li>Optimize ETL processes for performance and scalability to handle large volumes of data.</li><li>Ensure data quality and integrity throughout the ETL process by implementing validation and error-</li></ul>
handling mechanisms.<br>
<ul><li>Document ETL processes and procedures for knowledge sharing and maintenance.</li><li>Troubleshoot and resolve ETL pipeline issues in a timely manner.</li><li>Stay updated on the latest ETL technologies and best practices.</li></ul>
Qualifications we seek in you!<br>
Minimum Qualifications<br>
Bachelor's degree in computer science, Engineering, or a related field.<br>
<ul><li>hands-on experience in ETL development using Informatica ETL tools.</li><li>Proven experience working with Informatica and Snowflake data warehouse.</li><li>Strong understanding of SQL and data warehousing concepts.</li><li>Experience with data modeling and data integration techniques.</li><li>Excellent problem-solving and analytical skills.</li><li>Ability to work independently and as part of a team.</li><li>Strong communication and interpersonal skills.</li></ul>
Preferred Qualifications/ Skills<br>
<ul><li>Knowledge of Python or other scripting languages.</li><li>Experience with data quality and governance tools.</li></ul>
Why join Genpact?<br>
<ul><li>Lead AI-first transformation &ndash; Build and scale AI solutions that redefine industries</li><li>Make an impact &ndash; Drive change for global enterprises and solve business challenges that matter</li><li>Accelerate your career&mdash;Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills</li><li>Grow with the best &ndash; Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace</li><li>Committed to ethical AI &ndash; Work in an environment where governance, transparency, and security are at the core of everything we build</li><li>Thrive in a values-driven culture &ndash; Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress</li></ul>
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.<br>
Let&rsquo;s build tomorrow together.<br>
<br>
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.<br>
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.</div></div><p></p><p><br>
JobPrincipal Consultant</p><p>
Primary LocationIndia-Bangalore</p><p>
ScheduleFull-time</p><p>
Education LevelBachelor's / Graduation / Equivalent</p><p>
Job PostingFeb 20, 2026, 1:32:27 AM</p><p>
Unposting DateOngoing</p><p>
Master Skills ListDigital</p><p>
Job CategoryFull Time</p></div>

Principal Consultant, ETL Data Engineer and Python

MedReview Inc.

<div>
 <span>
  <span>
   <span>
    <strong>
     Position Summary:
     <br/>
    </strong>
   </span>
  </span>
 </span>
 <span>
  <span>
   <span>
    The ETL Engineer is responsible for designing, developing, and maintaining data pipelines that extract, transform, and load data into analytics platforms, including SQL Server and ClickHouse for real-time and high-performance querying. This role ensures data integrity, scalability, and performance for BI, reporting, and advanced analytics.
    <br/>
    <br/>
   </span>
  </span>
 </span>
 <span>
  <span>
   <span>
    <strong>
     Job Responsibilities:
    </strong>
   </span>
  </span>
 </span>
 <ul>
  <li>
   <span>
    <span>
     <span>
      <span>
       <strong>
        ETL Pipeline Development
       </strong>
      </span>
     </span>
    </span>
   </span>
   <ul>
    <li>
     <span>
      <span>
       <span>
        <span>
         Design and implement ETL workflows using SQL Server Integration Services, Azure Data Factory, Databricks, and ClickHouse.
        </span>
       </span>
      </span>
     </span>
    </li>
    <li>
     <span>
      <span>
       <span>
        <span>
         Develop transformations for structured and semi-structured data; optimize for speed and reliability.
        </span>
       </span>
      </span>
     </span>
    </li>
   </ul>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       <strong>
        ClickHouse Integration
       </strong>
      </span>
     </span>
    </span>
   </span>
   <ul>
    <li>
     <span>
      <span>
       <span>
        <span>
         Build and maintain ingestion pipelines for ClickHouse using batch and streaming methods.
        </span>
       </span>
      </span>
     </span>
    </li>
    <li>
     <span>
      <span>
       <span>
        <span>
         Optimize ClickHouse schemas, partitions, and materialized views for query performance.
        </span>
       </span>
      </span>
     </span>
    </li>
   </ul>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       <strong>
        Data Integration
       </strong>
      </span>
     </span>
    </span>
   </span>
   <ul>
    <li>
     <span>
      <span>
       <span>
        <span>
         Connect multiple sources (SQL Server, APIs, cloud storage, Kafka/Event Hubs) into centralized data platforms.
        </span>
       </span>
      </span>
     </span>
    </li>
   </ul>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       <strong>
        Performance &amp; Optimization
       </strong>
      </span>
     </span>
    </span>
   </span>
   <ul>
    <li>
     <span>
      <span>
       <span>
        <span>
         Monitor SSIS ETL jobs and SQL Server and ClickHouse queries; tune for low latency and high throughput.
        </span>
       </span>
      </span>
     </span>
    </li>
    <li>
     <span>
      <span>
       <span>
        <span>
         Implement compression, sharding, and replication strategies in ClickHouse.
        </span>
       </span>
      </span>
     </span>
    </li>
   </ul>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       <strong>
        Data Quality &amp; Governance
       </strong>
      </span>
     </span>
    </span>
   </span>
   <ul>
    <li>
     <span>
      <span>
       <span>
        <span>
         Apply validation checks, error handling, and lineage tracking.
        </span>
       </span>
      </span>
     </span>
    </li>
    <li>
     <span>
      <span>
       <span>
        <span>
         Ensure compliance with security and governance standards.
        </span>
       </span>
      </span>
     </span>
    </li>
   </ul>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       <strong>
        Collaboration
       </strong>
      </span>
     </span>
    </span>
   </span>
   <ul>
    <li>
     <span>
      <span>
       <span>
        <span>
         Work with data engineers, analysts, and BI teams to deliver reliable datasets.
        </span>
       </span>
      </span>
     </span>
    </li>
    <li>
     <span>
      <span>
       <span>
        <span>
         Support real-time analytics and dashboards powered by PowerBI and ClickHouse.
        </span>
       </span>
      </span>
     </span>
    </li>
   </ul>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       <strong>
        Documentation
       </strong>
      </span>
     </span>
    </span>
   </span>
   <ul>
    <li>
     <span>
      <span>
       <span>
        <span>
         Maintain clear documentation for ETL processes, SQL Server and ClickHouse schemas, and operational playbooks.
        </span>
       </span>
      </span>
     </span>
    </li>
   </ul>
  </li>
 </ul>
 <span>
  <span>
   <span>
    <strong>
     Required Skills:
    </strong>
   </span>
  </span>
 </span>
 <ul>
  <li>
   <span>
    <span>
     <span>
      <span>
       Strong experience with ETL tools (Azure Data Factory, SSIS, Databricks).
      </span>
     </span>
    </span>
   </span>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       Proficiency in SQL and relational database concepts.
      </span>
     </span>
    </span>
   </span>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       Familiarity with ClickHouse (schema design, ingestion, optimization).
      </span>
     </span>
    </span>
   </span>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       Familiarity with cloud platforms (Azure preferred).
      </span>
     </span>
    </span>
   </span>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       Programming skills in Python or Scala for data processing.
      </span>
     </span>
    </span>
   </span>
  </li>
 </ul>
 <span>
  <span>
   <span>
    <strong>
     Preferred Qualifications
    </strong>
   </span>
  </span>
 </span>
 <ul>
  <li>
   <span>
    <span>
     <span>
      <span>
       Experience with streaming data (Kafka, Azure Event Hubs).
      </span>
     </span>
    </span>
   </span>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       Familiarity with big data frameworks.
      </span>
     </span>
    </span>
   </span>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       Understanding of DevOps practices for data pipelines.
      </span>
     </span>
    </span>
   </span>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       Exposure to BI tools (Power BI, Tableau) integrated with ClickHouse.
      </span>
     </span>
    </span>
   </span>
  </li>
 </ul>
 <span>
  <span>
   <span>
    <strong>
     Education &amp; Experience
    </strong>
   </span>
  </span>
 </span>
 <ul>
  <li>
   <span>
    <span>
     <span>
      <span>
       Bachelor&rsquo;s degree in Computer Science, Data Engineering, or related field.
      </span>
     </span>
    </span>
   </span>
  </li>
  <li>
   <span>
    <span>
     <span>
      <span>
       3+ years of experience in ETL development and data integration.
      </span>
     </span>
    </span>
   </span>
  </li>
 </ul>
 <span>
  <span>
   <span>
    <strong>
     This is an On-Premises position
    </strong>
    . Monday through Thursday (9-5)
    <strong>
     and remote on Fridays only (No exceptions).
     <br/>
    </strong>
   </span>
  </span>
 </span>
 &nbsp;
</div>


ELT Engineer

Astronomer

<div><div><p>Location</p><div>
Hyderabad</div></div><div><p>
Employment Type</p><div>
Full time</div></div><div><p>
Location Type</p><div>
Hybrid</div></div><div><p>
Department</p><div>
Customer</div></div></div>
<br><div><div><div>Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow&reg;. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven s. Trusted by more than 800 of the world's leading enterprises, Astronomer lets businesses do more with their data. To learn more, visit www.astronomer.io.</div><p></p><p>
About this role:</p><p>
As a Solutions Engineer, you will be part of the Global Services Delivery Team and will be involved in the delivery of the various use cases in which Airflow is implemented across our customers. These organizations range from seed-stage startups to Fortune 500 enterprises. Although these organizations are in different phases of their data journey, they all can benefit from your expertise as a Solutions Engineer to implement Apache Airflow in a manner that follows best practices and allows continued growth. In this role, you will come to have a deep understanding of both Apache Airflow and Astronomer Products.</p><p>
Every Solutions Engineer will grow to become an Airflow expert and a trusted advisor to organizations looking to put their data in motion.</p><p></p><p><b><i>
Hybrid Work Model</i></b><i>:</i><b><i> </i></b><i>For this role, you will embrace a flexible hybrid work model, working at least </i><b><i>3 days</i></b><i> per week at our Office in </i><b><i>Hyderabad </i></b><i>while delivering a seamless experience that is digitally and physically connected.</i></p><p></p><p><b>
What You Get To Do:</b></p><p>
You'll be able to speak to and deliver solutions around Apache Airflow and the Astronomer platform. You'll interact with customers and partners to ensure successful Airflow implementation post-sales. You'll be a trusted advisor and help architect data pipelines across all types of environments and use cases. Last but not least, you'll have the opportunity to engage with the Apache Airflow project, a thriving open-source community with thousands of contributors.</p><ul><li><div>
Maintain and continuously improve your technical expertise. You will become a trusted expert in both Airflow and Astronomer&rsquo;s managed Airflow Platform. You stay up to date with the latest releases and features while focusing on those that have a greater impact on customers.</div></li><li><div>
Work with customers to educate and guide them regarding Airflow best practices. Perform Airflow code refactoring assessments as a trusted expert for new and existing customers.</div></li><li><div>
Collaborate with team members to design, prototype, and implement engineering solutions for internal and external use.</div></li><li><div>
Act as a liaison by collecting feedback and identifying Airflow/Astronomer improvements through client interactions and relaying these recommendations back to the Product team.</div></li><li><div>
Review and optimize customer data workflows and Airflow system configurations for improved performance.</div></li></ul><p></p><p><b>
What You Bring To The Role:</b></p><ul><li><div><b>
3-5 years of data-engineering experience, working with Apache Airflow in production environments</b></div></li><li><div><b>
Experience creating DAGs, writing Python, and building Airflow custom operators and hooks</b></div></li><li><div>
Excitement about implementing ETL/ELT pipelines, knowledge of applying Data transformations, optimizing and monitoring data pipelines</div></li><li><div>
Experience with related market products such as Cloudera, Databricks, Snowflake, DBT, AWS, Azure, Google Cloud, ETL Technologies or other analytics solutions</div></li><li><div>
Empathetic, driven and team-oriented</div></li><li><div>
Great prioritization skills and ability to execute on customer-facing activities</div></li><li><div>
A strong verbal and written communicator interacting with assigned customers over a variety of mediums (slack, email, knowledge transfer, and pair programming sessions).</div></li><li><div>
Highly data-driven and intrigued by the challenge of delivering an awesome Astronomer experience to hundreds of customers</div></li></ul><p></p><p><b>
Bonus points if you have:</b></p><ul><li><div>
Experienced with Production implementation of ETL/ELT processes using Modern Data Stack.</div></li><li><div>
Experience building and maintaining CI/CD pipelines</div></li><li><div>
Experience working on short and long-term Customer engagements</div></li><li><div>
Experience with infrastructure tools like Docker and Kubernetes</div></li></ul><p></p><p>
#LI-Fulltime</p><p>
#LI-Hybrid</p><p></p><p>
At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.</p></div></div><p></p>

Solutions Engineer - Data Engineering

Divya Stores

<p>We are seeking an experienced Data Engineer with expertise in Dataiku to join our data team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines, data integration processes, and data infrastructure. You will collaborate closely with data scientists, analysts, and other stakeholders to ensure efficient data flow and support data-driven decision making across the organization.</p><p><b>Requirements:</b></p><p>&middot; Design and implement robust data pipelines that ingest, process, and store unstructured data formats at scale within <b>Snowflake and GCP</b></p><p>&middot; Leverage Snowflake's unstructured data capabilities (Directory Tables, Scoped URLs, Snowpark) to make &quot;dark data&quot; queryable and actionable.</p><p>&middot; Build and maintain cloud-native ETL/ELT processes using Big Query, Cloud Storage, and Dataflow, ensuring seamless integration between GCP and Snowflake.</p><p>&middot; Instead of just using LLMs, you will integrate AI tools (OCR, NLP entities, Document AI) into the engineering flow to transform unstructured blobs into structured insights.</p><p>&middot; Tune complex SQL queries and Python-based processing jobs to handle petabyte-scale environments efficiently.</p><p>Job Type: Contract</p><p>Pay: Up to $60.00 per hour</p><p>Expected hours: 40 per week</p><p>Work Location: In person</p>

Gen AI Data Engineer

<div><p>Ab Initio Developers<br>
<br>
Position Description<br>
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.<br>
<br>
Job Title: Ab Initio Developer<br>
Position: Senior Software Engineer/Software Engineer<br>
Experience: 5 - 10 Years<br>
Category: Software Development/ Engineering<br>
Shift: General<br>
Main location: Hyderabad<br>
Position ID: J0226-1692<br>
Employment Type: Full Time<br>
<br>
We are hiring for total 5+ years of IT experience as Ab Initio developer for our locations in Hyderabad. We are looking for candidates who can join immediately.</p><p><b>
Your future duties and responsibilities</b></p><div>
Key Responsibilities:<br>
Design, develop, and maintain Ab Initio graphs and ETL workflows using core components such as Rollup, Scan, Join, Partitioning, Normalize.<br>
<ul><li>Build and manage Vectors and implement Plans and Conduct&gt;IT for orchestration and workflow control.</li><li>Implement parameterization and reusable logic using PDL and meta programming to support metadata driven development.</li><li>Develop, test, and deploy production-ready ETL solutions with emphasis on performance, scalability, and maintainability.</li><li>Troubleshoot, debug, and tune Ab Initio graphs for throughput, memory, and CPU efficiency.</li><li>Collaborate with data architects, BI teams, QA, and stakeholders to translate business requirements into robust data pipelines.</li><li>Create and maintain technical documentation, runbooks, and design artifacts for graphs, plans, and meta-programs.</li><li>Participate in code reviews, knowledge sharing, and continuous improvement initiatives.</li><li>Support migration, upgrade, and integration activities involving Express&gt;IT and related tooling.</li></ul>
Follow Agile practices and participate in sprint planning, standups, and retrospectives.</div><p><b>
Required qualifications to be successful in this role</b></p><div>
Total 5+ years of IT experience as ETL developer<br>
<ul><li>Minimum 2 years of hands-on Ab Initio development experience in enterprise environments.</li><li>Strong expertise with Ab Initio components: Rollup, Scan, Join, Partitioning, Normalize.</li><li>Proven experience building and managing Vectors and implementing Plans and Conduct&gt;IT.</li><li>Solid experience with PDL and meta programming to create parameterized, reusable graphs.</li><li>Practical exposure to Express&gt;IT or similar orchestration tools.</li><li>Strong SQL skills and experience working with relational and semi-structured data.</li><li>Excellent debugging and performance tuning skills for large data volumes.</li><li>Familiarity with source control, build processes, and deployment best practices.</li><li>Good communication skills and ability to work with cross-functional teams.</li></ul></div><p><b>
Together, as owners, let&rsquo;s turn meaningful insights into action.</b><br>
<br>
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you&rsquo;ll reach your full potential because&hellip;<br>
<br>
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That&rsquo;s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company&rsquo;s strategy and direction.<br>
<br>
Your work creates value. You&rsquo;ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.<br>
<br>
You&rsquo;ll shape your career by joining a company built to grow and last. You&rsquo;ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
<br>
<br>
Come join our team&mdash;one of the largest IT and business consulting services firms in the world.</p></div>

Ab Initio Developers-Software Engineer / Senior Software Engineer

Search 7352+ Etl engineer jobs near you this March. New roles added regularly across leading industries. Apply today.