Abrar Admin

eOne Infotech

<div><h3 class="jobSectionHeader"><b>Experience Level &ndash; 13-15+ Years
</b></h3><h3 class="jobSectionHeader"><b>Job Description</b></h3>
<p>
We are seeking a Mid&ndash;Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines, implement robust data validation and monitoring processes, and support mission-critical analytics platforms.</p>
<h3 class="jobSectionHeader"><b>
Key Responsibilities:</b></h3>
<ul><li>Develop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python</li>
<li>Build event-driven workflows using AWS Lambda</li>
<li>Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink</li>
<li>Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation</li>
<li>Optimize data processing performance, scalability, reliability, and cost in cloud environments</li>
<li>Collaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline</li>
</ul><h3 class="jobSectionHeader"><b>Required Skills:</b></h3>
<ul><li>Strong hands-on experience with Python and PySpark</li>
<li>Proven expertise in AWS Glue, Lambda, and other cloud-native data services</li>
<li>Solid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns)</li>
<li>Demonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection)</li>
<li>Strong understanding of distributed data processing and scalable architecture patterns</li>
</ul><h3 class="jobSectionHeader"><b>Good-to-Have Skills:</b></h3>
<ul><li>Experience with Apache Flink for real-time stream processing and stateful computations</li>
<li>Knowledge of KSQL or other streaming SQL engines</li>
<li>Exposure to CI/CD pipelines, IaC (Terraform/CloudFormation), and DevOps practices</li>
<li>Familiarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi</li>
<li>Experience working in enterprise or financial data environments</li></ul></div>

Sr. Data Engineer (Mid–Senior Level) – AWS & Streaming

<div><h3 class="jobSectionHeader"><b>Job Description</b></h3>
<p>
We are seeking a skilled Quality Engineer with hands-on experience in Behavior-Driven Development (BDD) to ensure the quality and reliability of our data ingestion and pipeline solutions. The ideal candidate will collaborate with cross-functional teams to define, implement, and automate BDD test scenarios for complex data workflows.</p>
<h3 class="jobSectionHeader"><b>
Responsibilities</b></h3>
<ul><li>Collaborate with product owners, data engineers, and business analysts to define acceptance criteria and BDD scenarios for data ingestion and pipeline processes.</li>
<li>Design, develop, and maintain automated BDD test suites using frameworks such as Behave, Cucumber, pytest-bdd and Playwright for Ui validations.</li>
<li>Validate data integrity, transformation logic, and end-to-end data flow from source to target systems.</li>
<li>Identify, document, and track defects; work with development teams to resolve issues.</li>
<li>Integrate automated tests into CI/CD pipelines for continuous quality assurance.</li>
<li>Analyze test results, generate reports, and communicate findings to stakeholders.</li>
<li>Contribute to test data management and environment setup for data pipeline testing.</li>
<li>Stay current with industry best practices in data quality, test automation, and BDD methodologies.</li>
</ul><h3 class="jobSectionHeader"><b>Required Skills &amp; Qualifications
</b></h3><ul><li>Bachelor&rsquo;s degree in Computer Science, Engineering, or related field.</li>
<li>5+ years of experience in software quality assurance or test automation, preferably in data engineering environments.</li>
<li>Strong experience with BDD frameworks (Behave, Cucumber, pytest-bdd, Playwright) and Gherkin syntax.</li>
<li>Experience with Implementing Test Runners such as TestNG, Selenium WebDriver to run tests and document reporting and results.</li>
<li>Proficiency in Python, Java or another programming language used for test automation.</li>
<li>Solid understanding of ETL/ELT processes, data ingestion, and data pipeline architectures.</li>
<li>Experience testing data transformations, data quality, and data integrity.</li>
<li>Familiarity with relational databases (SQL), data warehouses, and cloud data platforms (e.g., AWS Glue) and Snowflake.</li>
<li>Experience with CI/CD tools (e.g., Jenkins, GitHub Actions).</li>
<li>Excellent analytical, problem-solving, and communication skills.</li>
</ul><h3 class="jobSectionHeader"><b>Preferred Skills
</b></h3><ul><li>Knowledge of data governance and data privacy best practices.</li>
<li>Exposure to containerization (Docker, Kubernetes) and infrastructure as code.</li></ul></div>

Quality Engineer – BDD Implementation (Data Ingestion & Pipeline)

Join eOne Infotech and explore 2   exciting career opportunities. They're hiring for various roles with options for remote or on-site work. Apply today and become part of their innovative team.

eOne Infotech

About Company

Sr. Data Engineer (Mid–Senior Level) – AWS & Streaming

Quality Engineer – BDD Implementation (Data Ingestion & Pipeline)