Qureos Mentor

Smart Hire4u

Position OverviewWe are seeking a skilled Data Streaming Engineer to join our engineering team ((US Client Project). The successfulcandidate will play a critical role in developing and maintaining real-time data pipelines, modernizinganalytical workloads, and supporting operational excellence in cloud-based environments.This role requires a self-starter with a proven track record of owning issues, finding creative solutions tocomplex problems, and driving continual improvement initiatives. Strong organizational skills and athirst for knowledge are essential.ResponsibilitiesStreaming ETL Pipeline Development<ul><li>Develop and maintain ETL and real-time processing pipelines using Apache Flink (DataStream</li></ul>API)<ul><li>Build and extend CDC ingestion pipelines using Debezium, Apache Kafka, MongoDB CDC, and</li></ul>PostgreSQL CDC<ul><li>Implement transformation logic including joins, enrichment, normalization, schema mapping,</li></ul>and event-time semantics<ul><li>Integrate Flink jobs with downstream systems such as PostgreSQL, object storage, and internal</li></ul>servicesModernization Away from dbt (Data Build Tool) &amp; Snowflake<ul><li>Assist in migration of analytical and transformation workloads from MongoDB, dbt (Data Build</li></ul>Tool), and Snowflake to Flink/PostgreSQL<ul><li>Translate existing dbt models, DAGs, and downstream dependencies into equivalent Flink</li></ul>transformations or SQL-based operations<ul><li>Support design of new schema models, data quality checks, and lineage patterns to replace</li></ul>dbt/Snowflake functionality<ul><li>Participate in validation and regression testing to ensure fidelity during migration</li></ul>Operational Support<ul><li>Deploy and update Flink jobs on containerized cloud-based platforms (ECS)</li></ul><ul><li>Handle routine operational tasks including job configuration updates, savepoint management,</li></ul>and monitoring<ul><li>Troubleshoot failing jobs and ensure pipeline reliability</li></ul>Collaboration &amp; Documentation<ul><li>Work closely with platform engineering teams to define requirements for migration and pipeline</li></ul>development<ul><li>Produce clear documentation for data flows, schemas, and newly created Flink jobs</li></ul>Requirements<ul><li>4+ years of experience in data engineering or streaming pipeline development</li></ul><ul><li>Practical experience with Apache Flink DataStream API</li></ul><ul><li>Hands-on experience with Apache Kafka as a CDC or event streaming backbone</li></ul><ul><li>Familiarity with Debezium-based connectors or similar CDC frameworks</li></ul><ul><li>Solid understanding of SQL, CTEs, relational modeling, and PostgreSQL</li></ul><ul><li>Experience working with dbt and Snowflake, with ability to analyze models and transformation</li></ul>logic<ul><li>Demonstrated ability to develop software in Java for pipeline development</li></ul><ul><li>Familiarity with cloud environments (AWS preferred)</li></ul><ul><li>Experience refactoring or replacing dbt models with streaming transformations</li></ul><ul><li>Exposure to schema evolution strategies and metadata management</li></ul><ul><li>Some experience with CI/CD workflows for data pipelines</li></ul><ul><li>Familiarity with containerization concepts (Docker, ECS/EKS, or Kubernetes)</li></ul>Core Competencies<ul><li>Detail-oriented with strong problem-solving and troubleshooting skills</li></ul><ul><li>Strong desire for operational excellence and continuous improvement</li></ul><ul><li>Ability to translate analytical requirements into scalable data flows</li></ul><ul><li>Comfortable working within established infrastructure and collaborating with senior engineers</li></ul>on larger changes<ul><li>Effective written and verbal communication skills in English, especially for documentation and</li></ul>collaborationOur Values<ul><li>Be Committed: Work hard, own the problem, keep learning</li></ul><ul><li>Create Trust: Deliver on promises, build trust with clients and colleagues</li></ul><ul><li>Be Bold: Experiment, speak up</li></ul><ul><li>Deliver High Performance: Prepare thoroughly, commit fully, and deliver results</li></ul>Job Types: Full-time, PermanentPay: ₹800,000.00 - ₹1,200,000.00 per yearBenefits:<ul><li>Health insurance</li><li>Paid sick time</li><li>Provident Fund</li></ul>Ability to commute/relocate:<ul><li>Bengaluru, Karnataka: Reliably commute or planning to relocate before starting work (Required)</li></ul>Application Question(s):<ul><li>Skills Required: Develop and maintain ETL and real-time processing pipelines using Apache Flink (DataStream</li></ul>API)<ul><li>Build and extend CDC ingestion pipelines using Debezium, Apache Kafka, MongoDB CDC, and</li></ul>PostgreSQL CDC<ul><li>Implement transformation logic including joins, enrichment, normalization, schema mapping,</li></ul>and event-time semantics<ul><li>Integrate Flink jobs with downstream systems such as PostgreSQL, object storage, and internal</li></ul>services Experience:<ul><li>Data Streaming Engineer : 4 years (Required)</li></ul>Work Location: In person

Data Engineer

Join Smart Hire4u and explore 1   exciting career opportunities. They're hiring for various roles with options for remote or on-site work. Apply today and become part of their innovative team.

Smart Hire4u

ABOUT_COMPANY

Data Engineer