Qureos Mentor

Incedo Inc.

<div>
 
 Incedo Inc. is a high-growth Digital, Data and AI Transformation Specialist firm headquartered in New Jersey. We
 
 
 are a long-term strategy execution partner for Fortune 500 enterprises, operating at the intersection of business
 
 
 and technology across Banking &amp; Payments, Wealth Management, Telecom, Hi-Tech, and Life Sciences.
 
 
 We are building Incedo 4.0 - an AI-native, execution-focused, founder-led organization designed for scale, speed,
 
 
 and long-term impact.
 
 
 Incedo delivers ROI from AI @ Scale through the &ldquo;Power of 3&rdquo;:
 
 
 &bull; Deep domain expertise
 
 
 &bull; AI &amp; Data capabilities
 
 
 &bull; Engineering &amp; Operations excellence
 
 
 
 
 
 
 Job Title: Sr.Data Engineer&ndash; AWS &amp; Streaming
 
 
 
 
 Location
 
 : Fort Mill, SC or New York City, NY (Hybrid)
 
 
 
 
 
 Role Summary:
 
 
 We are seeking a Mid&ndash;Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines, implement robust data validation and monitoring processes, and support mission-critical analytics platforms.
 
 
 
 
 
 
 Key Responsibilities:
 
 
 <ul>
 <li>
 Develop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python
 </li>
 <li>
 Build event-driven workflows using AWS Lambda
 </li>
 <li>
 Design and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink
 </li>
 <li>
 Implement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation
 </li>
 <li>
 Optimize data processing performance, scalability, reliability, and cost in cloud environments
 </li>
 <li>
 Collaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline
 </li>
 </ul>
 
 
 
 
 
 Required Skills:
 
 
 <ul>
 <li>
 Strong hands-on experience with Python and PySpark
 </li>
 <li>
 Proven expertise in AWS Glue, Lambda, and other cloud-native data services
 </li>
 <li>
 Solid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns)
 </li>
 <li>
 Demonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection)
 </li>
 <li>
 Strong understanding of distributed data processing and scalable architecture patterns
 </li>
 </ul>
 
 
 
 
 
 Good-to-Have Skills:
 
 
 <ul>
 <li>
 Experience with Apache Flink for real-time stream processing and stateful computations
 </li>
 <li>
 Knowledge of KSQL or other streaming SQL engines
 </li>
 <li>
 Exposure to CI/CD pipelines, IaC (Terraform/CloudFormation), and DevOps practices
 </li>
 <li>
 Familiarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi
 </li>
 <li>
 Experience working in enterprise or financial data environments
 </li>
 </ul>
 
 
 
</div>

Senior Data Engineer

Join Incedo Inc. and explore 1   exciting career opportunities. They're hiring for various roles with options for remote or on-site work. Apply today and become part of their innovative team.

Incedo Inc.

About Company

Senior Data Engineer