Qureos Mentor

Aceis Services Pvt Ltd

Job Description: Senior Python/DAG DeveloperJob Title: Senior Python/DAG Developer Location: Remote Experience Level: 7+ years Job Type: ContractAbout the RoleWe are seeking a highly experienced and skilled Senior Python/DAG Developer to join our data engineering team. In this role, you will be responsible for designing, developing, and maintaining complex data pipelines and workflows. The ideal candidate will have a deep understanding of data orchestration principles, extensive experience with Python, and a proven track record of building robust and scalable Directed Acyclic Graphs (DAGs) using tools like Apache Airflow. You will be a key player in our effort to build the next generation of data infrastructure, ensuring data is processed efficiently and reliably across the organization.Key Responsibilities<ul><li>Design &amp; Development: Architect, build, and maintain efficient and scalable data pipelines using Python and DAG-based orchestration tools (e.g., Apache Airflow, Dagster, Prefect).</li><li>Orchestration: Develop, schedule, and monitor complex data workflows, ensuring timely and accurate data delivery for business intelligence, analytics, and machine learning initiatives.</li><li>Optimization: Identify performance bottlenecks and refactor data pipelines to improve efficiency, reliability, and cost-effectiveness.</li><li>Collaboration: Work closely with data scientists, analysts, and other engineers to understand data requirements and deliver solutions that meet business needs.</li><li>Code Quality: Uphold and promote best practices in coding, including code reviews, documentation, and automated testing to ensure long-term maintainability.</li><li>Troubleshooting: Diagnose and resolve issues within data pipelines and orchestration systems, responding to incidents and minimizing downtime.</li><li>Mentorship: Act as a subject matter expert and mentor junior developers, sharing knowledge of best practices in Python and data engineering.</li></ul>Required Qualifications<ul><li>Experience: 7+ years in software development with strong focus on Python for data engineering/ETL.</li><li>Python: Expert-level proficiency with clean, production-ready coding.</li><li>DAGs &amp; Orchestration: 3&ndash;5 years of experience with Apache Airflow or similar platforms; strong understanding of Airflow concepts (operators, sensors, hooks, XComs).</li><li>Database Skills: Strong SQL and relational database expertise (PostgreSQL, MySQL); knowledge of NoSQL and data warehouses (Snowflake, BigQuery) is a plus.</li><li>Cloud Platforms: Hands-on experience with AWS, GCP, or Azure and their data services (e.g., S3, Cloud Storage, EMR, Dataproc).</li><li>Data Formats: Familiarity with Parquet, Avro, JSON, and transformation techniques.</li><li>Version Control: Strong knowledge of Git and collaborative workflows.</li><li>Problem-Solving: Excellent analytical and troubleshooting skills.</li></ul>Preferred Qualifications<ul><li>Experience with streaming data technologies (Kafka, Spark Streaming, Flink).</li><li>Knowledge of Docker and Kubernetes.</li><li>Experience with CI/CD pipelines for data engineering.</li><li>Familiarity with data governance and security.</li><li>Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Engineering, or related field.</li></ul>Job Type: ContractPay: &#8377;55.82 - &#8377;67.23 per hourWork Location: Remote

Senior Python / DAG Developer

Join Aceis Services Pvt Ltd and explore 1   exciting career opportunities. They're hiring for various roles with options for remote or on-site work. Apply today and become part of their innovative team.

Aceis Services Pvt Ltd

ABOUT_COMPANY

Senior Python / DAG Developer