Senior Data Engineer

We are looking for the data Warehouse Engineer will be responsible for designing and maintaining a scalable data warehouse on ClickHouse, building and managing ETL/ELT pipelines using Apache Airflow and Airbyte, integrating data from ERPNext (FMCG operations). The role requires close collaboration with supply chain, operations, finance, and farm management teams to ensure timely, accurate, and business-relevant reporting. All data infrastructure — including ClickHouse, Apache Airflow, Airbyte, dbt, and Apache Superset, Power BI — is deployed and maintained entirely on the company's own servers.

Core Responsibilities:

· Design, build, and maintain the ClickHouse data warehouse; manage schema design, partitioning, and query optimization for FMCG datasets (sales, inventory, procurement, farm yield).

· Develop, schedule, and monitor ETL/ELT pipelines using Apache Airflow and Airbyte; integrate data from ERPNext, Retail, and Distribution system flat files, APIs, and external farm management systems.

· Create and maintain interactive dashboards and reports on Apache Superset and Microsoft Power BI for stakeholders across operations, supply chain, finance, and farm management.

· Ensure data quality, lineage, and governance; implement data validation checks, documentation, and metadata management across the data pipeline.

· Collaborate with business teams to gather reporting requirements, translate them into technical solutions, and support ad-hoc analytical queries and data requests.

Education & Experience:

Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field 3–5 years of hands-on experience in data warehousing, ETL pipeline development, and BI reporting in an FMCG, agri-food, or manufacturing environment.

Technical Skills:

- ClickHouse: Data modeling, MergeTree engines, query optimization, replication

- ERPNext: Core modules (Inventory, Procurement, Manufacturing, Accounts), REST API integration

- Apache Airflow: DAG development, scheduling, operators, and task dependency management

- Airbyte: Connector configuration, incremental sync, and custom connector development

- Apache Superset: Dataset creation, chart development, dashboard design, and RBAC configuration

- Power BI: Data modeling (DAX), Power Query, report/dashboard publishing, and governance

- Databases & Programming: Advanced SQL, Python (Pandas, SQLAlchemy)

- DevOps Tools: Docker, Docker Compose

Pay: Rs200,000.00 - Rs300,000.00 per month

Work Location: In person