Data Engineer (SQL & Analytics)

Experience: 8-9 Years

We are seeking a SQL & Python expert with a passion for data engineering and analytics to join our team. The ideal candidate will be responsible for designing, building, and optimizing the data foundations that power our analytics and machine learning initiatives. This role requires a deep understanding of database architecture, query optimization, and data warehousing.

Key Responsibilities:

• Design and author highly complex, performance-tuned SQL queries to drive our core ETL processes, business intelligence reports, and analytical data models.
• Architect and manage scalable data pipelines, with a primary focus on SQL-based transformations within our cloud data warehouse (e.g., AWS Athena).
• Apply advanced SQL techniques and statistical knowledge to perform complex data validation, cleansing, and integrity checks to support machine learning model development.
• Partner with data scientists to translate complex modeling requirements into efficient SQL queries for feature engineering and data extraction.
• Develop and maintain data quality and pipeline performance monitoring dashboards (Grafana), often powered by SQL-driven metrics.

Core Qualifications:

• SQL: Unmatched expertise in SQL. You must be highly proficient in writing and optimizing complex queries using multi-stage joins, common table expressions (CTEs), window functions, and stored procedures. A deep understanding of query execution plans and database performance tuning within a columnar data warehouse environment is essential.
• Data Warehousing (AWS): Hands-on experience with a cloud data warehouse, particularly AWS Redshift or similar technologies (e.g., Snowflake, BigQuery). Strong familiarity with related AWS services like S3 and Glue is required.
• Python: Strong Python scripting skills, used primarily for automating SQL-driven workflows and performing data manipulation (Pandas, NumPy) that complements our ETL processes.
• Statistics: A solid foundation in statistical concepts, used to validate data integrity and perform analytical investigations using SQL-based tests.
• Visualization & MLOps: Proven ability to build Grafana dashboards to visualize query performance and data quality. Familiarity with MLOps principles is a significant plus.

Job Type: Full-time

Work Location: In person