Senior Data Engineer

JOB DETAILS:

• Role: Lead Data Engineer
• Skills: Snowflake/Snowpipe, SQL, Python/PySpark, Kafka, Azure, ADLS, ADF, Data Vault, Databricks, Streaming
• Experience: 10+years
• Location: Chicago, IL (Onsite Job)

We at Coforge are seeking an experienced Lead Data Engineer someone with strong experience in

Snowflake/Snowpipe, SQL, Python/PySpark, Data Modeling, Data Vault, Kafka and Development of Azure based data platforms, experience in query optimization.

• Snowflake/Snowpipe, SQL, Python/PySpark
• Data Modeling, Data Engineering with Modeling Techniques - hands on experience
• Must have Data Vault experience and Real implementation experience
• Kafka-based streaming, EventHub
• Lead development of Azure-based data platforms, including ADLS, ADF, Databricks, and CI/CD automation.
• Streaming
• Triggers/Task
• Difference b/w virtual warehouse and serverless compute
• Why DBT compared to others
• experience in query optimization