Freelancing Opportunity
Job Title: Senior Data Engineer / Lead Data Engineer
Experience: 8+ Years
About the Role
We are seeking a highly experienced and motivated Senior Data Engineer with deep expertise in data warehousing, ETL development, and data engineering. In this critical role, you will design and build scalable, high-performance data solutions that convert raw data into actionable insights. You will also serve as a technical leader, mentoring junior engineers and driving best practices across the data engineering function.
Must-Have Skills
- Strong expertise in SQL Server (T-SQL) and Python (mandatory)
- PostgreSQL experience (preferred)
- Strong understanding of Object-Oriented Programming (OOP)
- ML Engineering experience as a primary skill
- Ability to write complex SQL, T-SQL, and PySpark procedures to solve business problems
Nice-to-Have Skills
- Apache Spark / PySpark
- Hadoop ecosystem tools
Key Responsibilities
- Lead the design, development, and implementation of data-driven solutions
- Define high-level and detailed technical specifications for data pipelines and models
- Develop, optimize, and maintain ETL pipelines using tools such as Informatica, SSIS, StreamSets, and Apache Spark
- Work extensively with SQL, T-SQL, and PySpark to build efficient and scalable data transformations
- Design and implement data models and schemas for analytics and reporting
- Leverage big data technologies including HDFS, Hive, Impala, Spark, Kafka, and Sqoop
- Monitor, troubleshoot, and resolve complex data pipeline and performance issues
- Ensure data governance, quality, and security best practices
- Mentor junior engineers and promote a culture of collaboration and technical excellence
- Stay up to date with emerging data engineering and ML engineering trends
Qualifications
- 8+ years of experience in data warehousing, ETL, and data engineering
- Proven experience building scalable, high-performance data platforms
- Strong problem-solving, communication, and leadership skills
Job Types: Part-time, Freelance
Contract length: 12 months
Pay: ₹30,000.00 - ₹40,000.00 per month
Benefits:
Experience:
- total work: 7 years (Required)
Shift availability:
- Night Shift (Required)
- Overnight Shift (Required)
Work Location: Remote