Data Engineer

Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : PySpark
Good to have skills : Python (Programming Language), Amazon Web Services (AWS)
Minimum 2 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to effectively migrate and deploy data across various systems, contributing to the overall efficiency and reliability of data operations within the organization. Roles & Responsibilities: - Develop and maintain data pipelines using PySpark, SQL, and Python. - Design and deploy ETL/ELT solutions leveraging AWS services such as Glue, S3, and Glue Catalog. - Analyze business requirements and translate them into technical designs. - Optimize performance and ensure secure AWS deployments. - Monitor and troubleshoot production pipelines; provide timely resolutions. - Document technical workflows and maintain process clarity. - Collaborate actively in team discussions and stakeholder workshops. Professional & Technical Skills: - Must To Have Skills: - Strong knowledge of PySpark, SQL, and distributed data processing. - Good To Have Skills: - Hands-on experience with AWS Glue, S3, and related AWS Big Data services. - Ability to create efficient, reusable, and secure data solutions. - Excellent communication skills for interacting with technical and non-technical stakeholders. - Familiarity with data governance, security best practices, and process visualization tools. - Exposure to public safety domain projects will be considered a strong plus. Additional Information: - The candidate should have minimum 2 years of experience in PySpark. - This position is based at our Chennai office. - A 15 years full time education is required.

15 years full time education