Databricks Developer/Engineer

Founded in 1976, CGI is among the world's largest independent IT and business consulting services firms. With 94,000 consultants and professionals globally, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services, and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion, and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.

Job Title: Databricks Developer / Engineer
Position: SSE / LA
Experience: 4+ years of experience
Category: Software Development
Job location: Bangalore / Chennai
Position ID: J1025-0246
Work Type: Hybrid
Employment Type: Full Time / Permanent
Qualification: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

• Design, develop, and maintain scalable and reliable data pipelines using AWS services, PySpark, and Databricks.
• Collaborate with cross-functional teams to understand data requirements, identify data sources, and define data ingestion strategies.
• Implement data extraction, transformation, and loading (ETL) processes to enable efficient data integration from various sources.
• Hands-on experience in developing and optimizing Databricks data pipelines using PySpark.
• Proficient in SQL, Python, and ETL processes
• Optimize and tune data pipelines to ensure high performance, scalability, and data quality.
• Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
• Collaborate with data scientists and analysts to provide them with clean, transformed, and reliable data for analysis and modeling.
• Develop and maintain data documentation, including data lineage, data dictionaries, and metadata management.
• Level of exp in Databricks: E4
• Should have worked in different functional perimeters (e.g. finance, HR, Geology, HSE…), so that they are open-minded and able to adapt to the HR domain which requires to have a deep understanding of functional need to make good quality developments (otherwise the calculation or the developed rule gives wrong results (e.g. negative headcount of employees, wrong columns used to make calculation, calculation in itself that wouldn’t follow the logical HR rule given by the business…)

CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.

#LI-GB9