Senior Software Engineer - Data Operations
Let’s be unstoppable together!
At Circana, we are fueled by our passion for continuous learning and growth. We seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We have a global commitment to diversity, equity, and inclusion as we believe in the undeniable strength that diversity brings to our business, employees, clients, and communities. With us, you can always bring your full self to work. Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified™ by Great Place To Work®. This prestigious award is based entirely on what current employees say about their experience working at Circana.
Learn more at www.circana.com.
What will you be doing?
At Circana, customer experience is at the forefront of everything we do. To help us build functional systems that improve the customer experience, we’re looking for a Data Operations Engineer who can be responsible for deploying product updates, identifying production issues, and implementing integrations that meet our customers’ needs. The ideal candidate will have a solid background in software engineering and be familiar with Python and will work with developers and engineers to ensure that software development follows established processes and works as intended.
Job Responsibilities
- Monitoring Data Loads:
- Continuously monitor data loading processes in production, identifying potential bottlenecks, errors, or anomalies in real-time using monitoring tools.
- Troubleshooting Data Issues:
- Diagnose and resolve data loading errors, including data format issues, connectivity problems, mapping errors, and data integrity concerns.
- Root Cause Analysis:
- Investigate the root cause of recurring data loading problems, and implement preventive measures to mitigate future issues.
- Data Validation:
- Perform quality checks on loaded data to ensure accuracy and consistency with expected data patterns.
- Incident Management:
- Respond to data loading incidents promptly, escalating critical issues to relevant stakeholders as needed.
- Documentation and Knowledge Sharing:
- Maintain clear documentation of data loading procedures, troubleshooting guides, and best practices to support team knowledge transfer.
Required Skills and Qualifications
- 4 – 6 years of work experience in large data integration and Data warehousing environment
- Experience as an Operations engineer or in a similar software engineering role
- Evaluate existing operational workflows and identify areas for enhancement.
- Collaborate with cross-functional teams to execute changes and monitor their effectiveness.
- Good knowledge of Data load monitoring, Python(optional), Unix, SQL, Shell Scripting
- Exposure to using automated scripts for data extraction, loading and validations
- Exposure to handling data from various sources (Flat files, Excel, Access, Oracle/Hadoop, Azure, GCP, AWS etc.)
- Working knowledge of databases and SQL
- Job scheduling thru Control-M, Airflow
- Problem-solving attitude
- Collaborative team spirit
Preferred Skills and Qualifications
- Bachelor of science degree (or equivalent) in computer science, engineering, or relevant field
- Experience in data load monitoring, Investigation
- Experience in building or maintaining ETL processes
- Exhibit a high level of ownership in responsibilities.
- Implement checks to ensure data accuracy, completeness, and consistency.
- Monitor data loads and troubleshoot anomalies or failures.
- Ready to work in 24x7 environment
Experience: 4-6 Years
Tech Stack: Unix, SQL, Airflow/Control M, Shell/Python
Location: Whitefield, Bangalore (Hybrid Model)