Valleysoft, a reputable IT services company, is seeking a skilled Data Engineer to join our dynamic team. The successful candidate will be responsible for designing, developing, and maintaining scalable data solutions to support business analytics and decision-making processes.
Key Responsibilities:
-
Design, build, and optimize data pipelines and ETL processes for collecting, transforming, and storing data across multiple sources
-
Develop and maintain data warehouses, data marts, and data lakes to enable efficient data access and analysis
-
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver relevant solutions
-
Ensure data quality, consistency, and security throughout the data lifecycle
-
Monitor and troubleshoot data pipeline performance and implement improvements
-
Keep up-to-date with emerging data engineering technologies and best practices
Requirements
-
Build and maintain data warehouse and data marts, including ODS and internal departmental marts
-
Gather, process, maintain, and analyze large datasets, ensuring data accuracy and quality
-
Design, automate, and support ETL pipelines and data flows across multiple applications
-
Create logical and physical data flow models and mapping designs for ETL processes
-
Strong SQL skills (performance tuning, index management) and solid understanding of database structures
-
Strong understanding of data modeling concepts
-
Familiarity with SQL and NoSQL storage, and Big Data technologies (Hive, Impala, YARN, Kafka, etc.)
Informatica-specific requirements:
-
Hands-on experience with Informatica PowerCenter development (mappings, sessions, workflows)
-
Strong knowledge of Informatica transformations (e.g., Lookup, Joiner, Aggregator, Expression, Router, Sorter) and performance tuning
-
Experience with Informatica Developer
-
Experience with Informatica B2B is a plus
-
Ability to design, automate, monitor, and troubleshoot ETL jobs, including scheduling
Banking sector requirements (preferred):
-
Previous experience in the banking sector, preferably business banking, including working with banking datasets
-
Strong understanding of data quality and reconciliation expectations in banking environments
-
Experience working under regulated environments and change control practices is a strong plus
Benefits
-
Private Health Insurance
-
Training & Development