Vertica Data Engineer

Vertica Data Engineer

Experience : 4+ years (Relevant)
Location: Dubai (Onsite)
Notice Period : Immediate - 30 days

Job Summary:

As a Vertica Data Engineer, you will be responsible for architecting, developing, and maintaining our Vertica database systems and data pipelines. You will work closely with cross-functional teams, including data scientists, analysts, and developers, to ensure seamless data integration, transformation, and retrieval from Vertica. Your expertise in Vertica's architecture, ETL processes, data modeling, and performance tuning will be crucial in delivering robust and scalable data solutions to support our business objectives. Responsible to migrate data from Oracle, SQL Server to VERTICA Database on timely manner.

1. Roles & Responsibility:

• Design and implement efficient data pipelines to extract, transform, and load (ETL) data from various sources into Vertica using Popular ETL Tools like (SAP BODS, INFORMATICA).
• Develop and maintain data models and database structures optimized for high-performance data retrieval and analysis in Vertica.
• Experience in Migrating data from Oracle/SQL Server/SQ Lite to VERTICA Database
• Write Program units (Functions/Procedures) to prepare Data based on the Business requirements.
• Collaborate with data scientists and analysts to understand their data needs and provide scalable solutions to meet analytical requirements.
• Implement data quality checks and data validation processes to ensure the accuracy and integrity of data stored in Vertica.
• Experience in VerticaPy to work with Machine Learning Libraries for Data science use cases
• Work with the DevOps team to ensure smooth deployment, monitoring, and maintenance of Vertica instances.
• Optimize database performance and query execution through indexing, partitioning, and other performance tuning techniques.
• Monitor Vertica database health, troubleshoot performance issues, and proactively address potential bottlenecks.
• Collaborate with data engineers and other stakeholders to define best practices and data governance standards for Vertica usage.
• Stay up-to-date with the latest advancements in Vertica and big data technologies and recommend improvements to existing solutions.
• Document technical specifications, data flows, and architectural designs related to Vertica implementations.
• Provide training and support to end-users to enable them to navigate and interact with Power BI reports effectively

2. Skill Requirements:

• Vertica Certification is a plus.
• Experience with data visualization tools (e.g., Power BI, SAP BI, SAS, Tableau) for data reporting and dashboard creation is beneficial.

4. Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field

5. Preferred Experience

1. Proven experience as a Data Engineer or similar role with hands-on expertise in designing and managing data solutions in Vertica.

2. Strong proficiency in SQL and experience with data modeling and schema design in Vertica.

3. In-depth knowledge of ETL processes and tools, particularly for data integration into Vertica.

4. Familiarity with other big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure) is advantageous.

5. Understanding of data warehousing concepts and best practices.

6. Experience in performance tuning and optimization of Vertica databases.

7. Familiarity with Linux environments and shell scripting for data-related automation tasks is a plus.

8. Excellent problem-solving skills and the ability to handle large datasets effectively.

9. Strong communication and collaboration skills to work effectively within a team-oriented environment.

10. Self-motivated, with the ability to work independently and manage multiple tasks and projects simultaneously.

Job Type: Full-time

Pay: AED12,000.00 - AED17,000.00 per month

Application Question(s):

• Do you have hands-on expertise in designing and managing data solutions in Vertica?

Experience:

• Relevant: 4 years (Preferred)