Data Engineer

Summary

The Data Engineer’s role is to work with the stake holders and project teams to ensure data needs/requirements are captured and fulfilled. This role would require a service-oriented mentality, high sense of ownership of the problems and requests assigned, focus on managing and resolving issues and establishing and maintaining communications with stake holders to keep them updated.

Required Qualifications

• Experience with database design and architecture – both SQL and NoSQL experience in the Cloud (AWS or Azure in particular)
• Experience with data warehousing – leverage big data in a meaningful manner; Snowflake experience a plus
• Experience with data transformation and ingestion – unifying large datasets into usable/accessible destinations (AWS Glue, Azure Data Factory)
• Knowledge of data processing/buffering – proven experience dealing with high volumes of business critical data
• Knowledge of operational automation tooling – data deployment automation tools
• Knowledge of high availability architecting – focus on redundancy, fail-over, and resilience
• Good understanding of estimation techniques
• Bachelors in Business MIS, or Computer Science (or equivalent work experience)
• 4+ years’ experience in database administration of development
• 4+ years’ experience in technology or finance fields
• Certifications in SQL or other database technology
• Strong understanding of database structures, theories, principles, and practices
• Hands-on database tuning and troubleshooting experience
• Experience with data processing flowcharting techniques
• Good understanding of the organization’s goals and objectives
• Knowledge of applicable data privacy practices and laws
• Good written and oral communication skills
• Strong technical documentation skills
• Good interpersonal skills
• Ability to conduct research into database issues, standards and products as required
• Ability to present ideas in user-friendly language
• Highly self-motivated and directed
• Keen attention to detail
• Proven analytical and problem-solving abilities
• Ability to effectively prioritize and execute tasks in a high-pressure environment
• Strong customer service orientation
• Experience working in a team-oriented, collaborative environment

Essential Functions

• Assembles and architects large, complex sets of data that meet business and technical requirements
• Identifies, designs and implements well-architected, data-centric solutions including:
  • Re-designs infrastructure for greater scalability
  • Optimizes data delivery
  • Automates manual processes
• Develops and maintains strategies on data consolidation
• Builds data models and defines the structure, attributes and nomenclature of data elements
• Maintains a strong grasp of ETL process and development
• Manages, Architects and builds Data ODS , Warehouse , and standard systems
• Builds required infrastructure for optimal extraction, transformation and loading of data from various data sources
• Builds analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics
• Works with stakeholders including data, design, product and executive teams and assists them with maximizing the impact of their data
• Addresses requests and needs on data analysis and report management
• Collaborates with application development, product owners, and business stake holders to achieve business results
• Participates in development and creation of Data warehouses
• Conducts Performance Tuning and Query Optimization, using Performance Monitor, SQL Profiler and other related monitoring and troubleshooting tools
• Demonstrates a strong knowledge of how indexes, index management, integrity checks, configuration, patching
• Writes and troubleshoots SQL Code ( stored procs, functions, tables, views, triggers, indexes, constraints )
• Evaluates new data sources for adherence to the organization's quality standards and ease of integration
• Maintains database performance by identifying and resolving production and application development problems; calculating optimum values for parameters; evaluating, integrating, and installing new releases; completing maintenance; answering user questions
• Provides database support by coding utilities, responding to user questions, and resolving problems
• Updates job knowledge by participating in educational opportunities; reading professional publications; maintaining personal networks; participating in professional organizations
• Accomplishes information systems and organization mission by completing related results as needed
• Creates functions to provide custom functionality as per the requirements
• Develops best practices around database reporting and Business Intelligence tools

Additional Specific Duties and Responsibilities

• Identifies, monitors, and communicates technical risk factors, issues, status, and results to IT management
• Participates in design walk-throughs and database script/code reviews