Summary
Our client is seeking a Data Engineer to implement data products with a focus on collecting, parsing, managing, and analyzing large sets of data to turn information into insights using multiple platforms while ensuring that data pipelines are scalable, repeatable, and secure
Responsibilities
-
Collect, cleanse, analyze, and validate data before storing it in application databases for final use by the organization and/or its clients.
-
Construct and apply standard statistical analysis and/or models to verify data acceptability/accuracy.
-
Configure, operate, and develop manual and/or automated methods, processes, and procedures to test input and output based on data compliance and quality.
-
Plan, design, develop, and perform quality assessments on data elements and structures to document and evaluate the integrity, completeness, quality, and appropriateness of format, records, and structures.
-
Gather and enter missing data and resolve any anomalies.
-
Work on Extract, Load, and Transform (ELT) processes/projects, individually, as part of, or in conjunction with a database/data warehouse team.
Requirements
-
4+ years of experience collecting, parsing, managing, and analyzing large sets of data.
-
Experience developing and analyzing complex SQL statements on a variety of relational databases (PostgreSQL, MySQL) for data querying and manipulation.
-
ETL/ELT experience.
-
Proven ability to use GitLab for creating a project, cloning a repository, creating a branch, staging, and committing and pushing changes.
-
Linux BASH scripting experience.
Preferred
-
Experience using core AWS services to build and support data warehouse solutions leveraging AWS architecture best practices.
-
Experience with Databricks.
-
Experience with Python.
This is a 12-month Contract opportunity. US Citizenship is required for this role. 100% Paid employee Medical/Dental Benefits, Paid time off, Paid Holidays, and 401(k) (with immediately-vested company match) available with TriCom during the contract period. H1-B Visa sponsorship is not available for this position. No third-parties, please.