Overview
We are seeking an energetic and highly skilled Senior Data Engineer to join our dynamic data team. In this pivotal role, you will lead the development and optimization of our data infrastructure, enabling advanced analytics and data-driven decision-making across the organization. Your expertise in big data technologies, cloud platforms, and data modeling will drive innovative solutions that support strategic initiatives and operational excellence. If you thrive in a fast-paced environment and are passionate about transforming complex data into actionable insights, this opportunity is for you!
Duties
- Design, develop, and maintain scalable data pipelines using ETL tools such as Informatica, Talend, and Shell Scripting to ensure efficient data flow from multiple sources including AWS, Azure Data Lake, and on-premises systems
- Collaborate with cross-functional teams to gather requirements, translate business needs into technical specifications, and implement robust data solutions using SQL, Python, Java, Spark, Hadoop, and Apache Hive
- Optimize existing data architectures by implementing best practices in database design for Data Warehouses utilizing Microsoft SQL Server, Oracle, and other relational databases
- Develop and deploy RESTful APIs to facilitate seamless data integration and access across platforms
- Lead efforts in model training and analysis skills to support machine learning initiatives and advanced analytics projects
- Ensure data quality, security, and compliance standards are maintained throughout all processes
- Participate actively in Agile development cycles to deliver iterative improvements rapidly while maintaining high standards of quality
Requirements
- Proven experience as a Data Engineer working with Big Data ecosystems such as Hadoop, Spark, Apache Hive, and cloud platforms like AWS or Azure
- Strong proficiency in SQL programming along with experience in database design for Data Warehouses using Microsoft SQL Server or Oracle
- Hands-on knowledge of ETL tools including Informatica and Talend; scripting skills in Bash (Unix shell), Shell Scripting, VBA preferred
- Familiarity with cloud storage solutions like Azure Data Lake and AWS services for scalable data management
- Experience with Looker or similar BI tools for analytics visualization and reporting
- Knowledge of Linked Data principles to enable semantic integration across datasets
- Ability to develop RESTful APIs for data access; experience with Model training for analytics applications is a plus
- Excellent analysis skills with a focus on optimizing performance and ensuring data integrity within complex environments
- Strong understanding of Agile methodologies to facilitate collaborative project delivery
Join us to shape the future of data-driven innovation! We’re committed to fostering an inclusive environment where your expertise fuels impactful solutions. Bring your passion for big data technologies, cloud platforms, and analytics to help us unlock the full potential of our enterprise data landscape.
Pay: $90,000.00 - $180,000.00 per year
Work Location: Remote