DE&A - Core - AWS data Engineer

AWS Data Engineer

5-8 YRS
Location: HYD

JD:

Job Description

• Assist in designing and implementing scalable and robust processes for ingesting and transforming complex datasets.
• Designs, develops, constructs, maintains and supports data pipelines for ETL from a multitude of sources.
• Creates blueprints for data management systems to centralize, protect, and maintain data sources.
• Focused on data stewardship and curation, the data engineer enables the data scientist to run their models and analyses to achieve the desired business outcomes
• Ingest large, complex data sets that meet functional and non-functional requirements.
• Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.
• Design and build bulk and delta data lift patterns for optimal extraction, transformation, and loading of data.
• Supports the organisation’s cloud strategy and aligns to the data achitecture and governance including the implementation of these data governance practices.
• Engineer data in the appropriate formats for downstream customers, risk and product analytics or enterprise applications.
• Assist in identifying, designing and implementing robust process improvement activities to drive efficiency and automation for greater scalability. This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies.
• Work with various stakeholders across the organization to understand data requirements and apply technical knowledge of data management to solve key business problems.
• Provide support in the operational environment with all relevant support teams for data services.
• Provide input into the management of demand across the various data streams and use cases.