Architect Data

Role & Responsibilities:

● Design and build a hybrid data solution using a combination of on-premise and in-cloud services.

● Work with business users and other stakeholders to understand business processes. Ability to design and implement Dimensional and Fact tables

● Identify and implement data transformation/cleansing requirements

● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse

● Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical data definitions

● Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact on our massive scale.

● Build tools to ingest and process terabyte-scale data on a daily basis.

● Communicate with a wide set of teams, including product owners, business analysts, data and enterprise architects, platform engineers, and cloud vendors, etc.

● Compilation of detailed design documents, technical specification documents, and test plans as required.

● Independently manage development tasks as per technical specification documents, prod deployment, post prod support, etc.

● Managing support to Unit Testing, SIT & UAT.

● Coordinate with business and support teams on testing and migration activities. Required Skills

● Experience in developing Big Data solutions (migration, storage, processing)

● Experience building and deploying cloud-based solutions at scale.

● 3+ years’ experience of Hands-on in data structures, spark, SQL and NoSQL Databases

● Hands-on experience in AWS Cloud with services such as AWS Glue, AWS Redshift, EC2, Lambda, S3.

● Strong software development skills in Python and Pyspark.

● Experience building and deploying cloud-based solutions at scale.

● Experience in developing Big Data solutions (migration, storage, processing).

● BS, MS or PhD degree in Computer Science or Engineering, and 4+ years of relevant work experience in Big Data and cloud systems

● Experience in SQL and Query optimization.

● Ability to clearly communicate technical roadmap, challenges and mitigation

● Experience building and supporting large-scale systems in a production environment.

Job Type: Full-time

Pay: ₹2,000,000.00 - ₹3,000,000.00 per year

Work Location: Remote