3896 وظيفة Data Engineer Aws قريبًا مني

About Letitbex AI:

Letitbex AI is a fast-growing AI-driven technology company focused on building intelligent, scalable, and enterprise-grade solutions. We work at the intersection of AI, data engineering, cloud, and business transformation, helping organizations unlock real value from artificial intelligence.

Position: Data Engineer

Experience: 3+ Years

Notice Period: Can be considered up to 20 Days

Location: Hyderabad (Hybrid)

Data Engineer with strong expertise in AWS, PySpark, and Snowflake

• Sound working experience in AWS cloud tech stack and Snowflake
• Coordinate closely with the Business teams for data integration and alignment
• Design,Develop, Maintain, support, and enhance the business intelligence data backend, including data warehouse and datalakes
• Ability to assess the current environment , requirements and propose the Data Engineering Solutions
• Adapt quickly to change in requirements and be willing to work with different technologies if required
• Ability to build frameworks and pipelines using AWS PySpark and Glue
• Able to enhance various Extraction, Ingestion and Enriched Frameworks that are already built using PySpark and Glue
• Able to build the logic by reading the data from AWS S3 and apply the transformations using Python and GCP
• Able to understand the existing AWS Lambda, SNS and SQS Events
• Able to work with platform team in problem solving and troubleshooting activities.
• Propose Standard and Best Practices by leveraging AWS Services
• Apply creative thinking/approach to arrive at technical solutions that enhance business goals and align with corporate technology strategies.
• Help Application teams in onboarding the feeds in to the built-in frameworks
• Make sure to follow best design practices during the implementation of ETL Frameworks
• Develop prototypes, technical proof of concepts and code with various solutions and convert platform architecture blueprints to real life working artifacts

Qualification:

• Bachelor’s or Master’s Degree in Computer Science or equivalent experience
• At least 3+yrs years of experience in application design, development and analysis
• Experience in AWS Cloud Solutions & GCP. Retail Industry experience preferred.
• Implement data transformations and data structures for data warehouse and lake/repository.
• Manage cloud and/or on-premises solutions for data transfer and storage.
• Process data using spark (PySpark)
• Manage cloud and/or on-premises solutions for data transfer and storage.
• Collaborate and work with data analysts in various functions to ensure that data meets their reporting and analysis needs.
• Experience in creating Various ETL Frameworks in processing or extracting the data from cloud databases by using AWS Services by leveraging Lambda, Glue, PySpark, Step Functions, SNS, SQS and Batch.
• Proven ability to be a strategic thinker to drive the necessary ownership and data governance within the organization
• Ability to evaluate risks and provide business recommendations / solutions in a timely manner
• Ability to remain calm in high stress situations while navigating and leading during times of conflict
• Should have sound knowledge in various AWS Services
• Able to understand the existing Frameworks built in AWS PySpark and Glue
• Able to scan ETL Frameworks and propose optimizations and cost savings.
• Able to work independently and able to take key decisions.
• Comfortable interacting with stakeholders at all levels through Business and IT.