Senior Consultant | Oracle Analytics Cloud | Hyderabad | Oracle

resource will provide support to Dell in implementing and maintaining an efficient data mesh system, ensuring effective data operations (Data Ops), and enforcing robust data governance. as follows

a) Ingesting data from diverse sources to ensure comprehensive coverage

b) Capture, Curate and consume data to meet specific data product requirements.

c) Supporting necessary capabilities for ensuring good data governance practice

Senior Data Engineer – Role Overview (Spark & Performance Focus)

Core Responsibilities

• Architect, build, and maintain scalable, fault-tolerant data pipelines using Apache Spark.
• Own the end-to-end data lifecycle from ingestion and transformation to storage and consumption.
• Optimize Spark jobs for performance by:
• Tuning shuffles, caching, partitions, and broadcast joins.
• Monitoring via Spark UI, YARN logs, and observability tools.
• Diagnose and resolve performance bottlenecks across distributed compute clusters.
• Write efficient SQL queries and stored procedures on SQL Server and PostgreSQL for analytical and operational workloads.
• Develop reusable Python utilities, scripts, and orchestration logic for streamlined data workflows.
• Collaborate with data scientists, analysts, and backend engineers to translate business needs into performant data solutions.
• Implement data governance, security, and compliance controls:
• Masking and audit logging