Data Engineer | Elastic Search Expertise | 4+ years

We are looking for an experienced Data Engineer with deep expertise in Elasticsearch to design, build, and maintain scalable data pipelines and infrastructure that power high-performance search and analytics systems.

This role focuses on enabling efficient data ingestion, transformation, indexing, and querying of large-scale structured and unstructured data into Elasticsearch clusters. The ideal candidate will bring strong hands-on experience with ETL/ELT pipeline development, Elasticsearch performance tuning, and data observability in production environments.

Key Responsibilities:

• Design, develop, and maintain robust ETL/ELT pipelines to ingest data into Elasticsearch from multiple data sources (structured, semi-structured, and unstructured).
• Automate and optimize data workflows for transformation and indexing.
• Ensure reliability, scalability, and data quality across all pipeline processes.
• Configure and manage Elasticsearch clusters for optimal performance, scalability, and fault tolerance.
• Optimize index settings, mappings, analyzers, and shard allocation strategies.
• Design efficient index structures and leverage aggregations, filters, and full-text search for fast, accurate queries.
• Implement monitoring and alerting systems using Elastic Stack (Kibana, Beats) and other observability tools.
• Develop automated health checks for APIs, endpoints, and infrastructure components.
• Define and manage key performance metrics and escalation procedures for system health.
• Work closely with application developers, data analysts, architects, and DevOps teams to ensure Elastic-based solutions are stable and scalable.
• Provide technical guidance on Elasticsearch best practices, query design, and performance tuning.
• Contribute to data governance by ensuring high standards in data quality, metadata management, and lineage tracking.

Required Skills

• Strong hands-on experience with Elasticsearch architecture, indexing, and query optimization.
• Proven ability to design and build ETL/ELT data pipelines for search and analytics.
• Expertise in data modeling for search-driven applications.
• Experience with data warehousing concepts and data governance principles.
• Familiarity with tools such as BigQuery, Kibana, or similar analytics dashboards.
• Strong scripting and automation skills using Python, Shell, or equivalent languages.

Preferred Skills

• Experience with 3DX or Teamcenter data structures.
• Exposure to AI/ML workflows and integrating Elasticsearch with machine learning models.
• Familiarity with Elasticsearch observability stack (e.g., Beats, Logstash, APM).
• Understanding of data lake or data lakehouse architectures.

Job Types: Full-time, Permanent

Pay: ₹469,516.31 - ₹3,000,000.00 per year

Application Question(s):

• Mention your last working date

Experience:

• ETL: 4 years (Preferred)
• Elasticsearch: 4 years (Preferred)
• Python: 4 years (Preferred)
• Data modeling: 4 years (Preferred)
• Data warehouse: 4 years (Preferred)
• bigQuery: 5 years (Preferred)
• AI/ML: 4 years (Preferred)

Work Location: In person