FIND_THE_RIGHTJOB.
Senior Analyst - Data Engineering
JOB_REQUIREMENTS
Hires in
Not specified
Employment Type
Not specified
Company Location
Not specified
Salary
Not specified
Designation:Senior Analyst - Data Engineering
Experience: 4 to 7 years
Location: Chennai, Tamil Nadu , India (CHN)
Job Description:
We are seeking an experienced Python Backend Developer with more than 5 years of hands-on experience to build and maintain reliable, scalable, and secure LLM orchestration services. In this role, you'll design reusable and testable modules, implement end-to-end RAG pipelines, and establish robust CI/CD practices with a strong emphasis on security and observability.
Responsibilities:
RAG Pipeline Development
- Design and implement complete RAG pipelines including embeddings generation, vector search, prompt injection, LLM invocation, and post-processing
- Build modular, maintainable code with clear interfaces for context assembly, retrieval logic, prompt construction, LLM invocation, and data persistence
- Optimize pipeline performance through token caching strategies, async I/O patterns, intelligent caching, and resource right-sizing
- Implement best practices for LLM orchestration ensuring efficient token usage and response quality
- CI/CD & Release Management
- Design and implement automated CI/CD pipelines with comprehensive test coverage, security scanning, and gated deployments
- Manage deployment strategies across dev, staging, and production environments
- Establish branching models, pull request workflows, code review standards, and merge strategies with quality gates
- Observability & Monitoring
- Implement comprehensive logging, tracing, and metrics collection for RAG pipelines
- Track key performance indicators including RAG cache hit rates, retrieval latency, LLM response times, and error rates
- Set up alerting mechanisms and monitoring dashboards using Azure Application Insights or similar tools
- Utilize structured logging and distributed tracing (OpenTelemetry) for production troubleshooting
- Code Quality & Best Practices
- Maintain high code quality standards with well-organized project structures, proper error handling, retry logic, and comprehensive logging
- Write unit tests, integration tests, and end-to-end tests with appropriate mocking strategies
- Implement database best practices including stored procedures, proper table design (primary keys, audit fields, indexing)
- Create and maintain thorough technical documentation
- Enforce security gates throughout the development lifecycle
Skills:
- Real-world experience with Azure Functions or similar serverless frameworks Experience with Azure SQL or similar relational databases Strong understanding of testing methodologies: unit testing, integration testing, and end-to-end testing with mocking frameworks Experience with CI/CD pipelines using Azure DevOps or GitHub Actions Knowledge of container builds, scanning, and deployment workflows Familiarity with Git branching strategies, PR workflows, and merge strategies (Good to have)Hands-on experience with LLM orchestration and RAG architectures, including embeddings, vector search, and prompt engineering (Good to have) Experience with LLM orchestration frameworks such as llama_index, LangChain, or similar (Good to have) Proficiency with Azure AI Search, Azure OpenAI
- Strong grasp of modular design, clean code principles, and API design Experience with error handling, retry mechanisms, and resilience patterns Understanding of asynchronous programming and performance optimization
Job Snapshot
Updated Date
23-12-2025
Job ID
J_4555
Location
Chennai, Tamil Nadu, India
Experience
4 - 7 Years
Employee Type
Permanent
© 2025 Qureos. All rights reserved.