data scientist

data engineer (pyspark) Jobs in Bangalore

data engineer (pyspark)

data scientist project manager Jobs in Bangalore

data scientist project manager

data strategy consultant Jobs in Bangalore

data strategy consultant

lead data  engineer

data engineer

Virtusa

<div>
 
 About The Role
 
 
 
 We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that ensure high data quality and availability across the organization. This role requires a strong background in big data ecosystems, cloud-native tools, and advanced data processing techniques.
 
 
 The ideal candidate has hands-on experience with data ingestion, transformation, and optimization on the Cloudera Data Platform, along with a proven track record of implementing data engineering best practices. You will work closely with other data engineers to build solutions that drive impactful business insights.
 
 
 
 Responsibilities
 
 
 
 Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.
 
 
 Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.
 
 
 Data Transformation and Processing: Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements.
 
 
 Performance Optimization: Conduct performance tuning of PySpark code and Cloudera components, optimizing resource utilization and reducing runtime of ETL processes.
 
 
 Data Quality and Validation: Implement data quality checks, monitoring, and validation routines to ensure data accuracy and reliability throughout the pipeline.
 
 
 Automation and Orchestration: Automate data workflows using tools like Apache Oozie, Airflow, or similar orchestration tools within the Cloudera ecosystem.
 
 
 Education and Experience
 
 
 Bachelors or Masters degree in Computer Science, Data Engineering, Information Systems, or a related field.
 
 
 3+ years of experience as a Data Engineer, with a strong focus on PySpark and the Cloudera Data Platform.
 
 
 Technical Skills
 
 
 PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.
 
 
 Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.
 
 
 Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).
 
 
 Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.
 
 
 Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.
 
 
 Scripting and Automation: Strong scripting skills in Linux.
</div>

Data Engineer (Pyspark)

MakeMyTrip

<div>
 
 
 Role:
 
 Lead Data Engineer
 
 
 
 Location:
 
 Bangalore
 
 
 
 Years of Experience:
 
 6 -8 Years
 
 
 
 About the function:
 
 
 
 At MakeMyTrip (MMT), technology is at the heart of everything we do. As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructure to create seamless and innovative travel experiences. We prioritize a tech-first mindset, where our engineering teams lead the charge in transforming the way people travel.
 
 
 Our culture encourages collaboration, creativity, and thought leadership, empowering engineers to challenge the status quo and develop impactful, game-changing solutions. At MMT, you'll work with the latest technologies, continually push boundaries, and have the chance to shape the future of travel.
 
 
 Join us and become part of a forward-thinking, tech-driven organization that thrives on innovation and continuous learning.
 
 
 
 
 
 
 About the team:
 
 
 
 MakeMyTrip as India&rsquo;s leading online travel company and provides petabytes of raw data which is helpful for business growth, analytical and machine learning needs.
 
 
 
 
 
 Data Platform Team is a horizontal function at MakeMyTrip to support various LOBs (Flights, Hotels, Holidays, Ground) and works heavily on streaming datasets which powers personalized experiences for every customer from recommendations to in-location engagement.
 
 
 
 
 
 Our team's key responsibilities are:
 
 <ol>
 <li>
 Design, construct, and maintain robust data systems and architectures
 </li>
 <li>
 Develop and optimize data capture, storage, processing, serving, and querying platforms
 </li>
 <li>
 Create data products for personalization, recommendation, customer segmentation, and intelligence
 </li>
 <li>
 Enhance our Measurement platform for A/B experimentation
 </li>
 <li>
 Contribute to our Feature Store, an internal unified data analytics platform
 </li>
 <li>
 Participate in the development of our next-generation Travel Planner using Generative AI and Multi-Agent frameworks.
 </li>
 <li>
 Implement and optimize data solutions for travel-specific use cases, such as:
 </li>
 <li>
 Analyzing cross-city travel patterns to extend trip recommendations
 </li>
 <li>
 Identifying correlations between hotel bookings in different areas to suggest complementary destinations
 </li>
 </ol>
 
 
 
 
 Required Skills and Experience:
 
 <ul>
 <li>
 Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture
 </li>
 <li>
 At least 6+ years of hands-on experience in Spark/BigData Tech stack
 </li>
 <li>
 Expertise in stream processing engines like Spark Structured Streaming or Apache Flink
 </li>
 <li>
 Analytical processing on Big Data using Spark
 </li>
 <li>
 At least 4+ years of experience in Scala. Experience with Python will be a plus.
 </li>
 <li>
 Hands-on administration, configuration management, monitoring, performance tuning of Spark workloads, Distributed platforms, and JVM based systems
 </li>
 <li>
 At least 2+ years of cloud deployment experience &ndash; AWS | Azure | Google Cloud Platform
 </li>
 <li>
 2 or more product deployments of big data technologies &ndash; Business Data Lake, NoSQL databases etc
 </li>
 <li>
 Awareness and decision-making ability to choose among various big data, NoSQL, analytics tools and technologies
 </li>
 <li>
 Should have experience in architecting and implementing domain centric big data solutions
 </li>
 <li>
 Ability to frame architectural decisions and provide technology leadership &amp; direction
 </li>
 <li>
 Excellent problem solving, hands-on engineering, and communication skills
 </li>
 </ul>
 
 
 
 
 
 
 
 At MakeMyTrip, we're committed to innovation and excellence in the travel industry. Join us in shaping the future of travel through data-driven solutions and advanced technologies. If you're passionate about leveraging data to create exceptional travel experiences, we want to hear from you!
 
</div>

Lead Data  Engineer

<div>
 
 Introduction
 
 
 
 In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
 
 
 
 Your Role And Responsibilities
 
 
 
 <ul>
 <li>
 As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing.
 </li>
 <li>
 Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets.
 </li>
 <li>
 In this role, your responsibilities may include:
 </li>
 <li>
 Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques
 </li>
 <li>
 Designing and implementing various enterprise search applications such as Elasticsearch and Splunk for client requirements
 </li>
 <li>
 Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviours.
 </li>
 <li>
 Build teams or writing programs to cleanse and integrate data in an efficient and reusable manner, developing predictive or prescriptive models, and evaluating modelling results
 
 
 </li>
 </ul>
 
 Preferred Education
 
 
 
 Master's Degree
 
 
 
 Required Technical And Professional Expertise
 
 
 
 <ul>
 <li>
 Proof of Concept (POC) Development: Develop POCs to validate and showcase the feasibility and effectiveness of the proposed AI solutions.
 </li>
 <li>
 Help in showcasing the ability of Gen AI code assistant to refactor/rewrite and document code from one language to another
 </li>
 <li>
 Document solution architectures, design decisions, implementation details, and lessons learned.
 </li>
 <li>
 Stay up to date with the latest trends and advancements in AI, foundation models, and large language models.
 </li>
 <li>
 Evaluate emerging technologies, tools, and frameworks to assess their potential impact on solution design and implementation
 
 
 </li>
 </ul>
 
 Preferred Technical And Professional Experience
 
 
 
 <ul>
 <li>
 Experience and working knowledge in COBOL &amp; JAVA would be preferred
 </li>
 <li>
 Having experience in Code generation, code matching &amp; code translation leveraging LLM capabilities would be a Big plus
 </li>
 <li>
 Demonstrate a growth mindset to understand clients' business processes and challenges
 </li>
 </ul>
</div>

Data Scientist-Advanced Analytics

MKS Inc.

<div>
 
 A Day in Your Life at MKS:
 
 
 
 As a
 
 Technical Data Compliance Engineer/Analyst
 
 at MKS Global Capability Center Bangalore, you will partner with R&amp;D teams across MKS PSD Business Units to manage technical data of complex high-precision positioning systems to ensure design documentation in compliance with MKS standards and international regulations.
 
 
 
 You Will Make an Impact By:
 
 
 
 <ul>
 <li>
 Technical data management of electromechanical parts and assemblies, including regular communication with suppliers and R&amp;D teams.
 </li>
 <li>
 Design quality and regulatory compliance (RoHS, REACH, etc.)
 </li>
 <li>
 Manage, generate, and implement ECO documentation changes. ERP system of record data entry and maintenance.
 </li>
 <li>
 CAD/manufacturing drawing review.
 
 
 </li>
 </ul>
 
 Skills You Bring:
 
 
 
 <ul>
 <li>
 3D CAD experience with SolidWorks and/or AutoCAD with fundamental drafting proficiency and knowledge of ANSI Y14.5 GD&amp;T
 </li>
 <li>
 Working knowledge of safety and regulatory compliance for mechanical and electrical hardware
 </li>
 <li>
 Experience with mechanical and electrical hardware designs, product BOMs, and Engineering Change Order process, and new product introduction.
 </li>
 <li>
 Experience with ERP systems and data entry (SAP preferred)
 </li>
 <li>
 Excellent verbal and written communication skills (French speaking preferred)
 
 
 </li>
 </ul>
</div>

Mechanical Engineer Analyst

Straive

<div>
 
 
 About the Role
 
 
 
 Straive is looking for a talented and driven
 
 Consultant / Data Scientist / GenAI Engineer
 
 to join our
 
 Analytics &amp; GenAI delivery team
 
 . In this role, you will work under the guidance of the Senior Project Manager / Engagement Manager to design, develop, and deploy advanced AI/ML and Generative AI solutions for global enterprise clients. You will be part of a high-performing team, collaborating with both onshore and offshore members to build scalable, production-grade AI systems.
 
 
 
 
 
 This role is ideal for candidates from
 
 premier engineering institutes
 
 with
 
 2&ndash;3 years of relevant experience
 
 in Python development, LLM integration, and RAG workflows, along with a passion for solving complex problems in real-world business contexts.
 
 
 
 
 
 
 Key Responsibilities
 
 
 <ul>
 <li>
 Develop and maintain
 
 Python-based
 
 applications, AI/ML models, and data processing pipelines for GenAI projects.
 </li>
 <li>
 Implement
 
 Large Language Model (LLM)
 
 integrations, including
 
 Retrieval-Augmented Generation (RAG)
 
 pipelines and embedding-based search solutions.
 </li>
 <li>
 Build data ingestion and transformation workflows, working with structured and unstructured datasets.
 </li>
 <li>
 Optimize AI model performance through
 
 prompt engineering
 
 , fine-tuning, and evaluation techniques.
 </li>
 <li>
 Collaborate closely with senior team members to translate business requirements into technical solutions.
 </li>
 <li>
 Integrate AI solutions with
 
 vector databases
 
 (e.g., Cosmos DB, Pinecone, ChromaDB) and API-driven applications.
 </li>
 <li>
 (Optional) Contribute to
 
 cloud-native deployments
 
 and
 
 Azure architecture
 
 &ndash;based solutions, including containerization, CI/CD, and basic MLOps workflows.
 </li>
 <li>
 Document workflows, maintain code repositories, and follow Agile development practices.
 </li>
 </ul>
 
 
 
 
 
 Required Qualifications
 
 
 <ul>
 <li>
 
 2&ndash;3 years
 
 of relevant experience in AI/ML development, preferably in enterprise projects.
 </li>
 <li>
 Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Data Science, AI/ML, or related field from a
 
 premier engineering institute
 
 .
 </li>
 <li>
 Proficiency in
 
 Python
 
 programming and familiarity with relevant libraries (e.g., LangChain, Hugging Face, Pandas, NumPy).
 </li>
 <li>
 Hands-on experience implementing
 
 RAG pipelines
 
 , embeddings, and vector search solutions.
 </li>
 <li>
 Understanding of
 
 LLM architectures
 
 and integration patterns.
 </li>
 <li>
 Working knowledge of
 
 SQL
 
 and data processing best practices.
 </li>
 <li>
 Basic knowledge of
 
 cloud DevOps concepts
 
 , preferably with
 
 Azure
 
 (AWS/GCP experience is also acceptable).
 </li>
 </ul>
 
 
 
 
 Preferred Skills
 
 
 <ul>
 <li>
 Exposure to
 
 agentic AI frameworks
 
 such as LangGraph, Semantic Kernel, or similar.
 </li>
 <li>
 Familiarity with ML model lifecycle management and deployment workflows.
 </li>
 <li>
 Prior experience working with cross-border teams and Agile environments.
 </li>
 </ul>
 
 
</div>

Data Scientist

Adobe

<div>
 
 Our Company
 
 
 
 Changing the world through digital experiences is what Adobe&rsquo;s all about. We give everyone&mdash;from emerging artists to global brands&mdash;everything they need to design and deliver exceptional digital experiences! We&rsquo;re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.
 
 
 We&rsquo;re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours!
 
 
 Computer Scientist I &ndash; Adobe Experience Platform
 
 
 Our Company
 
 
 At Adobe, you will be immersed in an exceptional work environment that is recognized around the world. Adobe is listed as Fortune&rsquo;s &ldquo;100 Best Companies to Work For&rdquo; for 20 consecutive years. You will also be surrounded by colleagues who are committed to helping each other grow. If you&rsquo;re looking to make an impact, Adobe's the place for you. Discover what our employees are saying about their career experiences on the Adobe Life blog and explore the meaningful benefits we offer.
 
 
 Changing the world through digital experiences is what Adobe&rsquo;s all about. We give global brands everything they need to design and deliver exceptional digital experiences. We&rsquo;re passionate about redefining how companies interact with customers across every screen.
 
 
 We&rsquo;re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours.
 
 
 The Opportunity
 
 
 Adobe is redefining customer intelligence. We help enterprises understand their customers deeply&mdash;what they value, what they need&mdash;and translate that understanding into meaningful, personalized experiences.
 
 
 The
 
 Adobe Experience Platform (AEP)
 
 is at the heart of this mission, powering data integration, governance, advanced analytics, and intelligent services at global scale. Our next chapter focuses on
 
 agent-driven AI systems
 
 &mdash;autonomous, adaptive agents that orchestrate complex workflows, learn from data, and deliver real-time insights and actions.
 
 
 At the core lies our
 
 Enterprise Knowledge Base
 
 , a foundational platform that unifies structured, unstructured, and semi-structured data. This system fuels advanced AI and Generative AI applications across Adobe&rsquo;s digital marketing ecosystem&mdash;empowering customers to unlock richer, more intelligent experiences.
 
 
 We are looking for someone who thrives on solving hard problems, scaling intelligent systems, and creating measurable impact. You&rsquo;ll lead the design and development of low-latency, high-throughput services that power intelligent enterprise experiences across millions of users worldwide.
 
 
 Job Responsibilities
 
 
 <ul>
 <li>
 Lead the technical design and implementation strategy for major systems and components of AEP Knowledge Base and the Agentic ecosystem.
 </li>
 <li>
 Strong background in distributed storage (Delta Lake, Iceberg), compute (Spark), data warehousing (Snowflake, BigQuery, Redshift) and cloud services (Azure, AWS, GCP).
 </li>
 <li>
 Knowledge of Vector Stores (FAISS, Pinecone, Weaviate, Milvus).
 </li>
 <li>
 Optimize for quality of data, low latency, high reliability and scalability across enterprise environments.
 </li>
 <li>
 Establish best practices for evaluation, safety, and guardrails for system behavior.
 </li>
 <li>
 Collaborate with research and product teams to integrate modern capabilities into the Platform.
 </li>
 <li>
 Mentor engineers and drive technical excellence in building production-grade systems.
 
 
 </li>
 </ul>
 What you will need to succeed
 
 
 <ul>
 <li>
 5+ years in design and development of large scale data intensive distributed systems.
 </li>
 <li>
 In depth work experience on technologies like Apache Spark, Delta Lake, Snowflake, Kubernetes, etc.
 </li>
 <li>
 Hands-on experience with public cloud platforms (Azure, AWS, or GCP).
 </li>
 <li>
 Strong background in relational databases (PostgreSQL, MySQL).
 </li>
 <li>
 Proficiency in Java, Scala, or Python, and a deep understanding of algorithms and data structures.
 </li>
 <li>
 A strong sense of ownership and cost-conscious design for compute and memory efficiency.
 </li>
 <li>
 Excellent communication skills and the ability to collaborate effectively with multi-functional teams.
 </li>
 <li>
 Bachelor&rsquo;s, Master&rsquo;s, or PhD in Computer Science or a related technical field with equivalent experience.
 
 
 </li>
 </ul>
 Why Adobe
 
 
 At Adobe, you&rsquo;ll work in a culture that values creativity, collaboration, and continuous learning. Our
 
 Check-In
 
 approach fosters open feedback, career growth, and shared success.
 
 
 If you&rsquo;re ready to shape the future of AI-powered customer experiences and make a global impact&mdash;
 
 Adobe is the place for you.
 
 
 
 Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more.
 
 
 Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015.
</div>

Computer Scientist-I

<div>
 
 Introduction
 
 
 
 In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
 
 
 
 Your Role And Responsibilities
 
 
 
 <ul>
 <li>
 Work with broader team to build, analyze and improve the AI solutions.
 </li>
 <li>
 You will also work with our software developers in consuming different enterprise applications.
 
 
 </li>
 </ul>
 
 Preferred Education
 
 
 
 Master's Degree
 
 
 
 Required Technical And Professional Expertise
 
 
 
 <ul>
 <li>
 Resource should have 5-7 years of experience. Sound knowledge of Python and should know how to use the ML related services.
 </li>
 <li>
 Proficient in Python with focus on Data Analytics Packages.
 </li>
 <li>
 Strategy Analyse large, complex data sets and provide actionable insights to inform business decisions.
 </li>
 <li>
 Strategy Design and implementing data models that help in identifying patterns and trends. Collaboration Work with data engineers to optimize and maintain data pipelines.
 </li>
 <li>
 Perform quantitative analyses that translate data into actionable insights and provide analytical, data-driven decision-making. Identify and recommend process improvements to enhance the efficiency of the data platform. Develop and maintain data models, algorithms, and statistical models
 
 
 </li>
 </ul>
 
 Preferred Technical And Professional Experience
 
 
 
 <ul>
 <li>
 Experience with conversation analytics. Experience with cloud technologies
 </li>
 <li>
 Experience with data exploration tools such as Tableu
 </li>
 </ul>
</div>

Data Scientist-Artificial Intelligence

Explore 67+ Data engineer in Bangalore this November. Find roles across top companies and apply now to boost your career.