data scientist

associate data scientist Jobs in Bangalore

associate data scientist

data analyst

data business analyst

data engineer (pyspark) Jobs in Bangalore

data engineer (pyspark)

data engineer

Virtusa

<div>
 
 About The Role
 
 
 
 We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that ensure high data quality and availability across the organization. This role requires a strong background in big data ecosystems, cloud-native tools, and advanced data processing techniques.
 
 
 The ideal candidate has hands-on experience with data ingestion, transformation, and optimization on the Cloudera Data Platform, along with a proven track record of implementing data engineering best practices. You will work closely with other data engineers to build solutions that drive impactful business insights.
 
 
 
 Responsibilities
 
 
 
 Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.
 
 
 Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.
 
 
 Data Transformation and Processing: Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements.
 
 
 Performance Optimization: Conduct performance tuning of PySpark code and Cloudera components, optimizing resource utilization and reducing runtime of ETL processes.
 
 
 Data Quality and Validation: Implement data quality checks, monitoring, and validation routines to ensure data accuracy and reliability throughout the pipeline.
 
 
 Automation and Orchestration: Automate data workflows using tools like Apache Oozie, Airflow, or similar orchestration tools within the Cloudera ecosystem.
 
 
 Education and Experience
 
 
 Bachelors or Masters degree in Computer Science, Data Engineering, Information Systems, or a related field.
 
 
 3+ years of experience as a Data Engineer, with a strong focus on PySpark and the Cloudera Data Platform.
 
 
 Technical Skills
 
 
 PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.
 
 
 Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.
 
 
 Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).
 
 
 Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.
 
 
 Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.
 
 
 Scripting and Automation: Strong scripting skills in Linux.
</div>

Data Engineer (Pyspark)

Straive

<div>
 
 
 About the Role
 
 
 
 Straive is looking for a talented and driven
 
 Consultant / Data Scientist / GenAI Engineer
 
 to join our
 
 Analytics &amp; GenAI delivery team
 
 . In this role, you will work under the guidance of the Senior Project Manager / Engagement Manager to design, develop, and deploy advanced AI/ML and Generative AI solutions for global enterprise clients. You will be part of a high-performing team, collaborating with both onshore and offshore members to build scalable, production-grade AI systems.
 
 
 
 
 
 This role is ideal for candidates from
 
 premier engineering institutes
 
 with
 
 2&ndash;3 years of relevant experience
 
 in Python development, LLM integration, and RAG workflows, along with a passion for solving complex problems in real-world business contexts.
 
 
 
 
 
 
 Key Responsibilities
 
 
 <ul>
 <li>
 Develop and maintain
 
 Python-based
 
 applications, AI/ML models, and data processing pipelines for GenAI projects.
 </li>
 <li>
 Implement
 
 Large Language Model (LLM)
 
 integrations, including
 
 Retrieval-Augmented Generation (RAG)
 
 pipelines and embedding-based search solutions.
 </li>
 <li>
 Build data ingestion and transformation workflows, working with structured and unstructured datasets.
 </li>
 <li>
 Optimize AI model performance through
 
 prompt engineering
 
 , fine-tuning, and evaluation techniques.
 </li>
 <li>
 Collaborate closely with senior team members to translate business requirements into technical solutions.
 </li>
 <li>
 Integrate AI solutions with
 
 vector databases
 
 (e.g., Cosmos DB, Pinecone, ChromaDB) and API-driven applications.
 </li>
 <li>
 (Optional) Contribute to
 
 cloud-native deployments
 
 and
 
 Azure architecture
 
 &ndash;based solutions, including containerization, CI/CD, and basic MLOps workflows.
 </li>
 <li>
 Document workflows, maintain code repositories, and follow Agile development practices.
 </li>
 </ul>
 
 
 
 
 
 Required Qualifications
 
 
 <ul>
 <li>
 
 2&ndash;3 years
 
 of relevant experience in AI/ML development, preferably in enterprise projects.
 </li>
 <li>
 Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Data Science, AI/ML, or related field from a
 
 premier engineering institute
 
 .
 </li>
 <li>
 Proficiency in
 
 Python
 
 programming and familiarity with relevant libraries (e.g., LangChain, Hugging Face, Pandas, NumPy).
 </li>
 <li>
 Hands-on experience implementing
 
 RAG pipelines
 
 , embeddings, and vector search solutions.
 </li>
 <li>
 Understanding of
 
 LLM architectures
 
 and integration patterns.
 </li>
 <li>
 Working knowledge of
 
 SQL
 
 and data processing best practices.
 </li>
 <li>
 Basic knowledge of
 
 cloud DevOps concepts
 
 , preferably with
 
 Azure
 
 (AWS/GCP experience is also acceptable).
 </li>
 </ul>
 
 
 
 
 Preferred Skills
 
 
 <ul>
 <li>
 Exposure to
 
 agentic AI frameworks
 
 such as LangGraph, Semantic Kernel, or similar.
 </li>
 <li>
 Familiarity with ML model lifecycle management and deployment workflows.
 </li>
 <li>
 Prior experience working with cross-border teams and Agile environments.
 </li>
 </ul>
 
 
</div>

Data Scientist

Commonwealth Bank

<div>
 
 Organization:
 
 
 
 Commonwealth Bank of Australia (CBA) is the largest bank in Australia with a market cap of almost $125 Billion and presence across New Zealand, Asia, the United States and the United Kingdom.
 
 
 It provides a variety of financial services, including retail, business and institutional banking, funds management, superannuation, insurance, investment, and broking services.
 
 
 
 Job Title:
 
 Data Scientist
 
 
 
 Location:
 
 Bangalore
 
 
 
 Business &amp; Team:
 
 The Chief Operations Office(COO) Data Science team is responsible for leading and the delivery of world-class AI and ML capabilities to support the stakeholders in serving our customers. We focus on developing advanced Machine Learning and Generative AI capabilities at CBA, working closely with business teams and analytics communities across the bank. We use data, ML and AI to enhance the financial wellbeing of our customers and communities, and to improve productivity and reduce risk.
 
 
 
 Impact &amp; contribution:
 
 The Data Scientist will use technical knowledge and understanding of business domain to own, drive and deliver highly complex data science projects independently, or with minimal guidance, including generative AI agentic frameworks.
 
 
 
 Roles &amp; Responsibilities:
 
 
 
 <ul>
 <li>
 Lead and drive AI/ data science projects independently, owning the end-to-end process from data collection, model development to model deployment and monitoring.
 </li>
 <li>
 Apply Gen AI, Computer Vison, NLP, Deep Learning, advanced statistical and ML predictive modelling techniques to develop and implement scalable AI solutions, ensuring accuracy and reliability of models.
 </li>
 <li>
 Design and implement agentic AI systems that operate autonomously in dynamic, real-world environments, including establishing evaluation metrics and mitigating risks associated with autonomous decision-making.
 </li>
 <li>
 Collaborate with business and cross-functional teams to understand their needs and implement AI driven solutions, ensuring adherence to data governance and privacy protocols.
 </li>
 <li>
 Contribute to strategic planning and direction of AI, including understanding and suggesting opportunities for AI solutions to drive greater impact, efficiency, or outcomes.
 </li>
 <li>
 Mentor junior data scientists, provide quality assurance on outputs, and guidance on their projects while fostering a culture of continuous learning and best practices.
 </li>
 <li>
 Develop and deploy production-grade AI/ machine learning models in cloud-based and on-prem platforms.
 </li>
 <li>
 Lead cross-functional teams in the design and execution of AI/ data science projects, ensuring alignment with business objectives.
 </li>
 <li>
 Work in a multidisciplinary squad alongside architects, data engineers, taking technical responsibility across all stages of solution development and applying modular, robust code design principles.
 </li>
 <li>
 Stay abreast of emerging technologies and industry trends, continuously enhancing expertise in AI/ data science methodologies and tools through active learning approaches.
 </li>
 <li>
 Drive innovation by exploring new approaches and techniques for solving complex business problems through data analysis and AI/ ML modelling.
 </li>
 <li>
 Ensure responsible and ethical AI implementation, including establishing guardrails, managing model bias, and adhering to group AI policies and regulatory requirements.
 
 
 </li>
 </ul>
 
 Essential Skills:
 
 
 
 <ul>
 <li>
 More than 5 years of relevant experience.
 </li>
 <li>
 Must have: Hands on experience in AI, Deep Learning, Computer Vision, Advanced GenAI experience incl. LLMs, transformer architectures, and ability to make informed choices between different model types.
 </li>
 <li>
 Must have: Expertise in designing and implementing agentic AI systems that operate autonomously in dynamic environments, including agentic frameworks, evaluation metrics, and risk mitigation strategies.
 </li>
 <li>
 Must have: Advanced proficiency in Python (mandatory), SQL, with demonstrated ability to write well-designed, modular and optimized code following software engineering best practices.
 </li>
 <li>
 Must have: Deep knowledge of AI concepts, terminologies, data management tools, and understanding of data bias and governance protocols.
 </li>
 <li>
 Must have: Experience in responsible and ethical AI implementation, including Responsible AI and adherence to governance policies.
 </li>
 <li>
 Must have: Advanced machine learning expertise including regression, ensemble methods, neural networks, hyperparameter tuning, and model optimisation techniques.
 
 
 </li>
 </ul>
 
 Preferred Skills:
 
 
 
 <ul>
 <li>
 Nice to have: Advanced statistical modelling capabilities including multivariate analysis, time series analysis, experimental design, randomized controlled trials, power analysis, and Bayesian statistics.
 </li>
 <li>
 Nice to have: MLOps experience including model versioning, automated testing, CI/CD pipelines, performance monitoring, and end-to-end model deployment in production environments.
 </li>
 <li>
 Nice to have: Experience with cloud platforms (AWS, Azure) and data platforms, big data frameworks, and distributed computing for large-scale datasets.
 
 
 </li>
 </ul>
 
 Education Qualifications:
 
 
 
 <ul>
 <li>
 Bachelor&rsquo;s degree in Engineering Or Master&rsquo;s degree Or Ph.D. in Data Science, Machine Learning, Computer Science, Computational Linguistics, Statistics, Mathematics, Engineering, Physics.
 
 
 </li>
 </ul>
 If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We&rsquo;re keen to support you with the next step in your career.
 
 
 We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
 
 
 Advertising End Date: 25/09/2025
</div>

Infosys

<div>
 <ul>
 <li>
 Primary skills: Technology-&gt;Business Intelligence - Visualization-&gt;MSBI (Power BI), Technology-&gt;Cloud Integration-&gt;Azure Data Factory (ADF)
 
 
 </li>
 </ul>
 A day in the life of an Infoscion
 
 
 <ul>
 <li>
 As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and facilitate deployment resulting in client delight.
 </li>
 <li>
 You will develop a proposal by owning parts of the proposal document and by giving inputs in solution design based on areas of expertise.
 </li>
 <li>
 You will plan the activities of configuration, configure the product as per the design, conduct conference room pilots and will assist in resolving any queries related to requirements and solution design
 </li>
 <li>
 You will conduct solution/product demonstrations, POC/Proof of Technology workshops and prepare effort estimates which suit the customer budgetary requirements and are in line with organization&rsquo;s financial guidelines
 </li>
 <li>
 Actively lead small projects and contribute to unit-level and organizational initiatives with an objective of providing high quality value adding solutions to customers. If you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you!
 </li>
 <li>
 Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability
 </li>
 <li>
 Good knowledge on software configuration management systems
 </li>
 <li>
 Awareness of latest technologies and Industry trends
 </li>
 <li>
 Logical thinking and problem solving skills along with an ability to collaborate
 </li>
 <li>
 Understanding of the financial processes for various types of projects and the various pricing models available
 </li>
 <li>
 Ability to assess the current processes, identify improvement areas and suggest the technology solutions
 </li>
 <li>
 One or two industry domain knowledge
 </li>
 <li>
 Client Interfacing skills
 </li>
 <li>
 Project and Team management
 </li>
 </ul>
</div>

Power BI & Azure Data Factory Consultant (Mid-Level)

Adobe

<div>
 
 Our Company
 
 
 
 Changing the world through digital experiences is what Adobe&rsquo;s all about. We give everyone&mdash;from emerging artists to global brands&mdash;everything they need to design and deliver exceptional digital experiences! We&rsquo;re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.
 
 
 We&rsquo;re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours!
 
 
 
 Backend Engineer &ndash; ML/AI &amp; Generative AI
 
 
 
 
 About The Role
 
 
 
 We are seeking a highly skilled
 
 Backend Engineer
 
 with a strong foundation in distributed systems and backend development, combined with practical experience in
 
 Machine Learning (ML), Artificial Intelligence (AI), and Generative AI applications
 
 . The ideal candidate will build scalable backend solutions that support AI-powered products, collaborating closely with data scientists and ML engineers to innovate, implement, and improve intelligent systems.
 
 
 
 Key Responsibilities
 
 
 
 <ul>
 <li>
 Design, develop, and maintain scalable backend services and APIs for AI-powered applications.
 </li>
 <li>
 Collaborate with ML/AI researchers and data scientists to productionize models (including LLMs, recommendation systems, and generative models).
 </li>
 <li>
 Implement efficient data pipelines to support training, evaluation, and deployment of models.
 </li>
 <li>
 Optimize inference systems for low-latency, high-throughput environments.
 </li>
 <li>
 Ensure backend systems are secure, resilient, and observable (logging, monitoring, tracing).
 </li>
 <li>
 Evaluate and integrate Generative AI APIs/SDKs (e.g., OpenAI, Anthropic, Hugging Face, etc.) into production systems.
 </li>
 <li>
 Contribute to architecture discussions, system design, and code reviews.
 </li>
 <li>
 Stay updated with emerging trends in GenAI, LLMOps, and backend technologies.
 
 
 </li>
 </ul>
 
 Required Qualifications
 
 
 
 <ul>
 <li>
 Bachelor&rsquo;s/Master&rsquo;s degree in Computer Science, Engineering, or equivalent practical experience.
 </li>
 <li>
 3&ndash;7 years of backend engineering experience (depending on seniority).
 </li>
 <li>
 Strong proficiency in one or more backend languages: Python, Java, Go, or Node.js.
 </li>
 <li>
 Experience with ML/AI frameworks and tooling (TensorFlow, PyTorch, Hugging Face, LangChain, etc.).
 </li>
 <li>
 Proven experience building RESTful APIs, gRPC, or GraphQL services.
 </li>
 <li>
 Solid understanding of databases (SQL and NoSQL), caching, and distributed systems.
 </li>
 <li>
 Hands-on experience deploying models in production (Docker, Kubernetes, cloud ML services).
 </li>
 <li>
 Familiarity with GenAI concepts (prompt engineering, embeddings, vector databases, fine-tuning).
 
 
 </li>
 </ul>
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Exposure to cloud platforms (AWS, GCP, Azure) and serverless technologies.
 </li>
 <li>
 Knowledge of data privacy, compliance, and responsible AI practices.
 </li>
 <li>
 Contributions to open-source ML/AI or GenAI projects.
 
 
 </li>
 </ul>
 Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more.
 
 
 Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015.
</div>

Software Development Engineer

<div>
 <ul>
 <li>
 Should have the hands on experience to train computer vision and deep learning models to solve computer vision use cases.
 </li>
 <li>
 Should be able to create and optimize algorithms for image and video analysis, for tasks such as object detection, image recognition, segmentation and video analytics.
 </li>
 <li>
 Should have expertise on different object tracking algorithms and track multi objects in multi cameras.
 </li>
 <li>
 Should be able to articulate camera calibration and region of interest extraction.
 </li>
 <li>
 Should have experience working on a large-scale implementation with 100+ stream in real time
 </li>
 <li>
 Fine-tune deep learning models like CNNs, vision transformers using frameworks such as Tensorflow, PyTorch, onnx etc.
 </li>
 <li>
 Should have used NVIDIA frameworks preferably like NGC models, TAO toolkit, metropolis Deep stream, triton server, and triton server to create inferencing pipeline and its deployment.
 </li>
 <li>
 Should have knowledge of optimizing inferencing pipelines to work on edge
 </li>
 <li>
 Should be able to perform necessary pre and post processing to optimize the computer vision models and evaluate it.
 </li>
 <li>
 Should have experience working on action recognition with temporal analysis
 </li>
 <li>
 Should have knowledge on pruning the model for deploying on edge/ARM devices
 </li>
 <li>
 Collaborate with Business and IT teams
 </li>
 </ul>
</div>

Pocket FM

<div>
 
 
 Software Development Engineer-Backend
 
 
 
 
 
 
 
 Location
 
 : Bengaluru
 
 
 
 Experience
 
 : 0&ndash;2 years
 
 
 
 
 
 
 About Pocket FM
 
 
 
 Pocket FM is India's leading audio streaming platform with a mission to redefine the way stories are consumed. We are building a personalized entertainment experience for the next billion users through a robust tech platform powered by data, intelligence, and audio innovation. Join us on our journey to scale storytelling to millions, one stream at a time.
 
 
 
 
 
 
 Role Overview
 
 
 
 We are looking for a motivated and curious
 
 SDE-1
 
 to join our fast-paced engineering team. You will play a key role in building scalable backend services and APIs that power our audio platform. If you are passionate about backend development and have hands-on experience with
 
 Python or Golang
 
 , we&rsquo;d love to connect with you.
 
 
 
 
 
 
 Responsibilities
 
 
 <ul>
 <li>
 Build and maintain highly scalable backend systems using
 
 Python or Golang
 
 </li>
 <li>
 Develop RESTful APIs and services for Pocket FM&rsquo;s core platform
 </li>
 <li>
 Work closely with product, design, and data teams to deliver seamless user experiences
 </li>
 <li>
 Optimize application performance and write clean, maintainable code
 </li>
 <li>
 Participate in code reviews, learning sessions, and continuous improvement initiatives
 </li>
 <li>
 Troubleshoot and debug production issues as part of a collaborative team
 </li>
 </ul>
 
 
 Requirements
 
 
 <ul>
 <li>
 Bachelor's degree in Computer Science, Engineering, or a related field
 </li>
 <li>
 0&ndash;2 years of backend development experience in
 
 Python or Golang
 
 </li>
 <li>
 Strong understanding of computer science fundamentals (DSA, OOP, OS, networking)
 </li>
 <li>
 Familiarity with REST API development and version control (Git)
 </li>
 <li>
 Working knowledge of databases (e.g., PostgreSQL, MongoDB, Redis)
 </li>
 <li>
 Ability to write modular, reusable, and testable code
 </li>
 <li>
 Good communication skills and a proactive attitude
 </li>
 </ul>
 
 
 Nice to Have
 
 
 <ul>
 <li>
 Exposure to cloud platforms like AWS, GCP, or Azure
 </li>
 <li>
 Experience with container technologies like Docker
 </li>
 <li>
 Familiarity with monitoring, logging, or CI/CD tools
 </li>
 <li>
 Contributions to open-source projects or personal backend projects
 </li>
 </ul>
 
 
</div>

Software development Engineer - Backend

Explore 54+ Data engineer in Bangalore this September. Find roles across top companies and apply now to boost your career.

54 data engineer jobs IN Bangalore

Data Engineer (Pyspark)

Data Scientist

Data Scientist

Power BI & Azure Data Factory Consultant (Mid-Level)

Software Development Engineer

Data Scientist

Software development Engineer - Backend