software engineer

data analyst

data scientist

ai engineer

associate lead data scientist Jobs in Mangaluru

associate lead data scientist

data engineer

Weekday AI (YC W21)

<div>
 
 This role is for one of the Weekday's clients
 
 
 
 
 Salary range: Rs 3000000 - Rs 4000000 (ie INR 30-40 LPA)
 
 
 
 Min Experience: 5 years
 
 
 Location: Bengaluru
 
 
 JobType: full-timeWe are seeking an experienced
 
 Data Engineer
 
 to design, build, and maintain robust data pipelines and architectures that power analytics, interoperability, and data-driven decision-making across our healthcare ecosystem. The ideal candidate will have a strong background in
 
 Azure data services
 
 ,
 
 ETL development
 
 ,
 
 Databricks
 
 , and hands-on experience with
 
 FHIR (Fast Healthcare Interoperability Resources)
 
 standards. This role requires a mix of technical proficiency, problem-solving ability, and a deep understanding of healthcare data integration.
 
 
 
 Requirements
 
 
 
 
 
 Key Responsibilities
 
 
 
 
 <ul>
 <li>
 Data Pipeline Development: Design, develop, and optimize scalable ETL/ELT workflows to extract, transform, and load structured and unstructured healthcare data into Azure-based data platforms (e.g., Azure Data Lake, Azure Synapse, Databricks).
 </li>
 <li>
 FHIR Data Integration: Implement and manage FHIR-based data models and APIs for healthcare data interoperability. Ensure compliance with healthcare data standards and regulatory frameworks.
 </li>
 <li>
 Data Architecture &amp; Modeling: Develop logical and physical data models to support data warehousing, reporting, and analytics needs. Ensure data accuracy, integrity, and security across all stages of the data lifecycle.
 </li>
 <li>
 Databricks Development: Build and manage scalable data processing solutions using Azure Databricks. Optimize performance of large-scale data transformations using PySpark, SQL, or Scala.
 </li>
 <li>
 Data Quality &amp; Governance: Establish and maintain data quality frameworks, validation processes, and governance standards. Ensure consistent and compliant data handling across systems.
 </li>
 <li>
 Collaboration &amp; Stakeholder Management: Partner with data scientists, analysts, architects, and business teams to deliver reliable and accessible data assets. Translate business requirements into technical solutions.
 </li>
 <li>
 Performance Optimization: Monitor, troubleshoot, and enhance data pipelines for performance, scalability, and cost efficiency in the Azure environment.
 </li>
 <li>
 Documentation &amp; Best Practices: Maintain detailed documentation of architecture, data flows, and processes. Contribute to continuous improvement by implementing data engineering best practices and automation.
 
 
 </li>
 </ul>
 
 Required Skills &amp; Qualifications
 
 
 
 <li>
 Education: Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
 </li>
 <li>
 Technical Skills:
 </li>
 <ul>
 <li>
 Strong expertise in Azure Data Services - Azure Data Factory, Azure Synapse, Azure Data Lake, and Azure SQL.
 </li>
 <li>
 Hands-on experience with Databricks for data processing, transformation, and analytics.
 </li>
 <li>
 Proven ability to design and maintain ETL/ELT pipelines using modern data engineering tools and frameworks.
 </li>
 <li>
 Proficiency in SQL, Python, or Scala for data manipulation and automation.
 </li>
 <li>
 Solid understanding of FHIR standards, data schemas, and API integration for healthcare data exchange.
 </li>
 <li>
 Experience with data modeling, metadata management, and data governance frameworks.
 </li>
 <li>
 Familiarity with CI/CD, Git, and DevOps practices in data engineering environments.
 </li>
 <li>
 Experience: 5-10 years of professional experience in data engineering, with at least 2 years of exposure to healthcare or interoperability projects leveraging FHIR.
 </li>
 <li>
 Soft Skills:
 </li>
 <ul>
 <li>
 Strong analytical and problem-solving abilities.
 </li>
 <li>
 Excellent communication and collaboration skills.
 </li>
 <li>
 Ability to work in a fast-paced, agile environment with cross-functional teams.
 
 
 </li>
 </ul>
 </ul>
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Experience with HL7, CDA, or other healthcare interoperability standards.
 </li>
 <li>
 Exposure to machine learning data pipelines or advanced analytics environments.
 </li>
 <li>
 Azure certifications (e.g., Azure Data Engineer Associate) are a plus
 </li>
 </ul>
</div>

Data Engineer

Volvo Cars

<div>
 
 Software, the fuel for mobility
 
 
 
 We bring bold digital visions to life. So we&rsquo;re on the lookout for more curious and creative engineers who want to create change &ndash; one line of high-quality code at a time. Our transformation isn't for everyone, but if you're excited about solving the leading-edge technological challenges facing the auto industry, then let&rsquo;s talk about your next move.
 
 
 Let's introduce ourselves
 
 
 At Volvo Cars, we are making bold digital visions come true. We aim to be the leader in the automotive world by creating a digital ecosystem built around making our customers' lives less complicated. What we all have in common at Volvo Cars is our passion for protecting lives, our endless curiosity and our dedication to create a new future for the automotive industry. Our human centric focus is what separates us from all other car companies.
 
 
 
 What You'll Do
 
 
 
 This role is part of Data and Analytics team which provides competence to Products Areas, Clusters and Teams to succeed in delivering business value by turning data into Insights. Expected to Utilize standards and best practices to enable Business areas to accelerate their value journey through Self-Service data &amp; analytics, and to accomplish &ldquo;insights at the fingertips&rdquo; for Volvo Car Group. Provides opportunity to mentor developers to build quality products, contribute to multiple domains and be part of technology selection/solution architecture.
 
 
 
 Main Responsibilities
 
 
 
 Act as Technology expert to build quality data products with willingness to self-learning and long-term commitment. Interact with Product teams, architects, and platform experts to deliver user stories on timely basis with world class quality.
 
 
 
 What You'll Bring
 
 
 
 
 Experience and Education
 
 
 
 <ul>
 <li>
 Educational Background: bachelor&rsquo;s or master&rsquo;s degree in computer science, or related field.
 </li>
 <li>
 Professional Experience: 5 years+ in data engineering or related field, handling large-scale data systems.
 
 
 </li>
 </ul>
 
 Analytical Skills
 
 
 
 <ul>
 <li>
 Data Warehousing: Experienced in building and maintaining data warehouses and data lakes.
 </li>
 <li>
 Data Modeling: Understanding of dimensional modeling techniques and ability to apply them in data transformation tasks.
 </li>
 <li>
 ELT Processes: Skilled in creating and managing ELT pipelines.
 </li>
 <li>
 Master Data Management (MDM): Working knowledge of master data management concepts and tools such as Semarchy XDM, with a focus on learning how to ensure data consistency and quality across systems.
 
 
 </li>
 </ul>
 
 Adaptability and Continuous Learning
 
 
 
 <ul>
 <li>
 Staying Updated: Keeps abreast of latest trends and technologies in data engineering.
 </li>
 <li>
 Embracing Change: Open to adopting new tools and methodologies.
 </li>
 <li>
 Continuous Improvement: Seeks opportunities to improve processes and systems.
 
 
 </li>
 </ul>
 
 Primary Technology Skills
 
 
 
 <ul>
 <li>
 Solid understanding of SQL programming with ability to write queries and troubleshoot data issues.
 </li>
 <li>
 Exposure to designing and managing ELT processes using dbt and Snowflake for data transformation.
 </li>
 <li>
 Basic knowledge of dimensional modeling and data modeling principles.
 </li>
 <li>
 Experience working with Snowflake as a cloud data warehouse for analytics and reporting.
 </li>
 <li>
 Familiarity with Microsoft Azure cloud services for data storage and processing.
 </li>
 <li>
 Exposure to Semarchy XDM or other MDM tools for managing master data and ensuring data quality.
 </li>
 <li>
 Understanding data governance concepts and willingness to learn data quality practices.
 </li>
 <li>
 Experience working in Agile environments such as SAFe.
 </li>
 <li>
 Exposure to Redpanda for streaming data integration and basic understanding of Benthos configuration for templated ingestion pipelines.
 </li>
 <li>
 Familiarity with Apache Airflow for orchestrating data workflows.
 
 
 </li>
 </ul>
 
 Secondary Technology Skills
 
 
 
 <ul>
 <li>
 Basic proficiency in Python for scripting and automation tasks.
 </li>
 <li>
 participate in peer reviews and collaborate with senior engineers.
 </li>
 <li>
 Exposure to API integration for data consumption.
 </li>
 <li>
 Experience or interest in building dashboards using Power BI.
 
 
 </li>
 </ul>
 
 Volvo Cars. For Life.
 
 
 
 For nearly a century, Volvo Cars has empowered people to move freely in a personal, sustainable and safe way. Today, we are driving bold advancements in electrification, sustainability and automotive safety. To realise our ambitious vision, we are seeking innovative minds who are ready to tackle the challenges of tomorrow &ndash; today.
 
 
 In our company, we believe extraordinary things are achieved by ordinary people with the drive to make a difference.
</div>

Deloitte

<div>
 
 
 Your potential, unleashed.
 
 
 
 India&rsquo;s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond.
 
 
 At Deloitte, your whole self to work, every day. Combine that with our drive to propel with purpose and you have the perfect playground to collaborate, innovate, grow, and make an impact that matters.
 
 
 
 
 
 
 The Team
 
 
 
 Deloitte&rsquo;s Technology &amp; Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence &amp; visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.
 
 
 
 
 
 
 Work you&rsquo;ll do
 
 
 
 Total Experience - 7 to 11 Years
 
 
 Relevant Experience - 5+
 
 
 Location - Bangalore
 
 
 
 
 
 
 Roles and Responsibilities:
 
 
 
 The Data Engineer will work on data engineering projects for various business units, focusing on delivery of complex data management solutions by leveraging industry best practices. They work with the project team to build the most efficient data pipelines and data management solutions that make data easily available for consuming applications and analytical solutions. A Data engineer is expected to possess strong technical skills.
 
 
 
 
 
 
 Experience: -
 
 
 <ul>
 <li>
 Knowledge of and skills in various programming languages primarily Python
 </li>
 <li>
 Must have knowledge on Back-end frameworks, Pandas, Numpy, Matplotlib/Seaborn
 </li>
 <li>
 Thorough understanding of containers and functions. Deployment experience with Kubernetes (K8s) or Functions is highly desirable.
 </li>
 <li>
 Experience using Cloud Native CI/CD tools (Azure Pipelines/Circle CI/Jenkins X).
 </li>
 <li>
 Experience deploying workloads to AWS or Azure with strong knowledge and understanding of the cloud provider's API / associated services and infrastructure
 </li>
 <li>
 Experience in test driven development &amp; writing of unit and integration tests is a must
 </li>
 <li>
 Knowledge of other Cloud (Google Cloud Platform, Cloudera etc), and Integration services technologies is highly desirable.
 </li>
 <li>
 Experience working in agile teams with demonstrated application of the principles.
 </li>
 <li>
 Demonstrable proficiency in developing complex JavaScript applications.
 </li>
 <li>
 Experience of working with lean startup/agile development methodologies
 </li>
 <li>
 Strong analytical, problem-solving, and troubleshooting skills.
 </li>
 <li>
 Experienced with modern coding, testing, debugging and automation techniques.
 </li>
 <li>
 Rave about the benefits of CI/CD
 </li>
 <li>
 Have a high bar for user experience and quality.
 </li>
 <li>
 You are data driven and customer obsessed.
 </li>
 <li>
 Good communication skills.
 </li>
 </ul>
 
 
 
 
 
 Key Characteristics
 
 
 <ul>
 <li>
 Availability to solve production issues/taking ownership of interfaces deployed on prod etc
 </li>
 <li>
 Understanding in RDBMS and NoSQL databases (e.g., PostgreSQL, MongoDB).
 </li>
 <li>
 Ability to troubleshoot and resolve database issues.
 </li>
 <li>
 In-depth knowledge and experience in RESTful API interfaces.
 </li>
 <li>
 Comprehensive understanding of ETL processes from end-to-end.
 </li>
 <li>
 Technology champion who constantly pursues skill enhancement and has inherent curiosity to understand work from multiple dimensions.
 </li>
 <li>
 Interest and passion in Big Data technologies and appreciates the value that can be brought in with an effective data management solution.
 </li>
 <li>
 Has worked on real data challenges and handled high volume, velocity, and variety of data.
 </li>
 <li>
 Is proficient in designing data integrations and data processes across different types of architecture patterns using native cloud services, or custom application codes
 </li>
 <li>
 Excellent analytical &amp; problem-solving skills, willingness to take ownership and resolve technical challenges.
 </li>
 <li>
 Contributes to community building initiatives like CoE, CoP.
 </li>
 </ul>
 
 
 
 
 
 
 
 
 Mandatory Skills
 
 
 <ul>
 <li>
 Programming Languages: Proficiency in Python and PySpark is paramount. Should have knowledge of data processing using Pandas, Numpy and relevant libraries to handle data.
 </li>
 <li>
 Databases: Strong knowledge of SQL and NoSQL databases
 </li>
 <li>
 Big Data Technologies: Experience with frameworks like Apache Spark, Hadoop, and Kafka for processing large datasets
 </li>
 <li>
 Cloud Computing: Familiarity with cloud platforms like Azure(preferred)/AWS(good to have) and their data services (e.g., Data Factory, Databricks, Synapse, Redshift)
 </li>
 <li>
 ETL/ELT &amp; Data Warehousing: Expertise in designing and implementing ETL (Extract, Transform, Load) processes, and data modelling for efficient data warehousing
 </li>
 <li>
 Data Pipelines: Ability to develop, optimize, and maintain robust and scalable data pipelines
 </li>
 <li>
 Should have a good understanding of optimization techniques and able to resolve performance bottlenecks
 </li>
 <li>
 Knowledge of web frameworks and API is beneficial
 </li>
 </ul>
 
 
 
 
 
 How you&rsquo;ll grow
 
 
 
 At Deloitte, our professional development plan focuses on helping people at every level of their career to identify and use their strengths to do their best work every day. From entry-level employees to senior leaders, we believe there&rsquo;s always room to learn. We offer opportunities to help build world-class skills in addition to hands-on experience in the global, fast-changing business world. From on-the-job learning experiences to formal development
 
 
 Programs at Deloitte University, our professionals have a variety of opportunities to continue to grow throughout their career. Explore Deloitte University, The Leadership Centre.
 
 
 
 
 
 
 Benefits
 
 
 
 At Deloitte, we know that great people make a great organization. We value our people and offer employees a broad range of benefits. Learn more about what working at Deloitte can mean for you.
 
 
 
 
 
 
 Our purpose
 
 
 
 Deloitte is led by a purpose:
 
 To make an impact that matters
 
 .
 
 
 Every day, Deloitte people are making a real impact in the places they live and work. We pride ourselves on doing not only what is good for clients, but also what is good for our people and the communities in which we live and work&mdash;always striving to be an organization that is held up as a role model of quality, integrity, and positive change. Learn more about Deloitte's impact on the world
 
 
 
 
 
 
 Interview tips
 
 
 
 We want job seekers exploring opportunities at Deloitte to feel prepared and confident. To help you with your interview, we suggest that you do your research: know some background about the organization and the business area you&rsquo;re applying to. Check out recruiting tips from Deloitte professionals.
 
</div>

Python Data Engineer

Data Engineer, Product Analytics

Takeda

<div>
 By clicking the &ldquo;Apply&rdquo; button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda&rsquo;s Privacy Notice and Terms of Use. I further attest that all information I submit in my employment application is true to the best of my knowledge.
 
 
 
 Job Description:
 
 
 
 
 The Future Begins Here:
 
 
 
 At Takeda, we are leading digital evolution and global transformation. By building innovative solutions and future-ready capabilities, we are meeting the need of patients, our people, and the planet.
 
 
 Bengaluru, the city, which is India&rsquo;s epicenter of Innovation, has been selected to be home to Takeda&rsquo;s recently launched Innovation Capability Center. We invite you to join our digital transformation journey. In this role, you will have the opportunity to boost your skills and become the heart of an innovative engine that is contributing to global impact and improvement.
 
 
 
 At Takeda&rsquo;s ICC we Unite in Diversity:
 
 
 
 Takeda is committed to creating an inclusive and collaborative workplace, where individuals are recognized for their backgrounds and abilities they bring to our company. We are continuously improving our collaborators journey in Takeda, and we welcome applications from all qualified candidates. Here, you will feel welcomed, respected, and valued as an important contributor to our diverse team
 
 
 
 About the role :
 
 
 
 As a Data Engineer, you will play an important role in supporting the design and implementation of data infrastructure and flow systems at Takeda. We are seeking an innovative and excited individual to aid in data collection and processing, allowing all business stakeholders to have access to data insights. In your role, you will collaborate closely with Data Engineer team members to help develop and maintain a robust data infrastructure, streamlining informed decision-making within Takeda. Your contributions will be integral to enhancing Takeda&rsquo;s dashboards and reporting, providing actionable insights to stakeholders throughout the business.
 
 
 In this role, you will be a part of ICC PDT Digital Analytics team. This team drives business insights to analyse and interpret the organization&rsquo;s data with the purpose of drawing conclusions about information and trends. This role will work closely with the Senior Data Engineers on executing complex tasks. This role will also align to the Data &amp; Analytics chapter of the ICC as a competency.
 
 
 This position will report to the Data Engineer lead for direction and Day-to-day management.
 
 
 
 How you will contribute :
 
 
 
 <ul>
 <li>
 Support the development and maintenance of data architecture and pipelines.
 </li>
 <li>
 Support the standardization, customization, and ad hoc data analysis by developing mechanisms that analyze and clean data.
 </li>
 <li>
 Utilize AWS technologies to build new integrations for increased data source, volume, and complexity.
 </li>
 <li>
 Outline data requirements for gathering and mining large-scale data.
 </li>
 <li>
 Support the implementation processes that drive data reconciliation and quality, ensuring production data is always accurate and available for key stakeholders, downstream systems, and business processes.
 </li>
 <li>
 Participate in the evaluation, implementation, and deployment of emerging tools for analytic data engineering to improve productivity.
 </li>
 <li>
 Coordinate with Senior Data Engineers to write unit, integration, and performance test scripts that perform data analysis.
 </li>
 <li>
 Support Business Analytics and Solution Architects to develop technical architectures for strategic enterprise projects and initiatives.
 </li>
 <li>
 Collaborate with Senior Data Engineers and Data Scientists to understand data requirements, and design solutions that enable advanced analytics, machine learning, and predictive modelling.
 
 
 </li>
 </ul>
 
 Minimum Requirements/Qualifications :
 
 
 
 <ul>
 <li>
 Bachelor&rsquo;s Degree in Engineering, Computer Science, Data Science, or related field.
 </li>
 <li>
 3-5 year of experience in software development, data science, data engineering, ETL, and analytics reporting development
 </li>
 <li>
 Knowledge of designing, building, implementing, and maintaining data and system integrations, understand software being leveraged
 </li>
 <li>
 Demonstrated understanding and experience using
 </li>
 <ul>
 <li>
 Data Engineering Programming Languages (i.e., Python, SQL)
 </li>
 <li>
 Distributed Data Framework (e.g., Spark)
 </li>
 <li>
 Cloud platform services (AWS/ Azure preferred)
 </li>
 <li>
 Relational Databases (Postgres/ SQL server)
 </li>
 <li>
 DevOps and continuous integration
 </li>
 <li>
 AWS knowledge on services like Lambda, DMS, Step Functions, S3, Event Bridge, Cloud Watch, Aurora RDS or related AWS ETL services
 </li>
 <li>
 Knowledge of Data lakes, Data warehouses
 </li>
 <li>
 Databricks/Delta Lakehouse architecture
 </li>
 <li>
 Code management platforms like Github/ Gitlab/ etc.,
 </li>
 <li>
 Job orchestration tools like Tidal/ Airflow
 </li>
 </ul>
 <li>
 Understanding of database architecture and administration
 </li>
 <li>
 Knowledge of the principles of continuous integration and delivery to automate the deployment of code changes to elevate environments, fostering enhanced code quality, test coverage, and automation of resilient test cases
 </li>
 <li>
 Proficient written and verbal communication skills, including storytelling and interacting effectively with multifunctional teams and other strategic partners
 </li>
 <li>
 Willingness to learn and collaborate with Senior and Mid-Level Data Engineers
 </li>
 <li>
 Strong problem solving and attention to detail skills
 </li>
 <li>
 Ability to work in a fast-paced environment
 
 </li>
 </ul>
 
 Preferred skillsets:
 
 
 
 <ul>
 <li>
 Experience working in a global environment
 </li>
 <li>
 Ability to support Senior Data Engineers in designing and implementing complex data solutions
 </li>
 <li>
 Demonstrated understanding and experience using
 </li>
 <ul>
 <li>
 Knowledge in CDK
 </li>
 <li>
 Experience in IICS Data Integration tool
 </li>
 <li>
 Job orchestration tools like Tidal/Airflow/ or similar
 </li>
 <li>
 Knowledge on No SQL
 </li>
 </ul>
 <li>
 Proficiency in leveraging the Databricks Unity Catalog for effective data governance and implementing robust access control mechanisms is highly advantageous.
 </li>
 <li>
 Databricks Certified Data Engineer Associate and/or AWS Certified Data Engineer
 
 </li>
 </ul>
 
 BENEFITS:
 
 
 
 It is our priority to provide competitive compensation and a benefit package that bridges your personal life with your professional career. Amongst our benefits are
 
 
 <ul>
 <li>
 Competitive Salary + Performance Annual Bonus
 </li>
 <li>
 Flexible work environment, including hybrid working
 </li>
 <li>
 Comprehensive Healthcare Insurance Plans for self, spouse, and children
 </li>
 <li>
 Group Term Life Insurance and Group Accident Insurance programs
 </li>
 <li>
 Employee Assistance Program
 </li>
 <li>
 Broad Variety of learning platforms
 </li>
 <li>
 Diversity, Equity, and Inclusion Programs
 </li>
 <li>
 Reimbursements &ndash; Home Internet &amp; Mobile Phone
 </li>
 <li>
 Employee Referral Program
 </li>
 <li>
 Leaves &ndash; Paternity Leave (4 Weeks) , Maternity Leave (up to 26 weeks), Bereavement Leave (5 calendar days)
 
 
 </li>
 </ul>
 
 ABOUT ICC IN TAKEDA:
 
 
 
 <ul>
 <li>
 Takeda is leading a digital revolution. We&rsquo;re not just transforming our company; we&rsquo;re improving the lives of millions of patients who rely on our medicines every day.
 </li>
 <li>
 As an organization, we are committed to our cloud-driven business transformation and believe the ICCs are the catalysts of change for our global organization.
 
 
 </li>
 </ul>
 
 Locations:
 
 
 
 IND - Bengaluru
 
 
 
 Worker Type:
 
 
 
 Employee
 
 
 
 Worker Sub-Type:
 
 
 
 Regular
 
 
 
 Time Type:
 
 
 
 Full time
 
 
</div>

Data Engineer for Data & Analytics

Cognizant

<div>
 
 
 
 Note:
 
 
 
 Please apply only if you're available for
 
 
 
 walk-In interview
 
 
 
 on
 
 
 
 22nd November
 
 
 
 at
 
 
 
 Bangalore office (Manyata Tech park)
 
 
 
 
 
 
 
 
 Job Title:
 
 Data Engineer
 
 (PySpark + Databricks)
 
 
 
 
 
 
 
 Location:
 
 [Insert Location]
 
 
 
 Employment Type:
 
 Full-time
 
 
 
 Experience Level:
 
 4-12 years (adjust as needed)
 
 
 
 Role Overview
 
 
 
 We are seeking a skilled
 
 Data Engineer
 
 with strong experience in
 
 PySpark
 
 and
 
 Databricks
 
 to design, develop, and optimize large-scale data pipelines and solutions. The ideal candidate will work closely with data architects, analysts, and business stakeholders to ensure efficient data processing and integration across platforms.
 
 
 
 Key Responsibilities
 
 
 <ul>
 <li>
 Design and implement scalable
 
 ETL pipelines
 
 using
 
 PySpark
 
 on
 
 Databricks
 
 .
 </li>
 <li>
 Develop and maintain data workflows for structured and unstructured data.
 </li>
 <li>
 Optimize Spark jobs for performance and cost efficiency.
 </li>
 <li>
 Collaborate with cross-functional teams to integrate data from multiple sources.
 </li>
 <li>
 Ensure data quality, security, and compliance with organizational standards.
 </li>
 <li>
 Work with
 
 cloud platforms
 
 (Azure/AWS/GCP) for data storage and processing.
 </li>
 <li>
 Troubleshoot and resolve issues in data pipelines and workflows.
 </li>
 </ul>
 
 
 Required Skills
 
 
 <ul>
 <li>
 Strong proficiency in
 
 PySpark
 
 and
 
 Databricks
 
 .
 </li>
 <li>
 Hands-on experience with
 
 Spark SQL
 
 ,
 
 Delta Lake
 
 , and
 
 data lake architectures
 
 .
 </li>
 <li>
 Knowledge of
 
 cloud services
 
 (Azure Data Lake, AWS S3, or GCP equivalent).
 </li>
 <li>
 Familiarity with
 
 CI/CD pipelines
 
 and version control (Git).
 </li>
 <li>
 Experience with
 
 performance tuning
 
 in Spark environments.
 </li>
 <li>
 Good understanding of
 
 data modeling
 
 and
 
 data warehousing concepts
 
 .
 </li>
 </ul>
 
 
 Preferred Skills
 
 
 <ul>
 <li>
 Experience with
 
 Airflow
 
 ,
 
 Azure Data Factory
 
 , or similar orchestration tools.
 </li>
 <li>
 Knowledge of
 
 Python
 
 ,
 
 SQL
 
 , and
 
 REST APIs
 
 .
 </li>
 <li>
 Exposure to
 
 machine learning workflows
 
 on Databricks is a plus.
 </li>
 </ul>
 
 
 Education
 
 
 <ul>
 <li>
 Bachelor&rsquo;s or master&rsquo;s degree in computer science, Information Technology, or related field.
 </li>
 </ul>
 
 
</div>

Software Engineer

Oracle

<div>
 
 Job Description
 
 
 
 At Oracle Health, we put humans at the heart of every conversation. Our mission is to create a human-centric healthcare experience powered by unified global data. As a global leader we&rsquo;re looking for a Data Engineer with BI to join an exciting project for replacing existing Data warehouse systems with the Oracle's own data warehouse to manage storage of all the internal corporate data to provide insights that will help our teams to make critical business decisions Join us and create the future!
 
 
 
 Responsibilities
 
 
 
 Career Level - IC3
 
 
 Roles and Responsibilities
 
 
 <ul>
 <li>
 Proficient in writing and optimising SQL queries for data extraction
 </li>
 <li>
 Translate client requirements to technical design that junior team members can implement
 </li>
 <li>
 Developing the code that aligns with the technical design and coding standards
 </li>
 <li>
 Review design and code implemented by other team members. Recommend better design and efficient code
 </li>
 <li>
 Conduct Peer design and Code Reviews for early detection of defects and code quality
 </li>
 <li>
 Documenting ETL processes and data flow diagrams
 </li>
 <li>
 Optimizing data extraction and transformation processes for better performance
 </li>
 <li>
 Performing data quality checks and debugging issues
 </li>
 <li>
 Conducting root cause analysis for data issues and implementing fixes
 </li>
 <li>
 Collaborating with more experienced developers on larger projects, collaborate with stakeholders on the requirements
 </li>
 <li>
 Participate in the requirements, design and implementation discussions
 </li>
 <li>
 Participating in learning and development opportunities to enhance technical skills
 </li>
 <li>
 Test storage system after transferring the data
 </li>
 <li>
 Exposures to Business Intelligence platforms like OAC, Power BI or Tableau
 
 
 
 </li>
 </ul>
 Technical Skills Set :
 
 
 <ul>
 <li>
 You must be strong in PLSQL concepts such as tables, keys, DDL, DML commands, etc.
 </li>
 <li>
 You need be proficient in writing, debugging complex SQL queries, Views and Stored Procedures.
 </li>
 <li>
 Strong hands on in Python / PySpark programming
 </li>
 <li>
 As a Data Engineer, you must be strong in data modelling, ETL / ELT concepts, programming / scripting Python language,
 </li>
 <li>
 You must be proficient in the following ETL process automation tools
 
 
 
 </li>
 </ul>
 &ensp;&ensp;&ensp;&ensp;&ensp;&ensp;
 
 
 <ul>
 <li>
 Oracle Data Integrator (ODI)
 
 
 
 </li>
 </ul>
 &ensp;&ensp;&ensp;&ensp;&ensp;&ensp;
 
 
 <ul>
 <li>
 Oracle Data Flow
 
 
 
 </li>
 </ul>
 &ensp;&ensp;&ensp;&ensp;&ensp;&ensp;
 
 
 <ul>
 <li>
 Oracle Database / Autonomous Data warehouse
 </li>
 <li>
 Should possess working knowledge in any of the cloud platform like Oracle Cloud (Preferred), Microsoft Azure, AWS
 </li>
 <li>
 You must be able to create technical design, build prototypes, build and maintain high performing data pipelines, optimise ETL pipelines
 </li>
 <li>
 Good knowledge on Business Intelligence development tools like OAC, PowerBI
 </li>
 <li>
 Good to have Microsoft ADF and Data Lakes, Databricks
 
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 Career Level - IC3
 
 
 
 About Us
 
 
 
 As a world leader in cloud solutions, Oracle uses tomorrow&rsquo;s technology to tackle today&rsquo;s challenges. We&rsquo;ve partnered with industry-leaders in almost every sector&mdash;and continue to thrive after 40+ years of change by operating with integrity.
 
 
 We know that true innovation starts when everyone is empowered to contribute. That&rsquo;s why we&rsquo;re committed to growing an inclusive workforce that promotes opportunities for all.
 
 
 Oracle careers open the door to global opportunities where work-life balance flourishes. We offer competitive benefits based on parity and consistency and support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.
 
 
 We&rsquo;re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing accommodation-request_mb@oracle.com or by calling +1 888 404 2494 in the United States.
 
 
 Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans&rsquo; status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.
</div>

Software Developer 3

Explore 327+ Data engineer in Mangaluru this November. Find roles across top companies and apply now to boost your career.

327 data engineer jobs IN Mangaluru

Data Engineer

Data Engineer

Python Data Engineer

Data Engineer, Product Analytics

Data Engineer for Data & Analytics

Software Engineer

Software Developer 3