data analyst

data engineer

production engineer

associate engineer

data management -senior data engineer Jobs in Mangaluru

data management -senior data engineer

database engineer

Microsoft

<div>
 
 Overview
 
 
 
 
 Overview:
 
 
 
 Do you want to join a world-class engineering team in India and work on hard technical challenges? Are you interested to work in a globally distributed team with an exceptional record of innovation and execution that has made us one of the largest businesses within Microsoft? If yes, keep reading&hellip;
 
 
 Azure SQL Database is a fast-growing platform as a service that is attracting application developers and enterprise workloads to the cloud. Our team is responsible for mission critical functions such as point in time restore, default disaster recovery and long-term retention for millions of databases. This is a great opportunity to learn and work on the internals of enterprise class relational database engines, solve hard problems and build a highly-scalable and reliable data service. You will be working in an environment where innovation is valued and will have an opportunity for direct impact on functionality, scalability, security, performance, manageability and supportability of the Azure SQL Database service. We need collaborative developers who can think big and find creative ways to meet these challenges. Come join us in the Azure Data SQL India team!
 
 
 Azure SQL Platform is guided by a visionary and transformative mission to revolutionize cloud database management and deliver the platform, service, and features, for running the world&rsquo;s most critical workloads for millions of customers worldwide. We are looking for a Software Engineer with strong engineering skills to join the team. You will have an opportunity to shape and build the next generation of SQL platform designed for 100x customer and request volume.
 
 
 
 Responsibilities
 
 
 
 <ul>
 <li>
 Design, implement and maintain services and components that provide secure and resilient platform for SQL control plane and data plane services.
 </li>
 <li>
 Develop innovative technology for managing massive-scale operations for large customers tolerating underlying system failures, software and hardware upgrades and reconfiguration, while enabling optimal placement and utilization of Azure clusters and regions.
 </li>
 <li>
 Design and implement solutions for cluster expansions at a global scale, analyze telemetry and the behavior of large distributed systems to mine actionable insights.
 </li>
 <li>
 Ensure the highest standards of quality and reliability across all services and solutions.
 </li>
 <li>
 Contribute to design of service software stack, datacenter design and network topology.
 </li>
 <li>
 Release features on time, with high quality, meeting functional, performance, scalability, and compliance requirements
 </li>
 <li>
 Research and adopt modern technology to improve quality of the service, increase customer value or reduce operating cost
 </li>
 <li>
 Participate in on-call rotation for the team
 
 
 </li>
 </ul>
 
 Qualifications
 
 
 
 Basic Qualifications:
 
 
 <ul>
 <li>
 Bachelor&rsquo;s degree in Computer Science or Engineering or Mathematics or Physics or IT technical discipline
 </li>
 <li>
 4+ years of programming experience in C#, C++.
 </li>
 <li>
 Proficiency in troubleshooting and debugging
 </li>
 <li>
 4+ years of commercial systems level software development experience
 
 
 </li>
 </ul>
 
 Preferred Qualifications
 
 
 
 <ul>
 <li>
 Experience with relational database internals and storage systems
 </li>
 <li>
 Experience with large scale distributed systems, multithreading and object-oriented programming
 </li>
 <li>
 Self-driven, results oriented, high integrity, ability to work collaboratively, solve problems with groups, find win/win solutions and celebrate successes
 
 
 </li>
 </ul>
 This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
 
 
 Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about
 
 requesting accommodations.
 
</div>

Software Engineering IC3

NTT DATA, Inc.

<div>
 
 Make an impact with NTT DATA
 
 
 
 Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion &ndash; it&rsquo;s a place where you can grow, belong and thrive.
 
 
 
 Your day at NTT DATA
 
 
 
 The Data Engineer is a seasoned subject matter expert, responsible for the transformation of data into a structured format that can be easily analyzed in a query or report.
 
 
 This role is responsible for developing structured data sets that can be reused or complimented by other data sets and reports.
 
 
 This role analyzes the data sources and data structure and designs and develops data models to support the analytics requirements of the business which includes management / operational / predictive / data science capabilities.
 
 
 
 Key responsibilities:
 
 
 
 <ul>
 <li>
 Creates data models in a structured data format to enable analysis thereof.
 </li>
 <li>
 Designs and develops scalable extract, transformation and loading (ETL) packages from the business source systems and the development of ETL routines to populate data from sources,
 </li>
 <li>
 Participates in the transformation of object and data models into appropriate database schemas within design constraints.
 </li>
 <li>
 Interprets installation standards to meet project needs and produce database components as required.
 </li>
 <li>
 Creates test scenarios and be responsible for participating in thorough testing and validation to support the accuracy of data transformations.
 </li>
 <li>
 Accountable for running data migrations across different databases and applications, for example MS Dynamics, Oracle, SAP and other ERP systems.
 </li>
 <li>
 Works across multiple IT and business teams to define and implement data table structures and data models based on requirements.
 </li>
 <li>
 Accountable for analysis, and development of ETL and migration documentation.
 </li>
 <li>
 Collaborates with various stakeholders to evaluate potential data requirements.
 </li>
 <li>
 Accountable for the definition and management of scoping, requirements, definition, and prioritization activities for small-scale changes and assist with more complex change initiatives.
 </li>
 <li>
 Collaborates with various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models.
 
 
 </li>
 </ul>
 
 To thrive in this role, you need to have:
 
 
 
 <ul>
 <li>
 Seasoned knowledge of the definition and management of scoping requirements, definition and prioritization activities.
 </li>
 <li>
 Seasoned understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models.
 </li>
 <li>
 Seasoned expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP.
 </li>
 <li>
 Seasoned understanding of data architecture landscape between physical and logical data models
 </li>
 <li>
 Analytical mindset with excellent business acumen skills.
 </li>
 <li>
 Problem-solving aptitude with the ability to communicate effectively, both written and verbal.
 </li>
 <li>
 Ability to build effective relationships at all levels within the organization.
 </li>
 <li>
 Seasoned expert in programing languages (Perl, bash, Shell Scripting, Python, etc.).
 
 
 </li>
 </ul>
 
 Academic qualifications and certifications:
 
 
 
 <ul>
 <li>
 Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field.
 </li>
 <li>
 Relevant certifications preferred such as SAP, Microsoft Azure etc.
 </li>
 <li>
 Certified Data Engineer, Certified Professional certification preferred.
 
 
 </li>
 </ul>
 
 Required experience:
 
 
 
 <ul>
 <li>
 Seasoned experience as a data engineering, data mining within a fast-paced environment.
 </li>
 <li>
 Proficient in building modern data analytics solutions that delivers insights from large and complex data sets with multi-terabyte scale.
 </li>
 <li>
 Seasoned experience with architecture and design of secure, highly available and scalable systems.
 </li>
 <li>
 Seasoned proficiency in automation, scripting and proven examples of successful implementation.
 </li>
 <li>
 Seasoned proficiency using scripting language (Perl, bash, Shell Scripting, Python, etc.).
 </li>
 <li>
 Seasoned experience with big data tools like Hadoop, Cassandra, Storm etc.
 </li>
 <li>
 Seasoned experience in any applicable language, preferably .NET.
 </li>
 <li>
 Seasoned proficiency in working with SAP, SQL, MySQL databases and Microsoft SQL.
 </li>
 <li>
 Seasoned experience working with data sets and ordering data through MS Excel functions, e.g. macros, pivots.
 
 
 </li>
 </ul>
 
 Workplace type:
 
 
 
 Hybrid Working
 
 
 
 About NTT DATA
 
 
 
 NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&amp;D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.
 
 
 
 Equal Opportunity Employer
 
 
 
 NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.
 
 
 
 Third parties fraudulently posing as NTT DATA recruiters
 
 
 
 NTT DATA recruiters will never ask job seekers or candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties who may attempt to impersonate NTT DATA recruiters&mdash;whether in writing or by phone&mdash;in order to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will come from an
 
 @nttdata.com
 
 email address. If you suspect any fraudulent activity, please
 
 contact us
 
 .
</div>

Data Engineer

Weekday AI (YC W21)

<div>
 
 This role is for one of the Weekday's clients
 
 
 
 Min Experience: 4 years
 
 
 Location: Pune, Bangalore
 
 
 JobType: full-time
 
 
 We are looking for an experienced Data Engineer with strong capabilities across SQL, ETL, Data Warehousing, BI, DevOps, and CI/CD&mdash;combined with hands-on experience in core banking systems and regulatory reporting pipelines. The ideal candidate will be highly technical, detail-oriented, and comfortable working with complex financial data environments.
 
 
 
 Requirements
 
 
 
 
 
 Key Responsibilities
 
 
 
 
 2. Data Warehousing &amp; Data Modelling
 
 
 
 
 3. SQL &amp; Database Engineering
 
 
 
 
 4. Big Data &amp; Distributed Processing
 
 
 
 
 5. BI, Reporting &amp; Visualization Support
 
 
 
 
 6. DevOps &amp; CI/CD Automation
 
 
 
 
 7. Banking Domain Expertise
 
 
 
 
 <ul>
 <li>
 Data Engineering &amp; ETL Development
 </li>
 <li>
 Design, build, and optimize ETL workflows for extracting data from Core Banking Systems (CBS) to support regulatory, analytics, and reporting needs.
 </li>
 <li>
 Develop ingestion pipelines using Apache NiFi, Airflow, SSIS, Informatica, Python, PySpark, and Databricks.
 </li>
 <li>
 Integrate and manage streaming solutions using Kafka or RabbitMQ.
 </li>
 <li>
 Ensure pipeline reliability, performance, data accuracy, and high availability.
 </li>
 <li>
 Build and maintain staging, integration, and semantic layers within enterprise data warehouses.
 </li>
 <li>
 Apply dimensional modelling techniques (star/snowflake schemas) and data vault concepts when needed.
 </li>
 <li>
 Optimize schema structures across SQL and distributed data environments for scalability and speed.
 </li>
 <li>
 Write advanced SQL queries, stored procedures, and transformations.
 </li>
 <li>
 Work extensively with SQL Server, Oracle, and MySQL.
 </li>
 <li>
 Conduct performance tuning, indexing, and query optimization for large datasets.
 </li>
 <li>
 Develop scalable transformation pipelines using Databricks, PySpark, and distributed processing engines.
 </li>
 <li>
 Handle large-scale data processing across structured and semi-structured datasets.
 </li>
 <li>
 Build clean and standardized datasets for regulatory and management reporting.
 </li>
 <li>
 Develop dashboards and visualizations using Power BI.
 </li>
 <li>
 Collaborate with reporting teams to ensure data quality, clarity, and compliance.
 </li>
 <li>
 Implement CI/CD workflows using Azure DevOps, Git, Jenkins, or similar tools.
 </li>
 <li>
 Manage version control, automated deployments, environment provisioning, and test automation.
 </li>
 <li>
 Ensure secure, scalable, and efficient deployment of data engineering and ETL components.
 </li>
 <li>
 Collaborate with finance, compliance, risk, and operations teams.
 </li>
 <li>
 Mandatory experience working with core banking systems such as T24, Finacle, or Flexcube.
 </li>
 <li>
 Build and maintain regulatory reporting pipelines (CBUAE, SAMA, QCB, BASEL, IFRS, ALM, Liquidity, Credit Risk, etc.).
 
 
 </li>
 </ul>
 
 Required Skills
 
 
 
 <ul>
 <li>
 Databases: SQL Server, Oracle, MySQL
 </li>
 <li>
 ETL Tools: Apache NiFi, Airflow, SSIS, Informatica
 </li>
 <li>
 Big Data: Databricks, PySpark
 </li>
 <li>
 Messaging: Kafka, RabbitMQ
 </li>
 <li>
 Programming: Python (required), Java (preferred)
 </li>
 <li>
 Reporting: Power BI
 </li>
 <li>
 Data Warehousing: Star/Snowflake schema, dimensional modelling
 </li>
 <li>
 DevOps/CI/CD: Git, Jenkins, Azure DevOps
 </li>
 <li>
 Nice to Have: MongoDB, Neo4j (NoSQL/Graph DBs)
 </li>
 <li>
 Domain Expertise: Core banking systems and regulatory reporting
 
 
 </li>
 </ul>
 
 Experience
 
 
 
 <ul>
 <li>
 4-7 years of experience in data engineering, ETL development, SQL, BI, and DevOps.
 </li>
 <li>
 Mandatory: Experience working within banks or financial institutions, including core banking systems and regulatory frameworks
 </li>
 </ul>
</div>

Scoutit

<div>
 We're looking for
 
 Data Engineers
 
 .
 
 
 
 Salary
 
 : INR 20 - 25 LPA
 
 
 
 Eligibility
 
 
 
 <ul>
 <li>
 2 years of relevant experience
 </li>
 <li>
 Has data pipeline implementation knowledge with any of these cloud providers - AWS, Azure, GCP.
 </li>
 <li>
 Experience with cloud storage, cloud database, cloud data warehousing and Data lake solutions
 </li>
 <li>
 Experience in using cloud data integration services for structured, semi-structured and unstructured data
 </li>
 <li>
 Strong proficiency in Python and SQL
 </li>
 <li>
 Eagerness to learn and grow in a collaborative environment.
 
 
 </li>
 </ul>
 (*Note: This is a requirement for one of Scout's clients)
 
 
 
 
 Roles and openings are subject to change. The client reserves the right to modify, reassign, or withdraw any role, requirements, number of positions, or timelines at any time during the hiring process. Submission of an application does not guarantee assignment to a particular role or an offer of employment. Applicants may be asked to attempt a hackathon assessment as a part of the hiring process. All hires are contingent on standard pre-employment screening and eligibility verification.
 
 
 
 
 Skills: cloud,azure,aws
</div>

Hypersonix Inc.

<div>
 Hypersonix.ai is disrupting the e-commerce space with AI, ML and advanced decision capabilities to drive real-time business insights. Hypersonix.ai has been built ground up with new age technology to simplify the consumption of data for our customers in various industry verticals. Hypersonix.ai is seeking a well-rounded, hands-on product leader to help lead product management of key capabilities and features.
 
 
 We are looking for talented and driven Data Engineers at various levels to work with customers to build the data warehouse, analytical dashboards and ML capabilities as per customer needs.
 
 
 
 Roles and Responsibilities:
 
 
 
 <ul>
 <li>
 Create and maintain optimal data pipeline architecture,
 </li>
 <li>
 Assemble large, complex data sets that meet functional / non-functional business requirements, should write complex queries in optimized way
 </li>
 <li>
 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
 </li>
 <li>
 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS &lsquo;big data&rsquo; technologies.
 </li>
 <li>
 Run ad-hoc analysis utilizing the data pipeline to provide actionable insights
 </li>
 <li>
 Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
 </li>
 <li>
 Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
 </li>
 <li>
 Work with analytics and data scientist team members and assist them in building and optimizing our product into an innovative industry leader
 
 
 </li>
 </ul>
 
 Requirements:
 
 
 
 <ul>
 <li>
 4 Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
 </li>
 <li>
 Experience building and optimizing &lsquo;big data&rsquo; data pipelines, architectures and data sets.
 </li>
 <li>
 Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
 </li>
 <li>
 Strong analytic skills related to working with unstructured datasets.
 </li>
 <li>
 Build processes supporting data transformation, data structures, metadata, dependency and workload management.
 </li>
 <li>
 A successful history of manipulating, processing and extracting value from large disconnected datasets.
 </li>
 <li>
 Working knowledge of message queuing, stream processing, and highly scalable &lsquo;big data&rsquo; data stores.
 </li>
 <li>
 Experience supporting and working with cross-functional teams in a dynamic environment.
 </li>
 <li>
 We are looking for a candidate with 8+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Information Technology or completed MCA.
 
 
 </li>
 </ul>
 Powered by JazzHR
 
 
 A0XZwDxlB2
</div>

Staff Data Engineer

Brillio

<div>
 
 About the Role
 
 
 Role Overview
 
 
 We are seeking a Build and Deploy Engineer with strong experience in ETL tools (DataStage, SSIS, IICS), Python, and UNIX scripting to support, maintain, and enhance data integration workflows for a leading banking client. The role involves build, release management, automation, and environment support for mission-critical data systems.
 
 
 ---
 
 
 Key Responsibilities
 
 
 &middot; Manage and execute build, deployment, and release activities for ETL applications (DataStage, SSIS, IICS).
 
 
 &middot; Automate deployment processes and environment setup using Python and UNIX shell scripting.
 
 
 &middot; Monitor and support ETL job executions, ensuring adherence to SLAs and minimizing downtime.
 
 
 &middot; Perform root cause analysis (RCA) and coordinate with development teams for resolution of build or deployment issues.
 
 
 &middot; Handle version control, code migration, and release coordination across Dev, UAT, and Production environments.
 
 
 &middot; Work with DBAs, system admins, and application teams to ensure environment stability and successful deployments.
 
 
 &middot; Maintain release documentation, build logs, and configuration records for audit compliance.
 
 
 &middot; Participate in Change Advisory Board (CAB) reviews and ensure adherence to ITIL change management processes.
 
 
 &middot; Provide 24x7 support during major releases and critical deployments.
 
 
 ---
 
 
 Technical Skills
 
 
 &middot; ETL Tools: IBM DataStage, Microsoft SSIS, Informatica IICS
 
 
 &middot; Languages &amp; Scripting: Python, UNIX shell scripting (mandatory)
 
 
 &middot; Databases: Oracle, SQL Server, Netezza, Snowflake (optional)
 
 
 &middot; Version Control: Git, Bitbucket, or similar
 
 
 &middot; CI/CD Tools: Jenkins, Azure DevOps, Control-M (nice to have)
 
 
 &middot; Operating Systems: UNIX/Linux, Windows
 
 
 &middot; Other Tools: ServiceNow, JIRA, or similar ITSM tools
 
 
 ---
 
 
 Domain &amp; Soft Skills
 
 
 &middot; Experience working in banking or financial services data environments.
 
 
 &middot; Strong knowledge of release governance, audit, and deployment compliance.
 
 
 &middot; Excellent troubleshooting, analytical, and problem-solving skills in data integration workflows.
 
 
 &middot; Ability to work in 24x7 managed services support models.
 
 
 &middot; Strong communication, documentation, and coordination skills across teams.
 
 
 ---
 
 
 Preferred Qualifications
 
 
 &middot; Experience in ETL deployment automation using Python or UNIX scripts.
 
 
 &middot; Familiarity with DataOps, CI/CD, or cloud migration pipelines.
 
 
 &middot; ITIL Foundation certification (preferred).
 
 
 
</div>

<div>
 Hypersonix.ai is disrupting the e-commerce space with AI, ML and advanced decision capabilities to drive real-time business insights. Hypersonix.ai has been built ground up with new age technology to simplify the consumption of data for our customers in various industry verticals. Hypersonix.ai is seeking a well-rounded, hands-on product leader to help lead product management of key capabilities and features.
 
 
 We are looking for talented and driven Data Engineers at various levels to work with customers to build the data warehouse, analytical dashboards and ML capabilities as per customer needs.
 
 
 
 Roles and Responsibilities:
 
 
 
 <ul>
 <li>
 Create and maintain optimal data pipeline architecture,
 </li>
 <li>
 Assemble large, complex data sets that meet functional / non-functional business requirements, should write complex queries in optimized way
 </li>
 <li>
 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
 </li>
 <li>
 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS &lsquo;big data&rsquo; technologies.
 </li>
 <li>
 Run ad-hoc analysis utilizing the data pipeline to provide actionable insights
 </li>
 <li>
 Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
 </li>
 <li>
 Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
 </li>
 <li>
 Work with analytics and data scientist team members and assist them in building and optimizing our product into an innovative industry leader
 
 
 </li>
 </ul>
 
 Requirements:
 
 
 
 <ul>
 <li>
 4 Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
 </li>
 <li>
 Experience building and optimizing &lsquo;big data&rsquo; data pipelines, architectures and data sets.
 </li>
 <li>
 Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
 </li>
 <li>
 Strong analytic skills related to working with unstructured datasets.
 </li>
 <li>
 Build processes supporting data transformation, data structures, metadata, dependency and workload management.
 </li>
 <li>
 A successful history of manipulating, processing and extracting value from large disconnected datasets.
 </li>
 <li>
 Working knowledge of message queuing, stream processing, and highly scalable &lsquo;big data&rsquo; data stores.
 </li>
 <li>
 Experience supporting and working with cross-functional teams in a dynamic environment.
 </li>
 <li>
 We are looking for a candidate with 4+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Information Technology or completed MCA.
 
 
 </li>
 </ul>
 Powered by JazzHR
 
 
 Id88T9y1Du
</div>

Senior Data Engineer

Explore 147+ Database engineer in Mangaluru this December. Find roles across top companies and apply now to boost your career.

147 database engineer jobs IN Mangaluru

Software Engineering IC3

Data Engineer

Data Engineer

Data Engineer

Staff Data Engineer

Data Engineer

Senior Data Engineer