big data architect

Deloitte

<div></div><div><div><div><div><div>Job requisition ID :: 90037
</div></div></div></div><div><div><div><div>Date: Oct 24, 2025
</div></div></div></div><div><div><div><div>Location: Bengaluru
</div></div></div></div><div><div><div><div>Designation: Associate Director
</div></div></div></div><div><div><div><div>Entity: Deloitte Touche Tohmatsu India LLP
</div></div></div></div><div><div><div><div><p><b>Job Description: Data Architect</b></p><p><b>
Location: Bangalore</b></p><p><b>
Experience: 15+ years</b></p><p></p><p><b><br>
Key Responsibilities</b></p><p>
Strong expertise with Cloud data technologies, distributed databases &amp; streaming platforms</p><p>
Experience designing data lake, warehouse &amp; data pipelines on Azure Cloud &amp; GCP</p><p>
Experience with Azure Databricks, Synapse, DataFactory &amp; PowerBI</p><p>
Develop and deliver Big Data solutions using Google dataproc</p><p>
Provide strategic direction and technical expertise to meet data architecture needs</p><p>
Experience working with text-based search and analytics engine such as Elastic Search, SOLR</p></div></div></div></div></div><p></p>

T&T | EAD | Director | Delivery Management | Mumbai | Engineering

Stanford University

<p>Stanford University is seeking a Big Data Architect 1 for a 1 year fixed term (possibility of renewal) to design and develop applications, test and build automation tools and support the development of Big Data architecture and analytical solutions.</p><p><strong>About Us:</strong><br>The Department of Biomedical Data Science merges the disciplines of biomedical informatics, biostatistics, computer science and advances in AI. The intersection of these disciplines is applied to precision health, leveraging data across the entire medical spectrum, including molecular, tissue, medical imaging, EHR, biosensory and population data.</p><p><strong>About the Position:</strong><br>We are seeking an experienced ML Data Engineer to drive the programmatic curation, cleaning, and generation of healthcare data. In this role, you will focus exclusively on developing and maintaining automated, ML-accelerated pipelines that ensure high-quality data ready for machine learning applications. Your work will be pivotal in shaping the integrity of our data and supporting downstream predictive models in a complex healthcare environment.</p><p><br><strong>You Will Find This Position a Good Fit If:</strong><br> You are passionate about transforming raw healthcare data into valuable insights.<br> You believe in the critical role of robust data curation in advancing machine learning in healthcare.<br> You thrive in environments where you can work independently on complex data challenges while collaborating with multidisciplinary teams.<br> You are excited to work with patient-level data and embrace challenges related to data diversity and complexity.</p><p><br><strong>Duties include:</strong><br> Design Big Data systems that are scalable, optimized and fault-tolerant.<br> Work closely with scientific staff, IT professional and project managers to understand their data requirements for existing and future projects involving Big Data.<br> Develop, test, implement, and maintain database management applications. Optimize and tune the system, perform software review and maintenance to ensure that data design elements are reusable, repeatable and robust.<br> Contribute to the development of guidelines, standards, and processes to ensure data quality, integrity and security of systems and data appropriate to risk.<br> Participate in and/or contribute to setting strategy and standards through data architecture and implementation, leveraging Big Data, analytics tools and technologies.<br> Work with IT and data owners to understand the types of data collected in various databases and data warehouses.<br> Research and suggest new toolsets/methods to improve data ingestion, storage, and data access.</p><p><br><strong>Key Responsibilities:</strong></p><p> Data Pipeline Engineering:<br> Design, implement, and maintain robust pipelines for the programmatic cleaning, transformation, and curation of healthcare data.<br> Develop automated processes to curate and validate data, ensuring accuracy and compliance with healthcare standards (e.g. OMOP CDM, FHIR).<br> ML Data Engineering:<br> Leverage core machine learning techniques to generate datasets, clean existing health records, join heterogeneous data sources, and enhance data quality for model training.<br> Implement innovative solutions to detect and correct data inconsistencies and anomalies in large-scale healthcare datasets.<br> Healthcare Data Expertise:<br> Work extensively with patient-level health data, ensuring that data handling practices adhere to industry regulations and ethical standards.<br> Utilize the OMOP Common Data Model (OMOP CDM) to standardize and harmonize disparate healthcare data sources, enhancing interoperability and scalability.<br> Collaboration & Continuous Improvement:<br> Collaborate closely with data scientists, clinical informaticians, and engineers to align data engineering practices with analytical and clinical requirements.<br> Continuously monitor, troubleshoot, and optimize data workflows to support dynamic research and operational needs.</p><p>The expected pay range for this position is $157,945 to $177,385 per annum.</p><p><br>Stanford University provides pay ranges representing its good faith estimate of what the university reasonably expects to pay for a position. The pay offered to a selected candidate will be determined based on factors such as (but not limited to) the scope and responsibilities of the position, the qualifications of the selected candidate, departmental budget availability, internal equity, geographic location and external market pay for comparable jobs.</p><p><br>At Stanford University, base pay represents only one aspect of the comprehensive rewards package. The Cardinal at Work website () provides detailed information on Stanford's extensive range of benefits and rewards offered to employees. Specifics about the rewards package for this position may be discussed during the hiring process.</p><p><br>Consistent with its obligations under the law, the University will provide reasonable accommodations to applicants and employees with disabilities. Applicants requiring a reasonable accommodation for any part of the application or hiring process should contact Stanford University Human Resources at . For all other inquiries, please submit a contact form.</p><p><br><em>Stanford is an equal employment opportunity and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by law. Stanford welcomes applications from all who would bring additional dimensions to the University's research mission.</em></p> <p><strong>DESIRED QUALIFICATIONS:</strong><br> 3+ years of experience in software development and data engineering with a strong focus on data cleaning, transformation, and creation.<br> Proficiency in Python and experience with data processing libraries (e.g., Pandas, Polars, NumPy).<br> Hands-on experience in building and maintaining automated data pipelines for large-scale data processing.<br> Familiarity with machine learning frameworks (e.g., PyTorch, JAX, scikit-learn) as applied to data quality and augmentation tasks.<br> Expertise in working with healthcare data, including familiarity with the OMOP Common Data Model (OMOP CDM).<br> Strong experience in a Linux environment and comfort with UNIX command-line tools.<br> Proven ability to work collaboratively in multidisciplinary teams and communicate technical concepts effectively.</p><p><br><strong>PREFERRED QUALIFICATIONS:</strong><br> Experience with cloud platforms (e.g., GCP, AWS, or Azure) and distributed computing frameworks.<br> Proficiency with version control systems (e.g., Git) and containerization tools (e.g., Docker).<br> Familiarity with healthcare data standards and regulatory requirements.</p><p><br><strong>EDUCATION & EXPERIENCE (REQUIRED):</strong></p><p>Bachelor's degree in scientific or analytic field and five years of relevant experience, or a combination of education and relevant experience.</p><p><strong>KNOWLEDGE, SKILLS AND ABILITIES (REQUIRED):</strong><br>• Knowledge of key data structures algorithms, and techniques pertinent to systems that support high volume, velocity, or variety datasets (including data mining, machine learning, NLP, data retrieval).<br>• Experience with relational, NoSQL, or NewSQL database systems and data modeling, structured and unstructured.<br>• Experience in parallel and distributed data processing techniques and platforms (MPI, Map/Reduce, Batch).<br>• Experience in scripting languages and experience in debugging them, experience with high performance/systems languages and techniques.<br>• Knowledge of benchmark software development and programmable fields/systems, ability to analyze systems and data pipelines and propose solutions that leverage emerging technologies.<br>• Ability to use and integrate security controls for web applications, mobile platforms, and backend systems.<br>• Experience deploying reliable data systems and data quality management.<br>• Ability to research, evaluate, architect, and deploy new tools, frameworks, and patterns to build scalable Big Data platforms.<br>• Ability to document use cases, solutions and recommendations.<br>• Demonstrated excellence in written and verbal communication skills.</p><p><strong>CERTIFICATIONS & LICENSES:</strong></p><p>None</p><p><strong>PHYSICAL REQUIREMENTS :</strong></p><p>• Frequently sit, grasp lightly, use fine manipulation and perform desk-based computer tasks, lift, carry, push pull objects that weigh to ten pounds.<br>• Occasionally sit, use a telephone or write by hand.<br>• Rarely kneel, crawl, climb, twist, bend, stoop, squat, reach or work above shoulders, sort, file paperwork or parts, operate foot and hand controls.</p><p><em> - Consistent with its obligations under the law, the University will provide reasonable accommodation to any employee with a disability who requires accommodation to perform the essential functions of his or her job.</em></p><img src="https://www.jobg8.com/Tracking.aspx?qn2dWMJXE5OUYhjpmgXExjIqwGbtR5Eaq" width="0" height="0" />

ML Data Engineer - Healthcare Data Curation & Cleaning (1 Year Fixed Term)

N Consulting Limited

LocationBloomsbury Square, London, United Kingdom# Technology Architect - Data Engineering at N Consulting LtdLocationBloomsbury Square, London, United KingdomSalary£400 - £500 /dayJob TypeContractDate PostedSeptember 17th, 2025Apply Now We're Hiring: Technology Architect - Data Engineering (Hybrid - London) Contract: 6 months Work Mode: Hybrid (12 days WFO/month)We are looking for an experienced Technology Architect with deep expertise in PySpark, ADF, and Databricks to lead and design data engineering solutions for our client. What You'll Do: Lead technical design using Medallion architecture and Azure ServicesCreate conceptual diagrams, source-to-target mapping, and dimensional data modelsGuide the data engineering team on development with ADF, Databricks, Python, JSON, and YAMLImplement performance optimization strategies during data transformationDeploy code artifacts using GitHub Workflows/CI-CD pipelines Collaborate effectively with team members and stakeholdersOptional: Work with Log Analytics and KQL queries Must-Have Skills: 10+ years of experience in Data Engineering Hands-on experience with PySpark, ADF, Databricks, SQL Strong understanding of dimensional modeling, normalization, schema design, and data harmonization Experience with Erwin and data modeling toolsExcellent communication, problem-solving, and client-facing skills Why Join Us: Work in a dynamic, collaborative environment Hands-on experience with cutting-edge Azure data engineering technologies Hybrid setup providing flexibility while staying connected to the team<img src="https://www.jobg8.com/Tracking.aspx?8I79n2dBKkRvNJmK9ygcKi%2f0hzunNcynz" width="0" height="0" />

Technology Architect - Data Engineering

Niveus Solutions

<div><div><div><div><p><b>Job Description</b></p><div>
:</div></div><p></p><div><div><br>
<ul><li>8-15 yrs of IT experience</li>
<li>Leads architecture and delivery of enterprise data platforms on GCP, ensuring scalability, compliance, and performance.</li>
</ul><ul><li>Front ends technical discussions and review with the customer during the pre-sales stage,provide technical proposals, architecture and estimations for new opportunities</li>
<li>Drives architectural review discussions with Customer, and other auditors.</li>
 <li>Builds case studies on existing projects and re-usable assets Manage End to End Product life cycle, from proposal to delivery and Regularly check with delivery on architecture improvement</li>
<li>Should have worked on Petabyte scale DW projects, and be able to suggest best practices needed for performance</li>
<li>Have experience migrating source systems like csv, SQL, Oracle, Mongo, SAP BW, SAP Hana</li>
<li>Should have worked on performance &amp; cost optimization project , helping clients to optimize the project cost.</li>
<li>Should be aware of security protocols for intransit data , encryption/decryption of PII data</li>
<li>Experience with workflow management using tools like Apache Airflow and scripting languages like Java/python</li>
</ul>
</div></div></div></div><div></div><div><div><div><div><p><b>Department</b></p></div><div><p>
Data Modernization</p></div></div></div></div><div><div><div><div><p><b>
Open Positions</b></p></div><div><p>
1</p></div></div></div></div><div><div><div><div><p><b>
Skills Required</b></p></div><div><p>
GCP Architecture, Data Platform Design, DevOps, Security, Cloud Infrastructure</p></div></div></div></div><div><div><div><div><p><b>
Role</b></p></div><p></p><div><div><br>
<ul><li>Develop high performance and scalable solutions using GCP that extract, transform, and load big data.</li>
<li>Designing and building production-grade data solutions from ingestion to consumption using Java /Python</li>
<li>Design and optimize data models on GCP cloud using GCP data stores such as BigQuery</li>
<li>Optimizing data pipelines for performance and cost for large scale data lakes.</li>
<li>Writing complex, highly-optimized queries across large data sets and to create data processing layers.</li>
<li>Closely interact with Data Engineers to identify right tools to deliver product features by performing POC</li>
<li>Collaborative team player that interacts with business, BAs and other Data/ML engineers</li>
<li>Research new use cases for existing data.</li>
</ul>
</div></div></div></div></div><div><div><div><div><p><b>Location</b></p></div><div><p>
Mangaluru, Karnataka, India</p></div></div></div></div><div></div><div><div><div><div><p><b>
Years Of Exp</b></p></div><div><p>
12 to 15 years</p></div></div></div></div><div></div><div><div><div><p><b>
Posted On</b></p><div>
:</div></div><div><p>
15-Oct-2025</p></div></div></div></div>

Cloud Expert/ Data Architect

InfoCepts

<div><div><div><div><div><p><b>Key Result Areas and Activities:</b></p>
<ul><li><p>Technology Assessment and Design</p>
</li></ul><ul><li><p>Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.</p>
</li></ul><ul><li><p>Should be able to design complex Big Data use cases using AWS Services under guidance of Architect</p>
</li></ul><ul><li><p>Should be able to assist the architect in reasoning about various architecture choices in terms of cost, performance, durability.</p>
</li><li><p>Should be able to suggest optimizations in existing designs.</p>
</li><li><p>Ensure optimal balance between cost and performance.</p>
</li></ul><ul><li><p>Documentation and Stakeholder Communication</p>
</li></ul><ul><li><p>Project documentation, adheres to quality guidelines &amp; schedules.</p>
</li></ul><ul><li><p>Works hand in hand with Architect &amp; PM for successful delivery of project and provide estimation, scoping, scheduling assistance.</p>
</li></ul><ul><li><p>Articulate design decisions very clearly with stakeholders.</p>
</li></ul><ul><li><p>Perform Proof-of-Concepts and document all observations before proposing a new solution.</p>
</li></ul><ul><li><p>Conduct design review sessions with other teams and identify scope of improvement.</p>
</li></ul><ul><li><p>Process Improvement and Automation</p>
</li></ul><ul><li><p>Suggests automation to improve existing processes.</p>
</li></ul><ul><li><p>Assist junior Data Engineers by providing expert advice or troubleshooting steps whenever required.</p>
</li></ul><ul><li><p>Keep suggesting new ways to improve team productivity.</p>
</li></ul><ul><li><p>Training and Knowledge Sharing</p>
</li></ul><ul><li><p>Create technology-focused training plans whenever required.</p>
</li></ul><ul><li><p>Deliver technology-focused training sessions with team members whenever required.</p>
</li></ul><ul><li><p>Conduct Expert Knowledge Sharing sessions with Client Stakeholders whenever required.</p>
</li></ul><ul><li><p>Assist in designing case study documents whenever required.</p><br>
</li></ul></div></div></div></div><p></p><div><div><div><div><div><p><b>Must-Have:</b></p>
<ul><li><p>In-depth knowledge of the following AWS services: S3, EC2, EMR, Athena, AWS Glue, Lambda</p>
</li></ul><ul><li><p>Experience with at least one MPP database: AWS Redshift, Snowflake, SingleStore</p>
</li></ul><ul><li><p>Proficiency in Big Data technologies: Apache Spark, Databricks</p>
</li></ul><ul><li><p>Must have strong programming skills in Python</p>
</li></ul><ul><li><p>Responsible for building data pipelines in AWS And Databricks</p>
</li></ul><ul><li><p>Experience with Big Data table formats, such as Delta Lake (open source)</p>
</li></ul><ul><li><p>Must have very strong SQL skills</p>
</li></ul><ul><li><p>Experience with orchestration tools like Apache Airflow</p>
</li></ul><ul><li><p>Expertise in developing ETL workflows with complex transformations such as SCD, deduplications, aggregations, etc.</p>
</li></ul><ul><li><p>Should be a quick and self-learner, ready to adapt to new AWS services or Big Data technologies as required</p>
</li></ul><ul><li><p>Strong understanding of data warehousing concepts</p><br>
</li></ul><p></p><p><b>Good to Have:</b></p>
<ul><li><p>Cloud Databases &ndash; Snowflake, AWS Aurora</p>
</li></ul><ul><li><p>Big Data &ndash; Hadoop, Hive</p>
</li></ul><ul><li><p>Cloud Databases&ndash; AWS Aurora</p>
</li></ul><ul><li><p>Associate Level or Professional Level AWS Certification</p><br>
</li></ul><p></p><p><b>Qualifications:</b></p>
<ul><li><p>Overall 5+ years of IT Exp</p>
</li></ul><ul><li><p>5+ years of relevant experience in AWS related project</p>
</li></ul><ul><li><p>Bachelor&rsquo;s degree in computer science, engineering, or related field (master's degree is a plus)</p>
</li></ul><ul><li><p>Demonstrated continued learning through one or more technical certifications or related methods.</p>
</li></ul></div></div></div></div></div><div></div><div><div><div><div><div><b>Years Of Exp
</b></div></div><div><p>5 to 7 years</p></div></div></div></div><div></div><div><div><div><div><div><b>
Location
</b></div></div><div><p>India</p></div></div></div></div></div>

Senior Data Engineer-AWS

Icogz Pvt Ltd

<p>Job description:</p><p><b>About Us:</b><br/>At icogz Technologies Pvt Ltd, we are pioneers in harnessing the power of generative AI and proprietary algorithms to transform the complexity of Big Data into clear, actionable insights. Our unique approach recognizes the challenges posed by fragmented data silos, which stem from the diverse perspectives of various stakeholders within a company.</p><p>By utilizing our advanced proprietary algorithms and streamlined data processing flows, we effectively integrate and analyze vast, disparate datasets. This process delivers a unified, cohesive view of your business operations, enabling real-time analysis and insightful decision-making.</p><p>Our solutions at icogz Technologies empower businesses to swiftly adapt and capitalize on strategic opportunities. By turning big data into a navigable landscape of insights, we help enhance operational agility, improve performance, and drive profitability.</p><p><b>Role Overview:</b><br/>We&rsquo;re seeking a seasoned <b>Python Developer</b> to architect and deliver high-performance, scalable backend solutions. You&rsquo;ll be involved in the development of robust APIs, optimize data processing workflows, and ensure code quality while adhering to secure, efficient, and SaaS-ready practices. Your expertise in Django, FastAPI, PostgreSQL, Document DB, and big data will drive our platform&rsquo;s evolution.</p><p><b>Key Responsibilities:</b></p><ul><li>Design, develop, and maintain <b>RESTful APIs</b> using <b>Django/DRF</b> and <b>FastAPI</b> for big data analytics and LLM based applications.</li><li>Architect, Develop and Maintain <b>multi-tenant SaaS solutions</b> with security-first coding practices (e.g., OWASP and AVS2 standards).</li><li>Optimize <b>PostgreSQL</b> performance for large datasets, including query tuning, indexing, and partitioning.</li><li><b>Manage and Optimize Document DB operations</b>: Design, implement, and maintain databases in Document DB (e.g., MongoDB, Couchbase) to ensure efficient data storage, retrieval, and scalability. Optimize database queries, indexes, and ensure high availability and disaster recovery strategies are in place.</li><li>Process and analyze big data efficiently using Pandas, PySpark, or similar libraries.</li><li>Integrate third-party APIs (payment gateways, AI/ML services, marketplaces) with fault tolerance and monitoring.</li><li>Implement caching strategies (Redis, Memcached) to reduce latency and improve scalability.</li><li>Write <b>async-friendly code</b> and leverage concurrency for performance-critical tasks.</li><li>Develop <b>dynamic, reusable code</b> components to support rapid iteration in marketplace or SaaS environments.</li><li>Ensure compliance with <b>secured coding practices</b> (authentication, encryption, vulnerability mitigation).</li><li>Collaborate with data scientists/ML engineers to deploy and optimize AI/ML models in production.</li><li>Stay updated with AI-driven tools (e.g., GitHub Copilot) to enhance development efficiency.</li></ul><p><b>Requirements:</b></p><ul><li><b>2-5 </b>years of Python development experience, with <b>expert-level proficiency in Django and FastAPI</b>.</li><li>Strong understanding of <b>REST API design</b>, authentication (OAuth2, JWT), and versioning.</li><li>Hands-on experience with <b>PostgreSQL</b>, including query optimization for large datasets.</li><li><b>Expertise in Document DB systems</b> (e.g., MongoDB, Couchbase), including schema design, query optimization, and storage management.</li><li>Proficient in <b>Pandas, NumPy</b>, or similar libraries for data transformation/analytics.</li><li>Familiarity with async frameworks (e.g., <b>asyncio, Celery</b>) and event-driven architectures.</li><li>Experience building <b>multi-tenant SaaS systems</b> (isolated databases, tenant-aware middleware).</li><li>Knowledge of <b>big data tools</b> (Spark, Dask, pyArrow) and efficient file processing (Parquet, CSV).</li><li>Expertise in caching mechanisms.</li><li>Proven track record of integrating third-party APIs (social media platforms, payment systems, cloud services).</li><li>Adaptability to AI tools.</li><li>Strong problem-solving skills and a commitment to writing clean, maintainable code.</li></ul><p><b>Nice-to-Have:</b></p><ul><li>Experience with <b>Django Channels</b> for WebSocket/real-time applications.</li><li>Familiarity with <b>cloud platforms</b> (AWS, Azure) and containerization (Docker, Kubernetes).</li><li>Exposure to <b>marketplace ecosystems</b> (e.g., pricing engines, vendor APIs).</li><li>Contributions to open-source projects or tech community involvement.</li><li>Monitoring tools like Grafana, Prometheus.</li><li>Awareness of AI/ML concepts (model deployment, data pipelines) and adaptability to AI tools.</li><li>Exposure to analytical Databases like ClickHouse, DuckDB.</li></ul><p><b>Why Join Us?</b></p><ul><li>Opportunities to work on AI/ML-driven projects.</li><li>Continuous learning.</li><li>Collaborative culture with a focus on innovation.</li></ul><p>Job Types: Full-time, Permanent</p><p>Benefits:</p><ul><li>Paid time off</li><li>Provident Fund</li></ul><p>Application Question(s):</p><ul><li>How many years of experience do you have with Fast API?</li><li>How many years of experience do you have with  PostgreSQL?</li></ul><p>Experience:</p><ul><li>Python: 3 years (Required)</li></ul><p>Location:</p><ul><li>Mumbai, Maharashtra (Required)</li></ul><p>Work Location: In person</p>

Backend Developer

Oracle

<div><div><div>We're seeking a Senior Data Integration Engineer to design, develop, and manage enterprise-grade data integration solutions. The ideal candidate will have experience with ETL/ELT processes, API-driven integrations, and enterprise data platforms, with strong technical skills and collaboration abilities.
</div><div>Please apply, If you have the passion and standard methodologies work in an environment where challenges are a norm, where individual brilliance is valued and goes hand in hand with team performance, Where being proactive is how we do things !!!</div></div></div>
<br><div></div><div><div>Successful applicants should have/demonstrate:
</div><p>Key responsibilities
</p><ul><li>Architect, design, and optimize scalable big data solutions for batch and real-time processing.
</li><li>Develop and maintain ETL/ELT pipelines to ingest, transform, and synchronize data from diverse sources.
</li><li>Integrate data from cloud applications, on-prem systems, APIs, and streaming workspaces into centralized data repositories.
</li><li>Implement and manage <b>data lakes </b>and <b>data warehouses </b>solutions on cloud infrastructure.
</li><li>Ensure <b>data consistency, quality, and compliance </b>with governance and security standards.
</li><li>Collaborate with data architects, data engineers, and business stakeholders to align integration solutions with organizational needs.
</li></ul><p>Core qualifications
</p><ul><li>Proficiency in Python, Java, or Scala for big data processing.
</li><li><b>Big Data Frameworks: </b>Strong expertise in Apache Spark, Hadoop, Hive, Flink, or Kafka.
</li><li>Hands-on experience with data modeling, data lakes (Delta Lake, Iceberg, Hudi), and data warehouses (Snowflake, Redshift, BigQuery).
</li><li><b>ETL/ELT Development: Expertise with tools like Informatica, Talend, SSIS, Apache NiFi, dbt, or custom Python-based frameworks.
</b></li><li><b>APIs &amp; Integration: Strong hands-on experience with REST, SOAP, GraphQL APIs, and integration platforms (MuleSoft, Dell Boomi, SnapLogic).
</b></li><li><b>Data Pipelines: Proficiency in batch and real-time integration (Kafka, AWS Kinesis/ Azure Event Hub/ GCP Pub/Sub).
</b></li><li><b>Databases: Deep knowledge of SQL (Oracle, PostgreSQL, SQL Server) and NoSQL (MongoDB, Cassandra, DynamoDB) systems.
</b></li></ul><p>Preferred experience
</p><ul><li>Expertise with at least one major cloud platform (AWS, Azure, GCP).
</li><li>Experience with data services such as AWS EMR/Glue, GCP Dataflow/Dataproc, or Azure Data Factory.
</li><li>Familiarity with containerization (Docker) and orchestration (Kubernetes).
</li><li>Knowledge of CI/CD pipelines for data engineering.
</li><li>Experience with OCI and Oracle Database (including JSON/REST, sharding) and/or Oracle microservices tooling.</li></ul></div><div></div>

Senior Big Data Engineer

Search 10000+ Big data architect jobs near you this October. New roles added regularly across leading industries. Apply today.