etl lead

Photon

<div><div><div><p><b>Job Description: </b>Database Lead
</p><p>Experience
</p><p>5&ndash;8 years
</p><p>Location
</p><p>Offshore
</p><p><b>Role Overview
</b></p><p>We are looking for a Database Lead with strong GCP, database, and ETL experience to support a cloud-native data platform. The role involves database design, data modeling, schema evolution, data migrations, ETL pipelines, and data streaming across MySQL, PostgreSQL, and Google Cloud databases (Spanner, Cloud SQL, AlloyDB).
</p><p>The candidate will act as a technical lead, collaborating with onshore architects and leading offshore DB/ETL resources as additional team members are onboarded.
</p><p><b>Key Responsibilities
</b></p><ul><li>Lead data modeling, schema design, and database architecture across MySQL, PostgreSQL, Spanner, Cloud SQL, and AlloyDB.
</li><li>Own data migrations (one-time migrations, incremental/delta loads, and ongoing data synchronization).
</li><li>Design and manage config-driven ETL / ELT pipelines, with table-level configuration files and minimal transformations.
</li><li>Support on-demand onboarding of new tables and manage schema changes / evolution.
</li><li>Design and support data streams for batch and near-real-time ingestion.
</li><li>Work across teams on event-driven architectures, ensuring reliable data publishing and downstream consumption.
</li><li>Enable CI/CD deployments for database changes, ETL jobs, dataflows, and configurations.
</li><li>Monitor and troubleshoot ETL pipelines, data syncs, and streaming jobs; support reprocessing and recovery.
</li><li>Prepare and maintain playbooks, runbooks, and operational documentation.
</li><li>Lead and mentor offshore DB/ETL engineers, review designs, guide implementation, and ensure delivery quality.
</li></ul><p><b>Mandatory Skills &amp; Experience
</b></p><ul><li>5&ndash;8 years of experience in database and data engineering roles.
</li><li>Proven expertise in data modeling, schema design, and data migrations.
</li><li>Strong hands-on experience with MySQL and PostgreSQL.
</li><li>Experience with Google Cloud databases: Spanner, Cloud SQL, AlloyDB.
</li><li>Experience with ETL / ELT pipelines, data integration, and data streaming.
</li><li>Strong understanding of schema evolution, delta processing, and data synchronization.
</li><li>Advanced SQL skills.
</li><li>Experience working on GCP, including services like Pub/Sub, Dataflow, BigQuery, and Cloud Storage.
</li><li>Experience with CI/CD pipelines for data and database deployments.
</li><li>Ability to technically lead offshore teams and work with onshore stakeholders.
</li></ul><p><b>Nice to Have
</b></p><ul><li>Exposure to other databases / technologies such as AS/400, MongoDB, Cassandra, and GraphQL.
</li><li>Experience in enterprise data modernization or legacy-to-cloud programs.
</li><li>Professional Cloud Certifications (Google / Microsoft / AWS), including:
<ul><li>Google Professional Data Engineer
</li><li>Google Cloud Architect
</li><li>Google Cloud Engineer</li></ul></li></ul></div></div></div>

Database Lead | Technical Lead | India

Xavor Corporation

<p><b>Key Responsibilities:</b></p><ul><li>Architect and lead scalable, high-availability data pipelines (batch &amp; streaming).</li><li>Design and implement cloud-native data solutions and ETL/ELT workflows on AWS.</li><li>Ensure data reliability, performance, security, and cost optimization.</li><li>Lead architectural reviews, define data standards, and drive best practices.</li><li>Mentor engineers and collaborate with cross-functional teams (Product, Analytics, DevOps).</li></ul><p><b>Must-Have Skills:</b></p><ul><li>Strong Python programming for data engineering, automation, and analytics.</li><li>Cloud expertise: AWS (Glue, S3, Lambda, Batch, IAM, ECR, SNS).</li><li>CI/CD, code reviews, and software development lifecycle (SDLC) best practices.</li><li>Experience with data pipelines, ETL/ELT, and batch/streaming processing.</li></ul><p><b>Nice-to-Have Skills:</b></p><ul><li>Real-time data replication and CDC using Oracle GoldenGate.</li><li>Event-driven streaming with Apache Kafka.</li><li>Observability, monitoring, and alerting for large-scale data systems.</li><li>Serverless architecture and containerization experience.</li></ul><p>Job Type: Full-time</p><p>Work Location: Remote</p>

Principal Data Engineer

Virtusa Lifespaces India Pvt Ltd

<div><p>Role Description UX Lead Company Background Virtusa is a global information technology (IT) services company providing consulting, software development, and outsourcing services. The company has deep engineering and product development roots, with UX as one cornerstone in our delivery excellence Virtusa is building a world class UX team to research, design and build innovative mobile and web-based apps for its corporate clients, and we are excited to be expanding our practice to meet the evolving needs of digital transformation and AI-powered experiences. Summary You love designing apps that people love to use. In this role, you'll take primary responsibility for leading a UX design team to create innovative, usable, and buildable phone tablet, and laptop/desktop applications, including AI-powered interfaces and intelligent user experiences. You have a combination of hands-on design skills and the ability to guide a team to great results while establishing scalable design processes and systems. You pride yourself on having some front-end technical know how which helps you understand the development implications of your design decisions and enables you to create prototypes to explore and illustrate ideas. Clients look to you for insight and leadership in navigating complex digital experiences and emerging technologies. Responsibilities Solve design challenges. You have deep experience in interaction design, information architecture, and/or visual design. While it's rare to find someone deeply skilled in all design disciplines, you are deep in at least two and have some skills in the third. You are also able to structure and draw insights from user research create artifacts that illustrate how an app will look and work and evaluate designs through usability testing. For example, youll create annotated wireframes, visual design comps, user flows, and/or paper and interactive prototypes as necessary in order to explore ideas and document design decisions.</p><div><p><b>
About Virtusa</b></p>
<p>Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth &mdash; one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.</p>
<p>Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.</p>
<p>Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.</p></div></div><p></p>

UX Lead

Anblicks

<div><div>(ReactJS UI, Postgres Data Modeling, Spark Analytics work).</div>
<div></div><ul><li>Team lead with experience leading agile dev teams, guiding them and being a role model to developers in the team (lead by example)</li><li>Must be highly hands-on lead, writing code, leading team, reviewing other developers code, working closely with the architect to implement the proposed design</li><li>5+ years of experience writing enterprise grade Java or Python code (should be highly proficient)</li><li>Solid understanding of data structures and fundamental algorithms (sort, select, search, queue)</li><li>Solid understanding of distributed computing and/or massively parallel processing concepts and frameworks (at least one): Spark, Kafka, MapReduce, Impala</li><li>2+ years of experience writing Spark and Spark SQL routines to process large volumes of data</li><li>2+ years of experience building enterprise data platforms: Data Ingestion, Data Lake, ETL, Data Warehouse, Data Access Patterns/APIs, Reporting</li><li>2+ years of experience building ETL or ELT routines in one or more of the technologies: Spark, Kafka</li><li>Decent data warehousing and data modeling skills</li><li>Experience working in Linux</li><li>Spring Boot/APIs implementation experience is a nice to have</li><li>Azure experience is a nice to have</li><li>Databricks experience is a nice to have</li></ul></div><div></div>

FullStack Developer

Algonomy

<div></div><div><div>Position : Database Programmer (DBP)</div>
<div>Experience: 2 &ndash; 4 years</div>
<div>Education : Graduate Degree from any stream</div>
<div>Location : Bangalore, India</div>
<div></div><div><div>At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale.</div>
<div></div><div>We aim to become the algorithmic bridge between consumers and brands/retailers, and to lead our customers through the Algorithmic transformation imperative. The name Algo-nomy signifies an expertise in algorithms. As technology evolves our lives (and our clients&rsquo;) at hyper-speed, Algonomy stands as a bold, creative and agile brand; and these are also the very qualities that every digital-first business needs in order to be successful in the new normal. We are ambitious, we create category leading solutions in our markets, and we are constantly learning, inventing and adapting to stay ahead of our industry&rsquo;s needs</div>
</div>
<div></div><div><b>Broad Responsibilities</b></div>
<ul><li>Key individual contributor to the Product Deployment team</li>
<li>Will need to perform ETL, ETL performance tuning</li>
<li>Will be required to do fine tuning of complex queries of analytical database warehouse
<ul><li>The role will require good knowledge of database and data warehouse architecture</li>
</ul></li><li>Will need to work effectively with other team members and share best practices</li>
</ul><ul><li>Will need to work closely with Team Members, Team Leads, including Business Analysts, and Quality Assurance, and Project Managers</li>
</ul>
<div></div><div><b>Essential requirements for the role</b></div>
<ul><li>Minimum 4 years of relevant hands-on experience in design &amp; develop data warehouse and database programming.</li>
</ul><ul><li><b>SQL &amp; DB Programming:</b></li>
</ul><ul><li>In-depth knowledge of T-SQL / PL-SQL Programming, performance tuning of complex queries</li>
</ul><ul><li>Knowledge in creating various database objects - Stored Procedures, User Define Functions, Views, indexes</li>
</ul><ul><li><b>ETL:</b></li>
</ul><ul><li>Design and develop Scripts and Programs required to extract, transform, clean, and move data, in a manner that quality data can be loaded into the Data Warehouse.</li>
</ul><div><ul><li>This will require previous experience in &ldquo;incremental and history data load&rdquo;</li></ul>
</div><ul><li>Will need ETL performance handling experience using MS - SSIS/any standard ETL Tool and strong in handling large volume of data extraction and loading (500gb to 5tb)</li>
</ul><ul><li>Should have above average skills in ETL, ETL performance tuning as well as above average skills in fine tuning complex queries of analytical Database Warehouse etc</li>
</ul><ul><li><b>DW &amp; BI:</b></li>
</ul><ul><li>Should have designed and developed small to medium Data Base/Data Warehouses</li>
<li>Should have been part of at least 1-2 end to end BI projects or product deployments</li>
</ul><ul><li>Should have good skills in logical and physical design of Data Base &amp; Data Warehouse as well as logical &amp; physical data model according to the customer deployment scenarios &amp; scope</li>
</ul>
<div></div><div><b>Nice to have</b></div>
<ul><li>Experience in SSRS/SSAS 2005/2008 and knowledge of standard BI tools which is an added advantage</li>
</ul><ul><li>Retail / CPG domain exposure</li></ul></div><div></div>

Database Programmer (DBP)

Cognizant Technology Solutions

<div><p><b>Skill: OBIEE, PL/SQL</b></p><p><b>
Experience: 4 to 9 Years</b></p><p><b>
Location: AIA &ndash; Pune</b></p><p></p><p><b>
Job description</b></p><p>
We are seeking an experienced Lead OBIEE Developer with strong expertise in Oracle BI Publisher, OBIEE, SQL, and PL/SQL to join our team. The ideal candidate will be responsible for designing, developing, and supporting enterprise BI solutions, ensuring high-quality reporting, dashboards, and reconciliation models. This role requires strong analytical, troubleshooting, and communication skills with the ability to collaborate across ETL, application, and business teams.</p><p></p><p><b>
Key Responsibilities</b></p><ul><li>
Design, develop, and unit test OBIEE/BIP reports, ad hoc analyses, schedules, and dashboards.</li><li>
Develop and maintain the data layer, RPD, and web catalog in OBIEE.</li><li>
Work on Oracle database objects (tables, views, queries, functions, procedures).</li><li>
Perform query optimization and performance analysis to improve reporting efficiency.</li><li>
Design and develop reconciliation model-related reports and validations.</li><li>
Debug, analyze, and fix reporting issues in OBIEE and BI Publisher.</li><li>
Collaborate with ETL and application teams to troubleshoot and propose effective solutions.</li><li>
Support production activities, including data fixes, ETL validations, and end-user queries.</li><li>
Review and resolve issues in reports, schedules, and connections.</li><li>
Communicate effectively with end users and stakeholders regarding issues, fixes, and validations.</li><li>
Lead and mentor junior developers in OBIEE and BI reporting best practices.</li></ul><p><b>
Required Skills</b></p><ul><li>
Strong hands-on experience with Oracle OBIEE 12c (Reports, Analysis, Dashboards, BI Publisher).</li><li>
Proficiency in Oracle SQL and PL/SQL (queries, stored procedures, functions, performance tuning).</li><li>
Experience in RPD maintenance, web catalog management, and data layer design.</li><li>
Strong debugging and analytical skills, including reconciliation model understanding and report-to-report validation.</li><li>
Excellent communication skills (email and verbal).</li></ul><p><b>
Secondary Skills</b></p><ul><li>
Knowledge of OBIEE/BIP scheduling and admin functions.</li><li>
Experience with connection management and report automation.</li><li>
Familiarity with data validation and production support processes.</li></ul></div>

OBIEE, PL/SQL

Alpheya

<p></p><div><p><b>About Alpheya</b></p><p>
We are a B2B WealthTech startup based in Abu Dhabi and backed by BNY Mellon (America&rsquo;s oldest bank and first company to list on NYSE) and Lunate (a new $50B AUM alternative asset management firm based in Abu Dhabi, UAE). The company has raised $300M to build a state of the art wealth technology platform.</p><p>
Our mission is to power and grow our clients&rsquo; Wealth franchises through differentiated experiences, financial solutions, and insights. Our digital wealth management platform- will enable banks and other financial institutions in the Middle East to grow and further penetrate affluent, HNW and UHNW investor segments.
</p><p>While still leveraging the capabilities and knowledge of large organizations, our fintech is a startup with truly cross-functional and agile teams.</p><p>
For more information, please visit www.alpheya.com</p><p></p><p><b>
Role description and responsibilities
</b></p><p>We're looking for a skilled Lead Data Engineer to contribute to the Python services that power our data platform. You'll help build and maintain high-throughput ETL pipelines that ingest real-time market data and expose it through secure CRUD APIs. Working alongside other backend and data engineers, you'll make sure data flows smoothly from external sources into our internal data platform.</p><p></p><ul>
<li>
<b>Leadership</b>: Lead a team of 2-3 Data Engineers to deliver production ready ETL pipelines and APIs exposing RAG and Agents capabilities.</li>
<li><b>Market-Data ETL Pipelines</b>: Implement, test, and improve scalable ETL workflows that handle large volumes of data.</li>
<li><b>Async Orchestration &amp; Scheduling</b>: Develop and maintain task queues with Async tools, helping the team meet SLAs and surface operational metrics.</li>
<li><b>API Implementation</b>: Build REST endpoints with FastAPI Framework, providing clean CRUD access to market data and configuration entities.</li>
<li><b>Observability &amp; Reliability</b>: Add structured logs, traces, and metrics; contribute alerts and dashboards (Prometheus/Grafana, OpenTelemetry) that keep services at 99.9 % + availability.</li>
<li><b>Code Quality &amp; Best Practices</b>: Write type-safe, well-tested code, participate in code reviews, and help maintain CI/CD workflows.</li>
<li><b>Cross-Functional Collaboration</b>: Work closely with data scientists, and product managers to translate data requirements into robust backend capabilities.</li>
</ul><p><b>
Requirements</b></p><ul>
<li>
<b>Education</b> - Master's degree in Computer Science, Software Engineering, or a related field (or equivalent practical experience).</li>
<li><b>Experience</b> - 5+ years building production Python backends for data-intensive applications.</li>
<li><b>Python Mastery</b> - Modern Python (3.10 +) with asyncio, typing, dependency injection, and packaging best practices.</li>
<li><b>ETL Skills</b> - Experience designing batch or streaming pipelines; comfort with Kafka, RabbitMQ, or similar tools.</li>
<li><b>Database Skills</b> - Strong Postgres knowledge: migrations (Alembic, Django ORM), query tuning, partitioning, backup/restore.</li>
<li><b>Async Orchestration</b> - Hands-on with async tools like Airflow, Dagster, or Celery for scheduling and monitoring jobs.</li>
<li><b>API Engineering</b> - Proven ability to implement secure, versioned REST/GraphQL APIs with auth, rate-limiting, and RBAC.</li>
<li><b>Testing &amp; DevOps</b> - Familiarity with Pytest, Docker, Kubernetes, Terraform, and GitHub Actions (or similar).</li>
<li><b>Soft Skills</b> - Clear written and verbal communication; collaborative mindset.</li>
</ul><p></p><p><b>
Nice-to-Haves</b></p><ul>
<li>
Time-series or columnar DBs (TimescaleDB, ClickHouse, InfluxDB).</li>
<li>Knowledge of financial market-data protocols (FIX, FAST) or regulatory feeds.</li></ul></div>

Lead Data Engineer

Search 10000+ Etl lead jobs near you this January. New roles added regularly across leading industries. Apply today.