big data platform architect

CRUTZ LEELA

<p>Big Data Architect required</p><p>Experience: 10-12 years</p><p>Key Responsibilities:</p><ul><li>Data Architecture Design: Designing and implementing scalable and resilient data</li></ul><p>architectures for both batch and streaming data processing.</p><ul><li>Data Modeling: Developing data models and database structures to ensure efficient</li></ul><p>data storage and retrieval.</p><ul><li>Data Security and Governance: Ensuring data security, integrity, and compliance</li></ul><p>with relevant regulations.</p><ul><li>Data Integration: Integrating data from various sources, including legacy systems,</li></ul><p>into the big data infrastructure.</p><ul><li>Performance Optimization: Monitoring and optimizing the performance of the big</li></ul><p>data infrastructure.</p><ul><li>Collaboration: Working with data scientists, engineers, and business stakeholders</li></ul><p>to understand requirements and translate them into technical solutions.</p><ul><li>Technology Selection: Evaluating and recommending new technologies and tools</li></ul><p>for data management and processing.</p><ul><li>Mentorship: Provide guidance and mentorship to junior team members.</li><li>Problem Solving: Identifying and resolving complex data challenges.</li><li>Participate in the pre and post sales process, helping both the sales, professional.</li></ul><p>Skills and Qualifications:</p><ul><li>Bachelor&rsquo;s / Master&rsquo;s degree in computer science, computer engineering, or</li></ul><p>relevant field.</p><ul><li>Overall 10+ years of experience, at least 2 years of experience in Big Data</li></ul><p>Architect.</p><ul><li>Strong understanding of big data technologies: Hadoop, Spark, NoSQL databases,</li></ul><p>cloud-based data services (AWS, Azure, GCP).</p><ul><li>Experience with open-source ecosystem programming languages (i.e., Python,</li></ul><p>Java, Scala, Spark etc.)</p><ul><li>Proficiency in data modeling and database design: SQL, NoSQL.</li><li>Experience with ETL processes: Extracting, transforming, and loading data.</li><li>Strong analytical and problem-solving skills.</li><li>Good communication and collaboration skills.</li><li>Experience with data security and governance principles.</li><li>Knowledge of API design and development.</li><li>Understanding of data visualization techniques.</li><li>Strong understanding of authentication (i.e. LDAP , Active Directory, SAML,</li></ul><p>Kerberos etc.) &amp;amp; authorization configuration for Hadoop based distributed systems.</p><ul><li>Familiarity of DevOps methodology &amp;amp; toolsets and automation experience.</li></ul><p>Job Types: Full-time, Permanent</p><p>Benefits:</p><ul><li>Provident Fund</li></ul><p>Work Location: In person</p>

Big Data Architect

CRUTZ LEELA ENTERPRISES

<p>Position- Big Data Architect</p><p>Experience: 10-12 years</p><p>Key Responsibilities:</p><ul><li>Data Architecture Design: Designing and implementing scalable and resilient data</li></ul><p>architectures for both batch and streaming data processing.</p><ul><li>Data Modeling: Developing data models and database structures to ensure efficient</li></ul><p>data storage and retrieval.</p><ul><li>Data Security and Governance: Ensuring data security, integrity, and compliance</li></ul><p>with relevant regulations.</p><ul><li>Data Integration: Integrating data from various sources, including legacy systems,</li></ul><p>into the big data infrastructure.</p><ul><li>Performance Optimization: Monitoring and optimizing the performance of the big</li></ul><p>data infrastructure.</p><ul><li>Collaboration: Working with data scientists, engineers, and business stakeholders</li></ul><p>to understand requirements and translate them into technical solutions.</p><ul><li>Technology Selection: Evaluating and recommending new technologies and tools</li></ul><p>for data management and processing.</p><ul><li>Mentorship: Provide guidance and mentorship to junior team members.</li></ul><ul><li>Problem Solving: Identifying and resolving complex data challenges.</li></ul><ul><li>Participate in the pre and post sales process, helping both the sales, professional.</li></ul><p>Skills and Qualifications:</p><ul><li>Bachelor&rsquo;s / Master&rsquo;s degree in computer science, computer engineering, or</li></ul><p>relevant field.</p><ul><li>Overall 10+ years of experience, at least 2 years of experience in Big Data</li></ul><p>Architect.</p><ul><li>Strong understanding of big data technologies: Hadoop, Spark, NoSQL databases,</li></ul><p>cloud-based data services (AWS, Azure, GCP).</p><ul><li>Experience with open-source ecosystem programming languages (i.e., Python,</li></ul><p>Java, Scala, Spark etc.)</p><ul><li>Proficiency in data modeling and database design: SQL, NoSQL.</li></ul><ul><li>Experience with ETL processes: Extracting, transforming, and loading data.</li></ul><ul><li>Strong analytical and problem-solving skills.</li></ul><ul><li>Good communication and collaboration skills.</li></ul><ul><li>Experience with data security and governance principles.</li></ul><ul><li>Knowledge of API design and development.</li></ul><ul><li>Understanding of data visualization techniques.</li></ul><ul><li>Strong understanding of authentication (i.e. LDAP , Active Directory, SAML,</li></ul><p>Kerberos etc.) &amp;amp; authorization configuration for Hadoop based distributed systems.</p><ul><li>Familiarity of DevOps methodology &amp;amp; toolsets and automation experience.</li></ul><p>Job Type: Permanent</p><p>Pay: &#8377;500,000.00 - &#8377;1,800,000.00 per year</p><p>Benefits:</p><ul><li>Provident Fund</li></ul><p>Work Location: In person</p>

Emergys

<div><div><div><div><div><div><div><div><div><div><div><div><div><div><div><p><b>Experience</b>: 10-12 years</p>
<p><b>
Location</b>: Pune, India (Work from Office)</p>
<p><b>
Key Responsibilities:</b></p>
<ul>
<li>Data Architecture Design: Designing and implementing scalable and resilient data architectures for both batch and streaming data processing.</li>
<li>Data Modeling: Developing data models and database structures to ensure efficient data storage and retrieval.</li>
<li>Data Security and Governance: Ensuring data security, integrity, and compliance with relevant regulations.</li>
<li>Data Integration: Integrating data from various sources, including legacy systems, into the big data infrastructure.</li>
<li>Performance Optimization: Monitoring and optimizing the performance of the big data infrastructure.</li>
<li>Collaboration: Working with data scientists, engineers, and business stakeholders to understand requirements and translate them into technical solutions.</li>
<li>Technology Selection: Evaluating and recommending new technologies and tools for data management and processing.</li>
<li>Mentorship: Provide guidance and mentorship to junior team members.</li>
<li>Problem Solving: Identifying and resolving complex data challenges.</li>
<li>Participate in the pre and post sales process, helping both the sales, professional.</li>
</ul>
<p><b>Skills and Qualifications:</b></p>
<ul>
<li>Bachelor&rsquo;s / Master&rsquo;s degree in computer science, computer engineering, or relevant field.</li>
<li>Overall 10+ years of experience, at least 2 years of experience in Big Data Architect.</li>
<li>Strong understanding of big data technologies: Hadoop, Spark, NoSQL databases, cloud-based data services (AWS, Azure, GCP).</li>
<li>Experience with open-source ecosystem programming languages (i.e., Python, Java, Scala, Spark etc.)</li>
<li>Proficiency in data modeling and database design: SQL, NoSQL.</li>
<li>Experience with ETL processes: Extracting, transforming, and loading data.</li>
<li>Strong analytical and problem-solving skills.</li>
<li>Good communication and collaboration skills.</li>
<li>Experience with data security and governance principles.</li>
<li>Knowledge of API design and development.</li>
<li>Understanding of data visualization techniques.</li>
<li>Strong understanding of authentication (i.e. LDAP , Active Directory, SAML, Kerberos etc.) &amp; authorization configuration for Hadoop based distributed systems.</li>
<li>Familiarity of DevOps methodology &amp; toolsets and automation experience.</li></ul></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><p></p>

TechBiz Global GmbH

<div><p>At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an
</p><p><b>Data Architect</b> to join one of our <b>clients</b>' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.</p><p><b>
Role Summary:</b></p><p>
The Data Architect will design and govern the complete data ecosystem for the ValueX platform &mdash; including data ingestion, processing, modeling, storage, orchestration, and governance.
</p><p>They will define the <b>data architecture blueprint</b> supporting the system&rsquo;s core modules.</p><p><b>
1. Customer Segmentation
</b></p><p><b>2. Business Decisioning &amp; Offer Assignment Engine
</b></p><p><b>3. Real-Time Offer Orchestration Module (ROOM)
</b></p><p><b>4. ML/AI Model Management &amp; Simulation Engine</b>
</p><p>The architect will ensure scalability to handle 50 million+ customer profiles, real-time event streams, and ML-driven decisioning &mdash; with a focus on performance, cost optimization, and maintainability.</p><p></p><p><b>
Key Responsibilities:
</b></p><p><b>Data Architecture &amp; Design</b></p><ul><li><p>
Define the end-to-end data architecture across batch, streaming, and real-time layers.</p></li><li><p>
Design Customer 360 and Offer 360 data models, including feature store and historical layers.
</p></li><li><p>Establish logical, physical, and semantic data models to enable segmentation, scoring, and orchestration.
</p></li><li><p>Define data contracts for Kafka topics, API payloads, and Adobe/CDP integrations.
</p></li><li><p>Set up data versioning and lineage frameworks to track data provenance</p></li></ul><p></p><p><b>
Data Ingestion &amp; Integration</b></p><ul><li><p>
Architect data ingestion pipelines from multiple telco sources: OCS, CRM, Kenan, Billing, DWH, Adobe AEP, Pricefx, and external APIs.
</p></li><li><p>Define patterns for real-time event ingestion (recharge, offer purchase, balance check).
</p></li><li><p>Standardize data access through APIs or data products for downstream modules.
</p></li><li><p>Design connectors for cloud storage (e.g., S3, Delta Lake) and integration middleware (e.g., n8n, DecisionRules.io, KNIME).</p></li></ul><p></p><p><b>
Data Management &amp; Governance</b>
</p><ul><li><p>Define and enforce data quality, lineage, catalog, and access policies.
</p></li><li><p>Establish metadata management frameworks (e.g., DataHub, Collibra, Amundsen).
</p></li><li><p>Set up data validation and DQ frameworks (Great Expectations, Deequ).
</p></li><li><p>Govern data partitioning, schema evolution, retention, and archiving strategies.
</p></li><li><p>Ensure compliance with data privacy and regulatory standards (e.g., PDPA, GDPR, local telecom data policies).</p></li></ul><p></p><p><b>
Scalability, Cost &amp; Performance</b>
</p><ul><li><p>Design for high performance and cost-efficient scalability (25M 50M 75M customers).
</p></li><li><p>Optimize compute/storage balance across environments (Dev, UAT, Prod).
</p></li><li><p>Define data lakehouse optimization strategies (Z-Order, Delta caching, compaction).
</p></li><li><p>Monitor and manage query performance, cluster sizing, and job orchestration costs.</p></li></ul><p></p><p><b>
Collaboration &amp; Governance</b>
</p><ul><li><p>Work closely with Data Engineers, Data Scientists, and Application Developers to ensure architectural alignment.
</p></li><li><p>Lead architecture review boards and maintain data design documentation (ERD, flow diagrams, schema registry).
</p></li><li><p>Serve as technical liaison between business stakeholders, data teams, and platform vendors (Databricks, Adobe, Pricefx).
</p></li><li><p>Provide best practices and design patterns for model deployment, retraining, and data lifecycle management.</p></li></ul><ul><li><p>
10+ years in Data Architecture and Data Platform Design</p></li><li><p>
Data Architecture-Data lakehouse design, data modeling (dimensional, normalized, semantic), schema management.</p></li><li><p>
ETL/ELT &amp; Orchestration-Databricks, Snowflake, dbt, Airflow, AWS Glue, Azure Data Factory.</p></li><li><p>
Streaming &amp; Real-Time-Apache Kafka, Spark Streaming, Kinesis, Flink</p></li><li><p>
Data Modeling-Customer 360, Offer 360, Transaction 360, Feature Store</p></li><li><p>
Cloud Platforms-AWS (S3, Glue, Lambda, EMR), Azure (ADF, Synapse), or GCP (BigQuery, Dataflow)</p></li><li><p>
Storage &amp; Compute-Delta Lake, Parquet, Iceberg, Snowflake</p></li><li><p>
Data Quality &amp; Governance-Great Expectations, Deequ, DataHub, Collibra</p></li><li><p>
Programming &amp; Scripting-Python, SQL, PySpark, YAML</p></li><li><p>
API &amp; Integration Design-REST, GraphQL, Kafka Connect, JSON schema</p></li><li><p>
Security &amp; Compliance-IAM, encryption (KMS), access control, masking, PDPA compliance
</p></li></ul><p></p><p><b>Preferred (Nice-to-Have)</b></p><ul><li><p>
Telecom industry experience (recharge, balance, offer, churn, usage data).
</p></li><li><p>Experience integrating with Adobe Experience Platform (AEP) or Pricefx.
</p></li><li><p>Knowledge of DecisionRules.io, KNIME, or n8n for workflow orchestration.
</p></li><li><p>Familiarity with AI/ML pipelines and MLOps frameworks (MLflow, SageMaker).
</p></li><li><p>Exposure to knowledge graphs (Neo4j, GraphFrames) for segmentation and recommendation.
</p></li><p></p><li><p><b>Educational Background Bachelor&rsquo;s or Master&rsquo;s degree in Computer Science, Data Engineering, or related fields.
</b></p></li><li><p><b>Certifications in AWS/Azure Data Architect, Databricks Certified Data Engineer, or Snowflake Architect are preferred.</b></p></li></ul></div>

Data Architect – Dynamic Pricing & Decision Intelligence Platform

TravelNet Solutions Inc

<div><div>Join TravelNet Solutions as a <b>Data Platform Architect!</b><br>
<br>
At TravelNet Solutions (TNS), we combine deep hospitality expertise with forward-thinking technology and a customer-obsessed mindset&hellip; to help property managers win! TNS is proud to be named an Inc.5000 Fastest Growing Company in America.<br>
<br>
This role is perfect for someone who is:<br>
<ul><li>A self-starter with tremendous initiative and a strong work ethic</li><li>An excellent communicator and collaborator across functional teams</li><li>Eager to make a high impact at a product-driven company</li><li>Adaptable, quick to embrace change, and a fast learner</li><li>Skilled in creative and critical thinking</li><li>Detail-oriented, even in a fast-paced environment</li><li>Passionate about technology and innovation</li></ul>
<br>
<b>About TravelNet Solutions</b><br>
For over 21 years, TravelNet Solutions has provided integrated software and marketing solutions for the hospitality industry, anchored by our flagship <b>Track Property Management System</b> and other products under the Track banner. Our single-vendor ecosystem equips growing vacation rental companies with all the enterprise-class tools they need to scale. With ongoing investments in platform development, 70+ integration partners, and a growing list of native features, Track empowers hospitality professionals to achieve digital transformation and operational excellence.<br>
<br>
Our <b>Core Values</b> reflect the behaviors that shape the tone of how we work with each other, our partners, and our customers:<br>
<br>
<ul><li>Serve Others: Nurturing growth to help others succeed</li><li>Grit: Taking ownership and never giving up on what matters most</li><li>Create the Future: Innovating to disrupt the status quo</li></ul><br>
<br>
Why Join Us?<br>
<ul><li>Be part of a fast-moving, dynamic team focused on growth and success.</li><li>Work alongside a talented, collaborative, and supportive team.</li><li>Work for a portfolio company offering a one-vendor solution for SaaS technology, marketing, and distribution.</li><li>Help reshape the hospitality industry through technology and service innovation.</li></ul>
<br>
Perks and Benefits:<br>
<ul><li>Full medical, dental, and vision coverage</li><li>Flexible Paid Time Off</li><li>Unlimited access to professional training and development</li><li>Health Savings Account with up to a $2,000 annual match</li><li>Up to $900 in Wellness Rewards annually</li><li>Flexible work environment</li><li>Free life insurance and long-term disability coverage</li><li>Flexible Spending Accounts</li><li>Retirement plan with employer match</li><li>Free snacks and soda in the office</li><li>$150 quarterly gift for personal use</li><li>Competitive wages</li><li>Work with an amazing team!</li></ul></div>
<div></div><div>The <b>Data Platform Architect </b>is responsible for defining, implementing, and evolving the end-to-end data architecture that powers our platform analytics, reporting, and data automation ecosystem.<br>
This role will design a scalable, automated <b>multi-tenant data warehouse</b> and pipeline architecture that integrates hundreds of tenant schemas from our <b>SaaS platform</b> into a centralized, governed, and cost-optimized analytics environment (AWS-based: Redshift, S3, Glue, Lake Formation, QuickSight).<br>
The ideal candidate combines deep data engineering expertise with <b>architectural systems thinking</b>&mdash;balancing automation, performance, and cost while ensuring accuracy, compliance, and scalability for every customer.</div>
<div><br>
<b>Duties and Responsibilities:</b><br>
<br>
<i>Architecture &amp; Design</i><br>
<ul><li>Architect a multi-tenant data platform capable of ingesting 500+ tenant schemas with automated onboarding/offboarding workflows</li><li>Design an end-to-end architecture that includes data lakes, warehouses, transformation pipelines, and semantic layers</li><li>Define data zone strategy (Raw Staging Serving), partitioning, and schema evolution patterns</li><li>Establish standards for data contracts, metadata cataloging, and lineage tracking across all tenants</li><li>Drive selection and configuration of core technologies (e.g., Redshift, Glue, S3, Lake Formation, dbt, Lambda, Airflow)</li><li>Collaborate with engineering and DevOps to ensure infrastructure as code (IaC) is applied to all data assets</li></ul>
<br>
<i>Pipeline &amp; Automation</i><br>
<ul><li>Design metadata-driven ingestion and transformation pipelines supporting incremental updates, schema drift, and tenant isolation.</li><li>Ensure pipelines are idempotent, self-healing, and fully integrated into CI/CD processes.</li><li>Partner with the Data Pipeline Engineers to deliver automated data onboarding, testing, and quality validation.</li></ul>
<br>
<i>Performance &amp; Cost Optimization</i><br>
<ul><li>Define workload management, clustering, and distribution strategies in Redshift or equivalent MPP systems.</li><li>Implement data lifecycle management policies to optimize storage and compute costs.</li><li>Continuously evaluate query performance, caching, and concurrency scaling options.</li></ul>
<br>
<i>Governance &amp; Security</i><br>
<ul><li>Implement data governance frameworks to ensure privacy, PII compliance, and secure tenant isolation</li><li>Partner with InfoSec to align encryption (KMS multi-region keys), object lock, and access control policies with SOC/PCI/GDPR standards.</li><li>Establish monitoring, alerting, and anomaly detection systems for data quality and operational stability.</li></ul>
<br>
<i>Collaboration &amp; Leadership</i><br>
<ul><li>Partner closely with Product, Engineering, and Analytics teams to ensure architecture aligns with business and product goals.</li><li>Mentor engineers on modern data platform practices (dbt, ELT, IaC, observability).</li><li>Act as a technical authority and evangelist for data platform best practices within the organization.</li></ul>
<br>
<b>Required Experience:</b><br>
<ul><li>Bachelor&rsquo;s or Master&rsquo;s degree in <b>Computer Science, Data Engineering</b>, or related field; or equivalent professional experience.</li><li><b>8+</b> years in data engineering or data architecture, including at least <b>3 years architecting</b> cloud-native data platforms.</li><li>Proven success <b>building</b> and maintaining large-scale data pipelines using AWS Glue, Lambda, Step Functions, or Airflow.</li><li>Expertise in <b>Redshift, Snowflake</b>, or equivalent MPP databases, including workload management and query optimization.</li><li>Proficiency with S3-based<b> data lakes</b>, Glue Data Catalog, and Lake Formation.</li><li>Deep understanding of data modeling (Kimball/ELT) and <b>multi-tenant</b> system design.</li><li>Experience defining and enforcing <b>data governance</b> frameworks (PII, access control, lineage).</li><li>Proficiency with <b>infrastructure-as-code</b> (Terraform/CloudFormation) and CI/CD for data assets.</li><li>Strong <b>SQL </b>and <b>Python </b>skills; dbt experience preferred.</li><li>Familiarity with embedded <b>BI/analytics </b>tools (QuickSight, GoodData) and semantic layer concepts</li></ul><br>
<br>
Preferred Experience:<br>
<ul><li>Experience with schema-per-tenant architectures and automated tenant provisioning.</li><li>Familiarity with Auth0 / SSO integration for analytics tools (e.g., QuickSight embedding).</li><li>Experience implementing observability platforms (e.g., Datadog, CloudWatch, Monte Carlo, Soda Core)</li><li>Exposure to data mesh or domain-oriented design principles.</li><li>Prior experience in SaaS product ecosystems or hospitality / property-management data preferred</li></ul>
<br>
<b>Diversity and Inclusion:</b><br>
We celebrate diversity of thought, culture, and background and are committed to creating an inclusive environment. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, disability, or veteran status or any other protected status under applicable federal, state, or local law. We comply with all applicable laws governing nondiscrimination in every location where we operate and encourage individuals from all backgrounds to apply.<br>
<br>
<b>Compensation:</b><br>
The typical starting salary range for this position is: $130-185k.<br>
The actual salary offer will consider multiple factors, including skills, experience, education, and location. Please note that the salary reflects the base amount only and does not include total compensation, such as discretionary bonuses and benefits.</div></div>

Data Platform Architect

Equinix

<div><div><div><h3 class="jobSectionHeader"><b>Principal Platform Engineer - Data &amp; AI
 </b></h3><div></div><div><div><ul><li>JR-152898
</li> <div></div><li>Hybrid
</li> </ul></div><div></div><div><ul><li>Bengaluru
</li> <div></div><li>Singapore
</li> </ul></div><div></div><div><ul><li>Information Technology
</li> </ul></div><div></div><div><ul><li>Full time</li></ul></div></div><div></div><div><div><b><br>
</b></div>
</div><div><p><b>Who are we?</b></p><div>
<p>
Equinix is the world&rsquo;s digital infrastructure company&reg;, shortening the path to connectivity to enable the innovations that enrich our work, life and planet.</p><br>
<p>
A place where bold ideas are welcomed, human connection is valued, and everyone has the opportunity to shape their future.</p>
</div><p></p>
Help us challenge assumptions, uncover bias, and remove barriers&mdash;because progress starts with fresh ideas. You&rsquo;ll find belonging, purpose, and a team that welcomes you&mdash;because when you feel valued, you&rsquo;re empowered to do your best work.<p></p><p>
We&rsquo;re looking for a Principal Platform Engineer with a strong foundation in data architecture, distributed systems, and modern cloud-native platforms to architect, build, and maintain intelligent infrastructure and systems that power our AI, GenAI and data-intensive workloads.</p><p></p><p><br>
You&rsquo;ll work closely with cross-functional teams, including data scientists, ML &amp; software engineers, and product managers &amp; play a key role in designing a highly scalable platform to manage the lifecycle of data pipelines, APIs, real-time streaming, and agentic GenAI workflows, while enabling federated data architectures. The ideal candidate will have a strong background in building and maintaining scalable AI &amp; Data Platform, optimizing workflows, and ensuring the reliability and performance of Data Platform systems.</p><p></p><p><b><br>
Responsibilities</b></p><p>
Platform &amp; Cloud Engineering</p><ul>
<li>
Develop and maintain real-time and batch data pipelines using tools like Airflow, dbt, Dataform, and Dataflow/Spark</li>
<li>Design and develop event-driven architectures using Apache Kafka, Google Pub/Sub, or equivalent messaging systems</li>
<li>Build and expose high-performance data APIs and microservices to support downstream applications, ML workflows, and GenAI agents</li>
<li>Architect and manage multi-cloud and hybrid cloud platforms (e.g., GCP, AWS, Azure) optimized for AI, ML, and real-time data processing workloads</li>
<li>Build reusable frameworks and infrastructure-as-code (IaC) using Terraform, Kubernetes, and CI/CD to drive self-service and automation</li>
<li>Ensure platform scalability, resilience, and cost efficiency through modern practices like GitOps, observability, and chaos engineering</li></ul><p></p><p><br>
Data Architecture &amp; Governance</p><ul>
<li>
Lead initiatives in data modeling, semantic layer design, and data cataloging, ensuring data quality and discoverability across domains</li>
<li>Implement enterprise-wide data governance practices, schema enforcement, and lineage tracking using tools like DataHub, Amundsen, or Collibra</li>
<li>Guide adoption of data fabric and mesh principles for federated ownership, scalable architecture, and domain-driven data product development</li></ul><p></p><p><br>
AI &amp; GenAI Platform Integration</p><ul>
<li>
Integrate LLM APIs (OpenAI, Gemini, Claude, etc.) into platform workflows for intelligent automation and enhanced user experience</li>
<li>Build and orchestrate multi-agent systems using frameworks like CrewAI, LangGraph, or AutoGen for use cases such as pipeline debugging, code generation, and MLOps</li>
<li>Experience in developing and integrating GenAI applications using MCP and orchestration of LLM-powered workflows (e.g., summarization, document Q&amp;A, chatbot assistants, and intelligent data exploration)</li>
<li>Hands-on expertise building and optimizing vector search and RAG pipelines using tools like Weaviate, Pinecone, or FAISS to support embedding-based retrieval and real-time semantic search across structured and unstructured datasets</li></ul><p></p><p><br>
Engineering Enablement</p><ul>
<li>
Create extensible CLIs, SDKs, and blueprints to simplify onboarding, accelerate development, and standardize best practices</li>
<li>Streamline onboarding, documentation, and platform implementation &amp; support using GenAI and conversational interfaces</li>
<li>Collaborate across teams to enforce cost, reliability, and security standards within platform blueprints</li>
<li>Act as a thought leader across engineering by introducing platform enhancements, observability, and cost optimization techniques</li>
<li>Mentor junior engineers and foster a culture of ownership, continuous learning, and innovation</li></ul><p></p><p><b><br>
Qualifications</b></p><ul>
<li>
15 years of hands-on experience in Platform or Data Engineering, Cloud Architecture, AI Engineering roles</li>
<li>Strong programming background in Java, Python, SQL, and one or more general-purpose languages</li>
<li>Deep knowledge of data modeling, distributed systems, and API design in production environments</li>
<li>Proficiency in designing and managing Kubernetes, serverless workloads, and streaming systems (Kafka, Pub/Sub, Flink, Spark)</li>
<li>Experience with metadata management, data catalogs, data quality enforcement, and semantic modeling &amp; automated integration with Data Platform</li>
<li>Proven experience building scalable, efficient data pipelines for structured and unstructured data</li>
<li>Experience with GenAI/LLM frameworks and tools for orchestration and workflow automation</li>
<li>Experience with RAG pipelines, vector databases, and embedding-based search.</li>
<li>Familiarity with observability tools (Prometheus, Grafana, OpenTelemetry) and strong debugging skills across the stack</li>
<li>Experience with ML Platforms (MLFlow, Vertex AI, Kubeflow) and AI/ML observability tools</li>
<li>Prior implementation of data mesh or data fabric in a large-scale enterprise</li>
<li>Experience with Looker Modeler, LookML, or semantic modeling layers</li></ul><p></p><p><br>
Why You&rsquo;ll Love This Role</p><ul>
<li>
Drive technical leadership across AI-native data platforms, automation systems, and self-service tools</li>
<li>Collaborate across teams to shape the next generation of intelligent platforms in the enterprise</li>
<li>Work with a high-energy, mission-driven team that embraces innovation, open-source, and experimentation</li>
</ul><p></p><p>
Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing form.
</p><p></p><p>Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.</p></div></div></div></div>

Principal Platform Engineer - Data & AI

Codvo.ai

<div><div><div><p><b>Job Description: Azure Data Platform Lead</b></p><div></div><p><b><br>
Position Overview</b></p><p>
Lead the design, implementation, and optimization of enterprise-scale Azure data platform solutions, driving modern data architecture initiatives and establishing best practices for data engineering and analytics.</p><div></div><p><b><br>
Key Responsibilities</b></p><p>
Platform Architecture &amp; Strategy:</p><ul><li>Design and implement scalable data platform architectures using Azure services (Synapse, Data Factory, Fabric, SQL Database)</li><li>Establish data lakehouse and data warehouse solutions with medallion architecture patterns</li><li>Define data governance frameworks, security protocols, and compliance standards</li><li>Lead platform evaluations, vendor selections, and technology roadmap planning</li></ul><p>
Technical Implementation:</p><ul><li>Architect data ingestion pipelines from diverse sources including databases, APIs, files, and streaming systems</li><li>Design and optimize ETL/ELT processes using SQL, Python, Spark, and Azure native services</li><li>Implement data quality frameworks, monitoring, and alerting systems</li><li>Establish CI/CD pipelines for data workflows and infrastructure as code</li></ul><p>
Integration &amp; Optimization:</p><ul><li>Design seamless integrations with BI tools, analytics platforms, and downstream systems</li><li>Optimize performance, cost, and scalability through automated resource management</li><li>Enable advanced analytics and machine learning capabilities on the platform</li><li>Lead data migration projects and platform modernization initiatives</li></ul><div></div><p><b><br>
Required Qualifications</b></p><p>
Technical Expertise:</p><ul><li>7+ years Azure data platform experience (Data Factory, Synapse Analytics, SQL Database, Storage)</li><li>Expert-level SQL, Python, and experience with Apache Spark (PySpark/Scala)</li><li>Strong understanding of data architecture patterns, data modeling, and distributed systems</li><li>Experience with Azure DevOps, ARM templates, and infrastructure automation</li><li>Knowledge of data governance tools and frameworks (Microsoft Purview preferred)</li></ul><p>
Platform Experience:</p><ul><li>Hands-on experience with modern data stack components and cloud-native architectures</li><li>RESTful API integration, real-time streaming, and batch processing systems</li><li>Enterprise data warehouse and analytics platform implementation</li><li>Performance tuning, cost optimization, and capacity planning experience</li></ul><div></div><p><b><br>
Leadership &amp; Communication:</b></p><ul><li>Proven ability to lead technical teams and mentor junior engineers</li><li>Experience presenting technical solutions to stakeholders at all levels</li><li>Strong documentation and knowledge transfer capabilities</li><li>Project management experience with data platform initiatives</li></ul><div></div><p><b><br>
Preferred Qualifications</b></p><ul><li>Microsoft Azure certifications (Data Engineer Associate, Solutions Architect Expert)</li><li>Experience with Microsoft Fabric and Power Platform integration</li><li>Machine learning and AI model deployment experience</li><li>Multi-cloud platform knowledge and cloud migration experience</li><li>Industry-specific data architecture experience (retail, financial services, healthcare)</li></ul><p></p><p><b><br>
About Us</b></p><p>
At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.</p></div></div></div><p></p>

Azure Data Platform Lead(India)

Search 10000+ Big data platform architect jobs near you this November. New roles added regularly across leading industries. Apply today.

10000 big data platform architect jobs NEAR_ME

Big Data Architect

Big Data Architect

Big Data Architect

Data Architect – Dynamic Pricing & Decision Intelligence Platform

Data Platform Architect

Principal Platform Engineer - Data & AI

Azure Data Platform Lead(India)