data engineer

Darkroom

<div>Data Engineer | Matter
About the Role
We are seeking an experienced Senior Data Engineer. You&rsquo;ll work closely with our CTO, CPO, and product teams to architect, build, and deliver robust data pipelines and transformations for our always-on AI platform. Success in this role will have a direct, measurable impact on business outcomes and future product velocity.
Key Responsibilities<ul><li>
Architect, build, and optimize scalable end-to-end data pipelines using dbt and our stack (Python microservices, Postgres, BigQuery, and GCP).</li><li>
Design, implement, and maintain ETL/ELT processes to ingest, clean, and transform large datasets from a variety of sources.</li><li>
Collaborate with product and engineering to define data requirements for new product features and analytics initiatives.</li><li>
Manage our data pipeline by onboarding new clients, loading their data, and applying all required formulas.</li><li>
Maintain and troubleshoot workflows by fixing broken formulas, adding new services, and ensuring reliable, high-throughput performance.</li><li>
Ensure data reliability, integrity, and security at scale.</li><li>
Troubleshoot, performance-tune, and document all pipelines and data workflows for smooth handoff.</li></ul>
About You<ul><li>
5+ years of hands-on experience building production-grade data pipelines, ETL/ELT workflows, and transformed datasets at scale.</li><li>
Expert-level Python; strong experience with dbt, Postgres, BigQuery, and core GCP data services (e.g., Dataflow, Pub/Sub, Storage, Composer).</li><li>
Demonstrated experience architecting, optimizing, and troubleshooting cloud-based data infrastructure.</li><li>
Familiarity with analytics, BI tools, and data visualization platforms is a plus.</li><li>
Startup or contract/consulting experience strongly preferred; you move quickly and commit to clear deliverables and deadlines.</li><li>
Excellent communication skills: you read requirements carefully, keep stakeholders looped in, and document as you go. You can boil down complex tasks into plain english for non-data engineers to understand.</li><li>
Low-ego, high-ownership, and passionate about building product-focused solutions.</li></ul></div>

Data Engineer

COZMALABS

We are seeking an experienced Data Engineer to join our team on a full-time basis. The ideal candidate will have a strong background in designing, building, and optimizing data pipelines, with a particular focus on enabling AI-driven solutions. This role involves close collaboration with software and AI engineering teams to ensure seamless, reliable data flows and robust cloud-based data integration within Microsoft Azure.Key Responsibilities<ul><li>Design, develop, and maintain scalable data pipelines and ETL processes to support AI initiatives.</li><li>Build and optimize data infrastructure to ensure efficient data management, processing, and storage in Azure cloud environments.</li><li>Collaborate with AI engineers to prepare, structure, and deliver high-quality datasets for machine learning models.</li><li>Ensure data pipelines meet security, reliability, and performance standards.</li><li>Monitor, troubleshoot, and improve pipeline performance to guarantee timely and accurate data delivery.</li><li>Implement data governance practices and ensure compliance with data security policies.</li></ul>Required Qualifications<ul><li>Proven experience as a Data Engineer, particularly in building and maintaining complex pipelines for AI or machine learning projects.</li><li>Strong proficiency in SQL and hands-on experience with relational databases (PostgreSQL, SQL Server) and NoSQL systems (e.g., MongoDB).</li><li>Expertise in Azure-based data solutions such as Azure Data Factory, Azure Synapse, and Azure Databricks.</li><li>Experience with data integration and orchestration tools (e.g., Apache Airflow).</li><li>Proficiency in at least one programming language for data workflows (e.g., Python).</li><li>Solid understanding of data warehousing concepts and best practices.</li><li>Strong analytical and problem-solving abilities.</li><li>Bachelor&rsquo;s degree in Computer Science, Engineering, or a related field.</li><li>Proficiency in English, both written and spoken.</li></ul>Desirable Qualifications<ul><li>Familiarity with machine learning concepts and data preprocessing techniques.</li><li>Knowledge of containerization technologies such as Docker and Kubernetes for deploying data pipelines.</li></ul>Job Type: Full-time

Data Engineer.

ZecData Technology

Job Description: Data EngineerPosition: Data Engineer Location: Indore Experience: 0-7 Employment Type: Full-TimeJob Summary:We are looking for a skilled Data Engineer to design, develop, and maintain data pipelines, ensuring efficient data processing, storage, and retrieval for business analytics and decision-making. The ideal candidate will have strong experience in working with large-scale data systems, ETL processes, and cloud-based platforms.Key Responsibilities:<ul><li>Data Pipeline Development:</li><li>Design, build, and maintain scalable, reliable, and efficient data pipelines to process and integrate data from various sources.</li><li>Ensure the timely and accurate flow of data across systems.</li><li>Data Architecture:</li><li>Develop and optimize data models and architectures for data warehouses, data lakes, and databases.</li><li>Collaborate with data scientists, analysts, and other stakeholders to ensure data accessibility.</li><li>ETL/ELT Processes:</li><li>Design and implement ETL/ELT workflows to extract, transform, and load data from diverse sources into target systems.</li><li>Monitor and troubleshoot ETL processes to maintain data integrity.</li><li>Data Governance:</li><li>Implement data quality checks, validation processes, and monitoring to ensure accuracy and consistency.</li><li>Ensure compliance with data privacy regulations and organizational policies.</li><li>Cloud &amp; Big Data Platforms:</li><li>Work with cloud-based tools (AWS, Azure, GCP) and big data technologies (Hadoop, Spark) for data storage and processing.</li><li>Optimize performance and cost-effectiveness of cloud-based data solutions.</li><li>Collaboration:</li><li>Partner with software engineers, data analysts, and business teams to identify and fulfill data requirements.</li><li>Provide support for ad-hoc data requests and troubleshoot data issues.</li></ul>Key Skills and Qualifications:<ul><li>Technical Skills:</li><li>Proficiency in programming languages such as Python, Java, or Scala.</li><li>Strong knowledge of SQL and database systems (e.g., PostgreSQL, MySQL, MongoDB).</li><li>Hands-on experience with ETL tools (e.g., Apache NiFi, Talend, Informatica).</li><li>Familiarity with big data technologies like Hadoop, Spark, and Kafka.</li><li>Experience with cloud platforms (AWS, GCP, Azure) and related services (e.g., S3, Redshift, BigQuery).</li><li>Analytical Skills:</li><li>Solid understanding of data modeling and database design principles.</li><li>Ability to analyze and interpret large data sets to solve business problems.</li><li>Other Skills:</li><li>Strong problem-solving and debugging skills.</li><li>Excellent communication and teamwork abilities.</li><li>A keen eye for detail and commitment to delivering high-quality work.</li></ul>Job Types: Full-time, Permanent, FresherPay: &#8377;25,000.00 - &#8377;50,000.00 per monthBenefits:<ul><li>Cell phone reimbursement</li><li>Paid sick time</li><li>Provident Fund</li></ul>Experience:<ul><li>total work: 1 year (Preferred)</li></ul>Work Location: In person

SB Infowaves

We are seeking a skilled Data Engineer (Good exposure in Power BI) to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will work closely with data analysts, data scientists, and business stakeholders to ensure data is reliable, accessible, and efficient for analytics and decision-making.Key Responsibilities<ul><li>Design, develop, and maintain robust ETL/ELT pipelines for structured and unstructured data.</li><li>Build and manage data warehouses, data lakes, and real-time data platforms.</li><li>Ensure data quality, consistency, and security across all data systems.</li><li>Optimize database performance and implement best practices for scalability and reliability.</li><li>Collaborate with data analysts, BI developers, and data scientists to understand data needs.</li><li>Automate workflows, monitoring, and error handling in data pipelines.</li><li>Work with cloud platforms (AWS, Azure, GCP) and modern data tools to deliver end-to-end solutions.</li><li>Implement governance standards and contribute to data documentation.</li></ul>Required Skills &amp; Qualifications<ul><li>Bachelor&rsquo;s/Master&rsquo;s degree in Computer Science, Information Systems, or related field.</li><li>Proven experience as a Data Engineer / ETL Developer / Database Engineer.</li><li>Strong knowledge of SQL, Python, and/or Scala/Java.</li><li>Hands-on experience with data integration tools (e.g., Apache Spark, Kafka, Airflow, Talend, Informatica).</li><li>Proficiency in cloud data services: AWS Redshift, Azure Synapse, Google BigQuery, or Snowflake.</li><li>Solid understanding of data modeling, warehousing concepts, and big data technologies (Hadoop, Hive, etc.).</li><li>Experience with CI/CD pipelines, Git, Docker, Kubernetes is a plus.</li><li>Excellent problem-solving, analytical, and communication skills.</li></ul>Job Type: Full-timePay: &#8377;600,000.00 - &#8377;900,000.00 per yearExperience:<ul><li>Data Engineer: 3 years (Preferred)</li></ul>Work Location: In person

Halan - حالا

<div>
 
 Job Overview:
 
 
 We are seeking a talented and motivated Senior Data Engineer with expertise in Scala and Python to join our data engineering team. This individual will play a key role in the design, development, and optimization of our data infrastructure and data pipelines. The ideal candidate has a passion for building scalable, high-performance systems and is eager to broaden their knowledge across the entire data engineering stack, from hardware infrastructure to project development.
 
 
 Key responsibilities:
 
 
 &bull; Collaborate with cross-functional teams to design, develop, and maintain data engineering solutions using Scala, Python, and Apache Spark.
 
 
 &bull; Implementation of new data engineering technologies, frameworks, and tools, such as HDFS, MongoDB, and PostgreSQL, to enhance performance, scalability, and efficiency.
 
 
 &bull; Understand and optimize hardware and resource consumption for data engineering projects.
 
 
 &bull; Develop a deep understanding of hardware infrastructure, including servers, clusters, and distributed systems, to ensure optimal data processing and storage.
 
 
 &bull; Design and architect high-performance, fault-tolerant, and scalable data pipelines.
 
 
 &bull; Conduct research and stay current with the latest advancements in data engineering, hardware technologies, and distributed computing paradigms.
 
 
 &bull; Mentor and guide junior team members, fostering a culture of continuous learning and skill development.
 
 
 &bull; Collaborate with stakeholders to gather requirements, propose technical solutions, and deliver high-quality data engineering projects.
 
 
 Requirements:
 
 
 &bull; 2-3 years of professional experience as a Software Engineer, with a focus on data engineering.
 
 
 &bull; Keen interest in hardware infrastructure, resource consumption optimization, and data engineering project development.
 
 
 &bull; Proven ability to work effectively in an Agile development environment and manage multiple priorities.
 
 
 &bull; Strong problem-solving, analytical thinking, communication, and collaboration skills.
 
</div>

Bilight Solutions

Job Title: Data Engineer (2-3 Years Experience)Location: ChennaiWork Mode: Full-time, Work From Office (9:30 AM &ndash; 6:30 PM)Availability: Immediate JoinersContact: 9384854315 (Reshma C - HR Executive)About the Role:We are looking for a highly skilled Data Engineer to join our delivery team. The role involves building robust, scalable, and secure data pipelines that power analytics and reporting. The ideal candidate will have strong experience in cloud platforms, ETL frameworks, and big data tools, and will work closely with analysts, business teams, and clients to ensure the timely delivery of clean, high-quality data for strategic insights and decision-making.Key Responsibilities:&#10003; Design and build scalable ETL/ELT pipelines for structured and unstructured data.&#10003; Develop data infrastructure using cloud services (AWS Glue, S3, Redshift, etc.).&#10003; Optimize data storage, processing, and query performance using PySpark or similar tools.&#10003; Implement and maintain data security, governance, and access control mechanisms.&#10003; Monitor and troubleshoot pipeline performance to ensure high availability and reliability.&#10003; Collaborate with business and analytics teams to understand and meet data requirements.&#10003; Ensure seamless integration of data from internal and external sources.&#10003; Create clear technical documentation for pipelines, workflows, and architecture.&#10003; Participate in client meetings, provide status updates, and highlight risks or blockers.&#10003; Drive automation, standardization, and process improvements across data engineering functions.Skills &amp; Qualifications:<ul><li>Programming: Strong in SQL, Python, or Scala</li></ul><ul><li>Big Data: Experience with PySpark, Spark, or Hadoop</li></ul><ul><li>Cloud Platforms: Hands-on with AWS, Azure, or GCP (Glue, S3, Redshift, BigQuery, etc.)</li></ul><ul><li>ETL Tools: Familiarity with Airflow, Azure Data Factory, or other orchestration tools</li></ul><ul><li>DevOps &amp; CI/CD: Experience with Git, pipeline automation, and deployment tools</li></ul><ul><li>Security &amp; Governance: Knowledge of data compliance and best practices</li></ul><ul><li>Monitoring Tools: Experience with CloudWatch, Prometheus, or Datadog</li></ul><ul><li>Education: Bachelor's degree in computer science, Engineering, or related field</li></ul><ul><li>Certifications: AWS/Azure/GCP cloud certifications are a plus</li></ul>Experience:&#10003; 2&ndash;3 years of experience in Data Engineering or similar roles&#10003; Strong experience in building cloud-based data pipelines and real-time data processingJob Types: Full-time, PermanentPay: &#8377;450,000.00 per yearBenefits:<ul><li>Health insurance</li><li>Provident Fund</li></ul>Work Location: In person

Xohani Solutions

Role: Data Engineer Location: Onsite/Bangalore Experience: 5&ndash;8 years Candidate must be local to Bangalore - interviews will be virtualAWS + Databricks Requirement Mandatory Skills:<ul><li>Databricks (3+ yrs): ETL/ELT with PySpark, Auto Loader, Structured Streaming, Delta Live Tables, Medallion Architecture, CI/CD integration. Databricks SQL Endpoints</li><li>AWS (5+ yrs): Glue, Lambda, CloudWatch, CloudTrail, IAM security best practices.</li><li>Governance &amp; Advanced: Unity Catalog, policy enforcement (Immuta/Privacera), AI/ML pipeline integration.</li></ul>Job Type: Full-timePay: &#8377;1,600,000.00 - &#8377;2,200,000.00 per yearWork Location: In person

Search 10000+ Data engineer jobs near you this December. New roles added regularly across leading industries. Apply today.

10000 data engineer jobs NEAR_ME

Data Engineer

Data Engineer.

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer