data pipeline developer

Amco IT Systems

<p><b>Job Title: Snowflake Developer</b></p><p><b>Location: Saudi Arabia</b></p><p><b>Experience: 3&ndash;5 years</b></p><p><b>Job Summary:</b></p><p>We&rsquo;re looking for a Snowflake Developer to build and optimize data pipelines and warehouse solutions. The ideal candidate should have hands-on experience with Snowflake architecture, strong SQL skills, and expertise in data modeling and workflow automation.</p><p><b>Key Responsibilities:</b></p><ul><li>Design and optimize Snowflake-based data pipelines.</li><li>Implement Snowpipe, Streams, Tasks, and Virtual Warehouses.</li><li>Automate workflows using Airflow or Luigi.</li><li>Integrate Snowflake with GCP and other cloud platforms.</li></ul><p><b>Requirements</b>:</p><ul><li>3&ndash;5 years&rsquo; experience in data engineering.</li><li>Strong SQL and data warehouse skills.</li><li>Proficiency in Snowflake and cloud integrations (preferably GCP).</li></ul><p>Job Type: Contract<br/>Contract length: 6 months</p><p>Ability to commute/relocate:</p><ul><li>Riyadh: Reliably commute or planning to relocate before starting work (Required)</li></ul><p>Application Question(s):</p><ul><li>What is your Nationality?</li><li>What is your notice period in days?</li><li>What is your current monthly salary?</li><li>What is your expected monthly salary in SAR?</li><li>How many years of experience do you have as a Snowflake developer?</li><li>Are you comfortable with 6 months contract (extendable)</li></ul><p>Language:</p><ul><li>Arabic (Required)</li></ul>

Snowflake Developr

Cambria

<div><div>Job Description:</div><div>
Cambria&rsquo;s internship program is a 12 week experience that successfully exposes interns to business need projects, professional development, assigned mentors and Cambria leaders. We help students identify their career interests and participate in two-way learning opportunities to develop their professional skill sets.</div><div></div><div>
Prepare to immerse yourself in a paid full-time, summer internship program that strives to provide cross-disciplinary work experiences. In the end, you will leave feeling accomplished, valuable and having made a difference.</div><div></div><div>
The Information Technology department is looking for a Data Developer Intern to join their team in Belle Plaine, MN!</div><div></div><div>
Position Summary:</div><div>
Cambria is seeking a passionate and driven Data Developer Intern to join our technical team. This is an exciting opportunity to influence the direction of data modernization and Artificial Intelligence within our operations.</div><div></div><div>
You will work directly with our data architects, application architects, and experienced data engineers, contributing to the integration of critical data assets and enabling the foundation for exceptional business insights. This role is designed for a motivated self-starter who is eager to learn and grow their skills among top technical talent in a tight-knit, collaborative environment.</div><div></div><div>
Essential Duties &amp; Responsibilities:</div><ul><li><div>
Complete and present a capstone project related to department business needs. This will include research, analysis, and presenting the overall findings and suggestions to peers and Cambria Leaders.</div></li><li><div>
Data Pipeline Support: Assist in the development, monitoring, and maintenance of data integration tools and processing pipelines.</div></li><li><div>
SQL Development: Learn to write and optimize SQL queries, views, and stored procedures to fulfill specific business requirements.</div></li><li><div>
AI/ML Exposure: Work alongside engineers to understand and support the implementation of foundational machine learning algorithms.</div></li><li><div>
Data Analysis &amp; Visualization: Participate in data analysis projects and utilize tools like Tableau or Grafana to develop initial visualizations.</div></li><li><div>
Documentation &amp; Quality: Support the maintenance of the data dictionary, contribute to metadata reports, and learn about data quality testing methodologies.</div></li><li><div>
Collaboration: Provide assistance and collaborate with Application Developers on integrating new data solutions.</div></li></ul><div></div><div>
Qualifications &amp; Skills:</div><ul><li><div>
Programming Fundamentals: Basic understanding of programming or scripting languages such as Python, JavaScript, or C#.</div></li><li><div>
Database Knowledge: Familiarity with relational databases (RDBMS) and the ability to write basic SQL queries (e.g., from coursework or personal projects).</div></li><li><div>
Conceptual Knowledge: General understanding of Data Warehousing concepts and basic data modeling principles.</div></li><li><div>
Communication: Excellent verbal and written communication skills with a strong team-oriented mindset.</div></li><li><div>
Learner Mindset: A successful candidate is a curious, lifelong learner who is motivated to continually improve their technical craft.</div></li></ul><div></div><div>
Minimum Requirements:</div><div>
Education: Currently pursuing a Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a closely related technical field. Expected graduation date of 2026, 2027, and 2028.</div><div>
Experience: Previous internship experience or relevant project-based work in a technical role is a plus.</div><div>
Systems: .NET, Oracle PL/SQL &amp; APEX, JavaScript, React, Python, GitLab</div><div></div><div>
Additional Requirements:</div><div>
Managerial Responsibilities: No</div><div>
Travel Requirements: Limited travel locally (Eden Prairie, Belle Plaine and Le Sueur)</div><div>
Physical Requirements: In-office position requiring telephone and computer use. Must be able to lift up to 30 pounds for displays, samples and other marketing materials</div><div>
Program Dates: May 18, 2025 - August 7, 2025; M-F; 40 hour work week</div><div></div><div>
This position pays $18.00 per hour and requires a daily in-office presence; please note that relocation and housing assistance are not provided. To ensure an efficient review process, candidates should apply to no more than 3 internship openings and are encouraged to check their email regularly for status updates. Due to the high volume of interest, we are unable to respond to individual inquiries regarding application status. Applications will be reviewed on a rolling basis until the position is filled or the window closes on February 15, 2026.</div><div></div><div>
Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.</div><div></div><div>
At Cambria, dedication to philanthropy and our people is at the heart of who we are. We strive to make a meaningful difference in the world every day by prioritizing employee well-being and fostering inclusivity and empowerment. Under the banner of <div>CambriaCares</div>, our philanthropic endeavors show our commitment to our people and our community to uplift kids, support education, and contribute to a sustainable future.</div><div></div><div>
For additional company information, please visit <div>www.CambriaUSA.com</div></div></div>

Data Developer Intern

Valtech Group

<div><p>Why Valtech? We&rsquo;re advisors, visionaries, creative and techies. We embrace all things digital. We talk to each other. We have fun. We love our clients. We&rsquo;re looking ahead &bull; We are global</p></div>
<br><p></p><div><p>We are seeking a skilled Data Engineer to join our growing data team in India. You will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines that enable data-driven decision making across our organization and client projects. This role offers the opportunity to work with cutting-edge technologies and contribute to innovative data solutions for global clients.</p><p>
What you do</p><p><b>
Technical Skills</b></p><ul>
<li><b>Minimum 3+ years</b> of experience in data engineering or related field</li>
<li>Strong programming skills in <b>Python</b> and/or <b>Scala/Java</b></li>
<li>Experience with <b>SQL</b> and database technologies (PostgreSQL, MySQL, MongoDB)</li>
<li>Hands-on experience with data processing frameworks:
</li><ul><li>Apache Spark, Hadoop ecosystem</li>
<li>Apache Kafka for streaming data</li>
<li>Apache Airflow or similar workflow orchestration tools</li>
</ul><li>Knowledge of data warehouse concepts and technologies</li>
<li>Experience with containerization (Docker, Kubernetes)</li>
<li>Understanding of data modeling principles and best practices</li>
</ul><p><b>
Cloud &amp; Platform Experience</b></p><ul>
<li>Experience with at least one major cloud platform (AWS, Azure, or GCP)</li>
<li>Familiarity with cloud-native data services:</li>
<li>Data lakes, data warehouses, and analytics services</li>
<li>Server less computing and event-driven architectures</li>
<li>Identity and access management for data systems</li>
<li>Knowledge of Infrastructure as Code (Terraform, CloudFormation, ARM templates)</li>
</ul><p><b>
Data &amp; Analytics</b></p><ul>
<li>Understanding of data governance and security principles</li>
<li>Experience with data quality frameworks and monitoring</li>
<li>Knowledge of dimensional modeling and data warehouse design</li>
<li>Familiarity with business intelligence and analytics tools</li>
<li>Understanding of data privacy regulations (GDPR, CCPA)</li>
</ul><p><b>
Preferred Qualifications</b></p><p><b>
Advanced Technical Skills</b></p><ul>
<li>Experience with modern data stack tools (dbt, Fivetran, Snowflake, Databricks)</li>
<li>Knowledge of machine learning pipelines and MLOps practices</li>
<li>Experience with event-driven architectures and microservices</li>
<li>Familiarity with data mesh and data fabric concepts</li>
<li>Experience with graph databases (Neo4j, Amazon Neptune)</li>
</ul><p><b>
Industry Experience</b></p><ul>
<li>Experience in digital agency or consulting environment</li>
<li>Background in financial services, e-commerce, retail, or customer experience platforms</li>
<li>Knowledge of marketing technology and customer data platforms</li>
<li>Experience with real-time analytics and personalization systems</li>
</ul><p><b>
Soft Skills</b></p><ul>
<li>Strong problem-solving and analytical thinking abilities</li>
<li>Excellent communication skills for client-facing interactions</li>
<li>Ability to work independently and manage multiple projects</li>
<li>Adaptability to rapidly changing technology landscape</li>
<li>Experience mentoring junior team members</li>
</ul><p>What we ask</p><p><b>
Data Infrastructure &amp; Architecture</b></p><ul>
<li>Design and implement robust, scalable data architectures and pipelines</li>
<li>Build and maintain ETL/ELT processes for batch and real-time data processing</li>
<li>Develop data models and schemas optimized for analytics and reporting</li>
<li>Ensure data quality, consistency, and reliability across all data systems</li>
</ul><p><b>
Platform-Agnostic Development</b></p><ul>
<li>Work with multiple cloud platforms (AWS, Azure, GCP) based on client requirements</li>
<li>Implement data solutions using various technologies and frameworks</li>
<li>Adapt quickly to new tools and platforms as project needs evolve</li>
<li>Maintain expertise across different cloud ecosystems and services</li>
</ul><p><b>
Data Pipeline Development</b></p><ul>
<li>Create automated data ingestion pipelines from various sources (APIs, databases, files, streaming)</li>
<li>Implement data transformation logic using modern data processing frameworks</li>
<li>Build monitoring and alerting systems for data pipeline health</li>
<li>Optimize pipeline performance and cost-efficiency</li>
</ul><p><b>
Collaboration &amp; Integration</b></p><ul>
<li>Work closely with data scientists, analysts, and business stakeholders</li>
<li>Collaborate with DevOps teams to implement CI/CD for data pipelines</li>
<li>Partner with client teams to understand data requirements and deliver solutions</li>
<li>Participate in architecture reviews and technical decision-making</li>
</ul><p>What we offer</p><p>
You&rsquo;ll join an international network of data professionals within our organisation. We support continuous development through our dedicated Academy. If you're looking to push the boundaries of innovation and creativity in a culture that values freedom and responsibility, we encourage you to apply.</p><p><i>
At Valtech, we&rsquo;re here to engineer experiences that work and reach every single person. To do this, we are proactive about creating workplaces that work for every person at Valtech. Our goal is to create an equitable workplace which gives people from all backgrounds the support they need to thrive, grow and meet their goals (whatever they may be). You can find out more about what we&rsquo;re doing to create a Valtech for everyone </i><i>here</i><i>.</i></p><div><i>
Please do not worry if you do not meet all of the criteria or if you have some gaps in your CV. We&rsquo;d love to hear from you and see if you&rsquo;re our next member of the Valtech team!</i></div></div>

Data Engineer

Cygnus Professionals

<p>Title: Palantir Foundry/AIP Developer</p><p>Location: Hyderabad (Hybrid) / Pune (Hybrid)</p><p>Full Time</p><p>Job Description</p><p>Core Responsibilities:</p><ul><li>Design and develop data pipelines and workflows within Palantir Foundry</li><li>Build and manage Ontology objects to enable semantic reasoning over data</li><li>Configure and maintain data integrations from various sources (JDBC, SFTP, APIs)</li><li>Write clean, efficient code using Python, Java, Scala, and SQL</li><li>Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions</li><li>Perform data quality checks and ensure reliability across Foundry applications</li><li>Participate in code reviews, agile ceremonies, and contribute to best practices</li><li>Troubleshoot and resolve issues in Foundry applications and pipelines</li></ul><p>Stay updated on Foundry features, AIP capabilities, and platform enhancements</p><p>Job Types: Full-time, Permanent</p><p>Pay: ₹1,375,459.53 - ₹2,097,548.79 per year</p><p>Benefits:</p><ul><li>Health insurance</li><li>Leave encashment</li><li>Provident Fund</li></ul><p>Work Location: In person</p>

Palantir Developer

IBS Software Services

<div><p>&acirc;&euro;&cent; Experience in developing and supporting Data Pipeline on Azure Data Factory
<br>
&acirc;&euro;&cent; Experience in developing and maintaining application on Big data technologies - Spark Framework, NoSQL, Azure Data Bricks and Hadoop Ecosystem- Hive, Impala, HDFS, YARN, Pig, Oozie etc
<br>
&acirc;&euro;&cent; Experience on Azure SQL DB &amp; Synapse Analytics, Power BI, SSIS, SSRS, T-SQL, Logic Ap
<br>
&acirc;&euro;&cent; Knowledge of Azure data lake is required and Azure Services like Analysis Service, Azure DevOps, CI/CD is a must.
<br>
&acirc;&euro;&cent; Knowledge and experience in design patterns, industry best practices and standards
<br>
&acirc;&euro;&cent; 5-8 years&acirc;&euro;&trade; experience following the Scrum methodology (certification is desirable)
<br>
&acirc;&euro;&cent; 5-8 years&acirc;&euro;&trade; experience in software development, including the full development life cycle
<br>
&acirc;&euro;&cent; 5-8 years&acirc;&euro;&trade; experience working in a fast paced software engineering environment
<br>
&acirc;&euro;&cent; Strong knowledge of front end design, development and testing
<br>
&acirc;&euro;&cent; Knowledge of SAFe is desirable</p></div>

Digital - Azure Developer

Etihad Credit Bureau

<div>
 <p>
  <strong>
   JOB DESCRIPTION SUMMARY
  </strong>
 </p>
 <p>
  <br/>
 </p>
 <p>
  This role will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring data flow across systems, and optimizing data infrastructure. You will collaborate with cross-functional teams, assist with production support, and drive process optimizations to ensure a seamless data ecosystem for business operations. Strong Databricks experience is a must.
 </p>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   KEY DUTIES &amp; RESPONSIBILITIES
  </strong>
 </p>
 <ul>
  <li>
   <strong>
    Data Pipeline Development:
   </strong>
   Design, build, and maintain robust data pipelines using Azure Data Factory (ADF), Azure Databricks, ADLS Gen 2 and PySpark, ensuring efficient data collection, processing, and storage from various sources.
  </li>
  <li>
   <strong>
    DataBricks Expertise:
   </strong>
   Have extensive experience working with DataBricks; including resource provisioning, understanding tools and modules available, and being able to share knowledge and expertise in DataBricks to contribute to optimization of this platform.
  </li>
  <li>
   <strong>
    Data Integration:
   </strong>
   Integrate data from multiple structured and unstructured sources, including APIs, third-party systems, and databases (SQL, Oracle), ensuring smooth data flow across the ecosystem.
  </li>
  <li>
   <strong>
    Data Warehousing:
   </strong>
   Design, develop, and optimize data lakes and warehouses on platforms like Databricks, Azure Synapse and ADLS, supporting analytics and reporting needs.
  </li>
  <li>
   <strong>
    ETL/ELT Development:
   </strong>
   Develop and optimize ETL processes for efficient data extraction, transformation, and loading, using tools like ADF and custom pipelines.
  </li>
  <li>
   <strong>
    Process Optimization:
   </strong>
   Automate and streamline data workflows (incremental loads, email notifications, pipeline runs) to enhance system performance and reduce costs.
  </li>
  <li>
   <strong>
    Production Support &amp; Resolution
   </strong>
   : Troubleshoot and resolve production failures within SLAs, ensuring minimal downtime and high data availability. Provide support during business hours and extended hours, (and if critical P1 failures on weekends in rotation with others), as required.
  </li>
  <li>
   <strong>
    Go-Live &amp; Project Support
   </strong>
   : Support the successful migration and implementation of new code and solutions. Utilizing Azure DevOps CI/CD.
  </li>
  <li>
   <strong>
    Team Management
   </strong>
   : Lead and manage vendor staff, ensuring smooth execution of projects or operations support as assigned. Ensuring SLAs or project milestones are met on time, and providing mentorship to junior team members.
  </li>
  <li>
   <strong>
    Innovation &amp; Optimization
   </strong>
   : Design scalable, high-performance data architectures and promote innovation, cost-efficiency, and operational excellence.
  </li>
  <li>
   <strong>
    Documentation &amp; Knowledge Transfer
   </strong>
   : Create and maintain clear documentation for processes, operations, and technical solutions, including knowledge transfer documents and data catalogue updates.
  </li>
  <li>
   <strong>
    Monitoring &amp; System Oversight
   </strong>
   : Monitor system performance, identify opportunities for optimization, and ensure platform scalability to meet future needs.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   EDUCATION &amp; SKILLS
  </strong>
 </p>
 <ul>
  <li>
   Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field
  </li>
  <li>
   Proven experience working with cloud-based infrastructure, particularly Azure
  </li>
  <li>
   Proven experience working with DataBricks.
  </li>
  <li>
   Experience with containerization tools (Docker, Kubernetes) and CI/CD pipelines
  </li>
  <li>
   Proficient in English
  </li>
  <li>
   Preferred proficiency in Arabic
  </li>
  <li>
   Preferred knowledge of machine learning workflows and model deployment
  </li>
  <li>
   Proficiency in Russian, Turkish and Central Asian languages is a plus.
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   EXPERIENCE &amp; KNOWLEDGE
  </strong>
 </p>
 <ul>
  <li>
   6+ years of experience in data engineering, production support, and pipeline management
  </li>
  <li>
   Cloud Platforms: ADLS Gen 2, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and DevOps, Azure Key Vault
  </li>
  <li>
   Programming/Querying: Python, PySpark, SQL
  </li>
  <li>
   Automation &amp; Monitoring: Custom automation tools, failure email triggers, performance monitoring solutions
  </li>
  <li>
   Preferred experience in project management
  </li>
  <li>
   Excellent leadership, communication, and problem-solving skills is a plus
  </li>
 </ul>
 <p>
  <br/>
 </p>
 <p>
  <strong>
   ABILITIES &amp; SPECIFIC REQUIREMENTS
  </strong>
 </p>
 <ul>
  <li>
   Handles diverse tasks and meets deadlines under pressure
  </li>
  <li>
   Works independently and responsibly
  </li>
  <li>
   Skilled negotiator with vendors
  </li>
  <li>
   Executes clear strategies aligned with corporate goals
  </li>
  <li>
   Communicates effectively with technical and non-technical audiences
  </li>
  <li>
   Leads professionally and fosters teamwork
  </li>
  <li>
   Manages change and adapts quickly with critical thinking
  </li>
  <li>
   Applies systematic problem-solving and agile decision-making
  </li>
  <li>
   Promotes collaboration, innovation, transparency, and accountability
  </li>
 </ul>
</div>


Senior Specialist - Data Engineering

Virtusa

<div>Data Pipeline Development
<br>
Design develop and maintain efficient reliable and reusable ETLELT pipelines using DBT Snowflake and related technologies
<br>
<br>
Data Modeling
<br>
Build and optimize data models star snowflake schemas to support analytical and reporting use cases ensuring data quality accuracy and performance
<br>
<br>
Data Integration
<br>
Integrate data from multiple sources APIs databases SaaS platforms cloud storage into Snowflake using modern data ingestion tools and frameworks
<br>
<br>
Performance Optimization
<br>
Tune SQL queries manage compute resources and optimize Snowflake performance for scalability and cost efficiency
<br>
<br>
Data Governance Quality
<br>
Implement data validation testing and monitoring processes to ensure high data quality and consistency across environments
<br>
<br>
Collaboration
<br>
Partner with data analysts data scientists and business teams to understand requirements define transformations and deliver highquality datasets
<br>
<br>
Automation CICD
<br>
Contribute to automation version control and deployment best practices using Git CICD pipelines and DBT Cloud or similar
<br>
<br>
Documentation
<br>
Maintain clear comprehensive documentation for pipelines data models and workflows
<br>
<br>
Required Skills Qualifications
<br>
Education Bachelors degree in computer science Information Technology Engineering or related field
<br>
Experience 710 years in data engineering with at least 3 years of handson experience in Snowflake and DBT
<br>
<br>
Technical Expertise
<br>
Strong SQL skills and experience in building complex transformations
<br>
Proficiency in Snowflake architecture warehouses micropartitioning clustering query optimization etc
<br>
Deep understanding of DBT models macros testing documentation version control
<br>
Experience with cloud platforms such as AWS Azure or GCP eg S3 Lambda Cloud Storage
<br>
Familiarity with Python or Scala for data engineering workflows
<br>
Knowledge of orchestration tools such as Airflow Dagster or Prefect
<br>
Experience with Git CICD and deployment automation
<br>
<br>
Preferred Skills
<br>
Exposure to data warehousing concepts data lake architectures and realtime streaming Kafka Kinesis etc
<br>
Familiarity with BI tools such as Looker Power BI or Tableau
<br>
Knowledge of data governance security and compliance standards GDPR HIPAA etc
<br>
Experience working in an Agile environment
<br>
<br>
Key Attributes
<br>
Strong analytical and problemsolving skills
<br>
Excellent communication and collaboration abilities
<br>
Proactive mindset with attention to detail
<br>
Ability to work in fastpaced crossfunctional environments.<div><p><b>
About Virtusa</b></p>
<p>Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth &mdash; one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.</p>
<p>Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.</p>
<p>Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.</p></div></div><p></p>

Snowflake DBT

Search 10000+ Data pipeline developer jobs near you this January. New roles added regularly across leading industries. Apply today.