data analyst

data architect

data engineer

devops engineer

ai engineer

data pipeline engineer

Systems Limited

<div><p>The candidate will be responsible for designing, building, and managing data infrastructure and pipelines to support analytics and machine learning initiatives. This role involves working closely with data scientists, analysts, and other teams to ensure data integrity, optimize data processing, and create robust data solutions</p><br>
<p></p>
<p><b>
Responsibilities:</b></p>
<ul>
<li>Design, develop, and optimize data pipelines and workflows to gather, clean, and process large datasets.</li>
<li>Build scalable and reliable data models that support analytics and reporting needs.</li>
<li>Develop and maintain ETL processes to collect, store, and retrieve data efficiently.</li>
<li>Collaborate with data scientists and analysts to define and implement data requirements.</li>
<li>Implement data quality checks and monitoring processes to ensure data integrity.</li>
<li>Maintain and optimize data infrastructure, ensuring high availability and performance.</li>
<li>Integrate data from various sources and manage data storage solutions in cloud and on-premise environments.</li>
<li>Document data architecture, pipelines, and ETL processes.</li></ul><br>
<p></p>
<p><b>
Requirements:</b></p>
<ul>
<li>Bachelor&rsquo;s degree in Computer Science, Data Science, Engineering, or a related field.</li>
<li>Proven experience as a Data Engineer or similar role.</li>
<li>Proficiency in SQL, Python, and ETL tools.</li>
<li>Experience with data storage systems such as SQL databases, data lakes, and warehouses.</li>
<li>Strong knowledge of cloud platforms like AWS, Azure, or GCP.</li>
<li>Familiarity with big data technologies (e.g., Hadoop, Spark).</li>
<li>Knowledge of data modeling, data architecture, and data warehousing</li></ul></div>

Data Engineer

<div><p>We are seeking an experienced Data Engineer with hands-on expertise in building and optimizing data pipelines and workflows. The ideal candidate will have strong experience with Azure Data Factory, Microsoft Fabric, and PySpark.</p>
<p><b>
Responsibilities:</b></p>
<ul>
<li><p>Design, develop, and maintain scalable data pipelines using Azure Data Factory.</p>
</li>
<li><p>Work with Microsoft Fabric to enhance data warehousing and analytics capabilities.</p>
</li>
<li><p>Develop and optimize ETL processes using PySpark.</p>
</li>
<li><p>Ensure data integrity, quality, and availability across systems.</p>
</li>
<li><p>Collaborate with cross-functional teams including data scientists, analysts, and product managers.</p>
</li>
<li><p>Monitor and troubleshoot data workflows to ensure optimal performance and reliability.</p>
</li>
<li><p>Maintain documentation and follow best practices in data engineering.</p></li></ul><br>
<p>
</p><h3 class="jobSectionHeader"><b>Requirements:</b></h3>
<ul>
<li><p>Bachelor&rsquo;s degree in Computer Science, Engineering, or a related field.</p>
</li>
<li><p>5+ years of experience in data engineering or similar roles.</p>
</li>
<li><p>Proven expertise in Azure Data Factory</p>
</li>
<li><p>Hands-on experience with Microsoft Fabric.</p>
</li>
<li><p>Proficiency in PySpark and distributed data processing.</p>
</li>
<li><p>Strong understanding of data warehousing concepts and cloud architecture.</p>
</li>
<li><p>Excellent problem-solving and communication skills.</p>
</li>
<li><p>Ability to work independently and within a team environment.</p></li></ul></div>

Senior Consultant Data Analytics

Xynotech

<p>We&rsquo;re looking for a hands-on <b>Data Engineer</b> to join our team and lead the development of robust data pipelines powering the IllumiFi Analytics platform. You&rsquo;ll work with cutting-edge, cloud-native tools to architect, implement, and optimize serverless data solutions on AWS.</p><p>If you enjoy working with Python, PySpark, and modern data lakehouse patterns in a fast-paced environment &mdash; this is your opportunity to build impactful solutions from the ground up.</p><p><b>What You&rsquo;ll Actually Do Here</b></p><ul><li>Design and implement scalable, serverless data pipelines using AWS services such as <b>Glue, Lambda, Step Functions, Athena, and S3</b></li><li>Build and optimize ETL processes using <b>Python/PySpark</b> for efficient data transformations</li><li>Ingest and process structured and semi-structured data formats including <b>JSON, Parquet, and CSV</b></li><li>Integrate with external APIs using <b>REST protocols and OAuth2 authentication</b></li><li>Model analytical datasets with <b>star/snowflake schemas</b>, implement <b>SCD Type 2</b>, and define <b>partitioning strategies</b> for efficient query performance</li><li>Build and maintain a well-organized <b>S3-based data lake</b> structure to support analytics workloads</li><li>Apply best practices for <b>version control</b>, data quality, and automation using <b>GitHub workflows</b></li><li>Drive technical design discussions and contribute to improving infrastructure, tooling, and data processes</li></ul><p><b>What We&rsquo;re Looking For</b></p><ul><li>2+ years of experince in Data Engineering</li></ul><p>Strong hands-on experience with <b>AWS services</b> &mdash; especially <b>Glue, Lambda, S3, Step Functions, and Athena</b></p><ul><li>Solid command of <b>Python/PySpark</b> for building and managing ETL pipelines</li><li>Proven track record working with large-scale datasets and optimizing performance</li><li>Deep understanding of <b>data modeling</b>, transformations, and <b>SQL</b> for analytical use cases</li><li>Familiarity with <b>REST APIs</b>, OAuth2 authentication, and data integration patterns</li><li>Experience with <b>Git</b>, <b>CI/CD</b>, and workflow automation</li><li>A problem-solving mindset and a passion for scalable, efficient data engineering</li><li>Ability to work independently and collaborate across teams</li></ul><p><b>Tools &amp; Platforms</b></p><ul><li><b>Languages &amp; Frameworks</b>: Python, PySpark</li><li><b>Cloud &amp; Tools</b>: AWS Glue, Lambda, S3, Step Functions, Athena</li><li><b>Data Formats</b>: JSON, Parquet, CSV</li><li><b>Modeling &amp; Querying</b>: SQL, Star/Snowflake schemas</li><li><b>Version Control</b>: Git, GitHub workflows</li></ul><p><b>Nice-to-Haves</b></p><ul><li>Experience with <b>Apache Iceberg or Hudi</b> for data lakehouse architectures</li><li>Knowledge of <b>data quality frameworks</b> like Great Expectations</li><li>Familiarity with <b>Terraform/IaC</b> for infrastructure automation</li><li>Background in <b>e-commerce or analytics platforms</b></li><li>Exposure to <b>performance tuning</b> for large data workloads</li><li>Hands-on with <b>Step Functions HTTP Task</b></li></ul><p>Job Type: Full-time</p><p>Education:</p><ul><li>Bachelor's (Required)</li></ul><p>Experience:</p><ul><li>Data Engineering: 2 years (Required)</li></ul><p>Location:</p><ul><li>Karachi (Required)</li></ul><p>Work Location: In person</p>

Contour Software

<div><div>About Contour</div><div></div><div><div>
Contour Software</div> has grown from a dozen people to over 2,000 staff across 3 cities, in less than 14 years.</div><div><br>
As a subsidiary of Constellation Software Inc., we are proud to be part of a global enterprise software conglomerate that has grown to become one of the top 10 software companies in the world, with employees and customers in 100+ countries. With a broad-based and ever-growing portfolio of market-leading, vertical-market enterprise solutions covering more than 100 industry domains in predominantly mature markets, CSI's recipe creates the perfect environment for professionals to build fulfilling, long-term careers.</div><div><br>
What started as an R&amp;D &amp; Accounting back-office, has progressed into a full-service Global Centre serving all functions and departments, at the divisional as well as operating group/corporate level. Today Contour employees, located in Karachi, Lahore &amp; Islamabad, are serving CSI divisions located in time zones spanning the globe, from Sydney to Vancouver. With the global growth of Constellation as the wind in our sails, we are only just getting started!</div><div></div><div>
The Division:<br>
<br>
At CSIPay, a Jonas company, we are dedicated to empowering Constellation&rsquo;s six operating groups in the USA and Canada with seamless payment processing solutions. Our goal is to give you greater control over your revenue, enhance your market potential, and improve customer satisfaction, fostering success for all within the Constellation family.</div><div><br>
The Position:<br>
<br>
We are looking for Data Engineers to join our development team and participate in different projects. We are looking for proactive people, team players passionate about technology and big data. This is an excellent opportunity for those professionals looking to develop in one of the fastest growing areas of software development.</div><div><br>
The selected individuals will work out of the Contour Software Lahore/Karachi/Islamabad resource center office, as an extension of the division-based R&amp;D department.</div><div><br>
Role and Responsibilities include but not limited to:<br>
<br>
<ul><li>Write efficient queries to extract and analyze large datasets while ensuring seamless systems integration by developing robust data workflows.</li><li>Design, develop, and maintain scalable ETL solutions for data pipelines, enhancing and optimizing existing processes to meet evolving business needs.</li><li>Develop and expand the organization&rsquo;s data technology stack to support advanced data processing and analytics needs, leveraging tools like AWS MapReduce and PySpark for big data handling.</li><li>Apply machine learning techniques to clean and process data, supporting future initiatives to integrate machine learning into analytics workflows.</li><li>Continuously evaluate and adopt the most efficient tools and technologies for data extraction, transformation, analysis, and integration.</li><li>Build a strong understanding of customer business needs to deliver tailored and impactful data solutions, collaborating with stakeholders to translate business requirements into technical implementations.</li><li>Utilize AWS services, including MapReduce and related tools, to enable scalable data processing and pipeline optimization while ensuring security, scalability, and cost-efficiency.</li><li>Monitor and improve the performance of data systems and processes, staying updated on industry trends and emerging technologies in data engineering and analytics.</li></ul>
Required Skills:<br>
<ul><li>Minimum 3 years of experience with AWS cloud data lake architectures including services like S3, Glue, Athena, and Redshift.</li><li>Hands on experience with Apache Airflow for designing and managing complex data workflows.</li><li>Deep understanding of data warehouse concepts, architectures, and structures.</li><li>Expertise in cloud technologies, particularly AWS services, including AWS Glue, AWS Data Lake, and Amazon EMR for big data processing.</li><li>Proven ability to design and build robust, scalable data pipelines for big data processing and transformation.</li><li>Hands-on experience with big data tools and frameworks such as PySpark, Databricks, and related technologies.</li><li>Proficiency in programming languages such as Python for data manipulation, transformation, and analysis. Advanced Python development skills, including experience with AWS SDKs (e.g. boto3) for interacting with cloud services.</li><li>Proficiency in Apache Kafka for real-time data streaming and event-driven architectures.</li><li>Strong SQL skills with a focus on complex query development and optimization. Familiarity with NoSQL databases such as DynamoDB or MongoDB</li><li>Experience integrating Python applications with RESTful APIs and external services</li><li>Deep understanding of data security best practices, including encryption at rest and in transit. Hands-on experience in implementing AWS KMS (Key Management Services) for managing encryption keys.</li><li>Familiarity with IAM policies, VPC configurations, and security groups for securing data pipelines.</li><li>Familiarity with machine learning concepts and their application to data cleaning and integration tasks.</li><li>Advanced English proficiency, with excellent communication skills for collaborating with stakeholders</li></ul></div><div>
Exciting Benefits we offer:</div><ul><li><div>
Market-leading Salary</div></li><li><div>
Medical Coverage &ndash; Self &amp; Dependents</div></li><li><div>
Parents Medical Coverage</div></li><li><div>
Provident Fund</div></li><li><div>
Employee Performance-based bonuses</div></li><li><div>
Home Internet Subsidy</div></li><li><div>
Conveyance Allowance</div></li><li><div>
Profit Sharing Plan [Tenured Employees Only]</div></li><li><div>
Life Benefit</div></li><li><div>
Child Care Facility</div></li><li><div>
Company Provided Lunch/Dinner</div></li><li><div>
Professional Development Budget</div></li><li><div>
Recreational area for in-house games</div></li><li><div>
Sporadic On-shore training opportunities</div></li><li><div>
Friendly work environment</div></li><li><div>
Leave Encashment</div></li></ul><div></div><div><i>
Disclaimer:</i><i> At Contour, we attribute our success to the unique contributions of our diverse staff. We&rsquo;re committed to fostering a culture of respect that thrives on the varied perspectives and experiences of all individuals we recruit, employ, promote, and compensate. Since day one, we&rsquo;ve adhered to a policy that champions a work environment honoring the worth and dignity of each person while being free from all forms of employment discrimination.</i></div><div></div><div><i>
In our continuous effort to promote inclusivity, we extend our commitment to individuals with special needs by providing reasonable accommodations. We actively encourage qualified individuals with special needs to apply for the various openings within our company. Should you require assistance in completing the application process or have any inquiries regarding special facilities, please do not hesitate to contact our HR team. Your unique talents and abilities are welcomed and valued here.</i></div></div><div></div>

office field software house

<p>Office Field is looking for a diligent and experienced Data Architect to join our team</p><p><b>Responsibilities</b>:</p><ul><li>Design and implement effective database solutions for stock, crypto, and financial data.</li></ul><ul><li>Establish best practices in architecture, design, and development.</li></ul><ul><li>Perform SQL tuning and optimize database responsiveness.</li></ul><ul><li>Use Snowflake to support high-frequency data ingestion and enhance data quality.</li></ul><ul><li>Implement and maintain ETL workflows with Airflow and Snowflake.</li></ul><ul><li>Ensure software quality, security, and modifiability.</li></ul><ul><li>Address data challenges in PostgreSQL and MongoDB databases.</li></ul><ul><li>Optimize ETL workflows using Apache Airflow.</li></ul><p><b>Requirements</b>:</p><ul><li>Bachelor&rsquo;s degree in Computer Science or related field.</li></ul><ul><li>6+ years&rsquo; experience in similar roles.</li></ul><ul><li>Proficiency in Firebase, MongoDB, MySQL, Hadoop, Firehose, and PostgreSQL.</li></ul><ul><li>Experience with Snowflake or similar cloud data warehousing.</li></ul><ul><li>Knowledge of API frameworks like FastAPI and real-time data ingestion.</li></ul><ul><li>Familiarity with AWS and GCP.</li></ul><ul><li>Extensive experience with Apache Airflow for data pipelines.</li></ul><p>Job Type: Full-time</p><p>Experience:</p><ul><li>Python: 1 year (Preferred)</li><li>Data Science: 1 year (Preferred)</li></ul><p>Work Location: In person</p>

Data Architect

Squarera

<p>We are looking for a Jr. Data Engineer who has a strong foundation in SQL and a passion for data. You will work with our data team to build and maintain pipelines, support data modeling, and contribute to the overall data architecture. This is a great opportunity for someone early in their career to grow in a supportive and dynamic environment.</p><p>Key Responsibilities:</p><ul><li>Design, build, and maintain reliable data pipelines using SQL and other ETL tools.</li><li>Collaborate with data analysts, engineers, and business stakeholders to gather requirements and deliver data solutions.</li><li>Clean, transform, and validate data for use in reporting and analytics.</li><li>Ensure data quality and integrity across multiple sources.</li><li>Monitor existing workflows and optimize queries for better performance.</li><li>Participate in code reviews and contribute to technical documentation.</li></ul><p>Required Skills and Qualifications:</p><ul><li>6 months to 1 year of hands-on experience in data engineering or a similar role.</li><li>Proficient in writing complex SQL queries (joins, window functions, CTEs, aggregations, etc.).</li><li>Basic understanding of ETL processes and data pipeline tools.</li><li>Familiarity with databases such as PostgreSQL, MySQL, or SQL Server.</li><li>Exposure to cloud platforms like AWS, GCP, or Azure is a plus.</li><li>Good problem-solving skills and attention to detail.</li><li>Excellent communication and collaboration abilities.</li></ul><p>Preferred (but not required):</p><ul><li>Experience with Python or any scripting language.</li><li>Familiarity with tools like Airflow, DBT, or data warehousing solutions like Snowflake/BigQuery/Redshift.</li><li>Exposure to version control systems (e.g., Git).</li></ul><p>What We Offer:</p><ul><li>A collaborative team environment.</li><li>Opportunities for learning and professional growth.</li><li>Competitive compensation.</li></ul><p>Job Type: Full-time</p><p>Work Location: In person</p>

Jr. Solution Engineer - Data

NielsenIQ

<div>
 <strong>
  Company Description
  <br/>
  <br/>
 </strong>
 NIQ Etilize (formerly GfK Etilize) is the largest product data provider in the world. We have been providing clients from around the world with mission-critical product data and solutions for retailers, distributors and manufacturers to power their eCommerce efforts. Our team brings decades of eCommerce experience, and we truly are passionate about product content and optimizing it for our clients. We provide standardized product data feeds for more than 20 million products worldwide.
 <br/>
 <br/>
 <strong>
  Job Description
  <br/>
  <br/>
 </strong>
 We are looking for a Software Test Engineer to join our team. As a Software Test Engineer, You are the quality advocate in your agile team and you will be responsible for planning, implementing, and automating software tests in an Agile environment. We expect from you to have knowledge in STLC. You will work closely with the development team. We expect from you to be a proactive person and to enjoy working in a team of like-minded professionals and keen to provide feedback on other's code as well as act on feedback received on yours.
 <br/>
 <br/>
 <strong>
  As Software Test Engineer you will have the following key accountabilities:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Participate in "3 Amigos" - pair with the PO and Developer and create Acceptance Criteria for the user stories
  </li>
  <li>
   Review the acceptance criteria and identify the test scenarios
  </li>
  <li>
   Provide test estimates during sprint planning
  </li>
  <li>
   Design Test Automation Framework
  </li>
  <li>
   Develop automated acceptance tests for the features
  </li>
  <li>
   Develop and implement integration, regression, and system tests for the new features
  </li>
  <li>
   Create and maintain test data and test environment needed for testing
  </li>
  <li>
   Log defects and track them
  </li>
  <li>
   Conduct exploratory testing as part of every sprint
  </li>
  <li>
   Develop automated tests for non-functional testing
  </li>
  <li>
   Ensure that tasks are delivered on time and of high quality
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Qualifications
  <br/>
  <br/>
 </strong>
 <strong>
  Now that you know what a Software Test Engineer does, what skills, qualifications and experience do you need?
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   ~4 years of experience in software testing
  </li>
  <li>
   1+ years of hands on experience in Automation testing
  </li>
  <li>
   Good understanding of OOP development practices with Java or similar
  </li>
  <li>
   The ability to use a version control system and follow the guidelines and the branching strategy in place
  </li>
  <li>
   Familiarity and ability to work with design patterns
  </li>
  <li>
   Knowledge in BDD methodology
  </li>
  <li>
   Acceptance Test Automation with Selenium WebDriver, Cucumber or similar
  </li>
  <li>
   Experience with relational or non-relational databases like SQL
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  It would be a great addition if you have:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Experience in automated API testing
  </li>
  <li>
   The ability to integrate automated acceptance tests into CI/CD pipeline
  </li>
  <li>
   Familiarity and ability to work with CI tools like Jenkins
  </li>
  <li>
   Security and/or Performance testing hands-on experience.
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Additional Information
  <br/>
  <br/>
 </strong>
 <strong>
  Benefits:
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Exciting work environment that brings people together
  </li>
  <li>
   Use the latest digital technologies
  </li>
  <li>
   Ongoing trainings to support your development
  </li>
  <li>
   Opportunities for personal and professional growth
  </li>
  <li>
   Great compensation linked to individual performance and company results
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  Our Benefits
  <br/>
  <br/>
 </strong>
 <ul>
  <li>
   Flexible working environment
  </li>
  <li>
   Volunteer time off
  </li>
  <li>
   LinkedIn Learning
  </li>
  <li>
   Employee-Assistance-Program (EAP)
   <br/>
   <br/>
  </li>
 </ul>
 <strong>
  About NIQ
  <br/>
  <br/>
 </strong>
 NIQ is the world&rsquo;s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights&mdash;delivered with advanced analytics through state-of-the-art platforms&mdash;NIQ delivers the Full View&trade;. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world&rsquo;s population.
 <br/>
 <br/>
 For more information, visit NIQ.com
 <br/>
 <br/>
 Want to keep up with our latest updates?
 <br/>
 <br/>
 Follow us on: LinkedIn | Instagram | Twitter | Facebook
 <br/>
 <br/>
 <strong>
  Our commitment to Diversity, Equity, and Inclusion
  <br/>
  <br/>
 </strong>
 NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center: https://nielseniq.com/global/en/news-center/diversity-inclusion
</div>


Software Test Engineer

Explore 703+ Data pipeline engineer in Karachi this September. Find roles across top companies and apply now to boost your career.

703 data pipeline engineer jobs IN Karachi

Data Engineer

Senior Consultant Data Analytics

Data Engineer

Data Engineer

Data Architect

Jr. Solution Engineer - Data

Software Test Engineer