Lead Python Developer (Web Scraping)

We are seeking a highly experienced Lead Python Developer with a strong focus on web and application scraping to design, build, and maintain scalable scraping solutions. The ideal candidate will have deep hands-on expertise in Python, Selenium, and Appium, along with experience extracting data from complex sources and integrating third-party APIs.

This role involves developing and maintaining scraping applications, deploying solutions in AWS, and collaborating closely with cross-functional teams to ensure reliable and high-performing data extraction pipelines.

Key Responsibilities

• Design and develop browser-based web scraping applications using Selenium.
• Build and maintain Android application scrapers using the Appium framework.
• Research third-party websites and mobile applications to implement efficient and robust scraping logic.
• Extract and process data from multiple file formats, including PDF, Excel, and CSV.
• Integrate scraping solutions with third-party APIs using Python.
• Maintain and enhance existing Python-based applications to ensure performance and stability.
• Deploy, monitor, and maintain applications in AWS environments.
• Use Docker for containerization and application consistency.
• Collaborate effectively with cross-functional teams to deliver scalable and reliable solutions.
• Ensure operational excellence through monitoring, debugging, and performance optimization.

Required Skills & Experience

• Bachelor’s or Master’s degree in Computer Science or a related field.
• 8+ years of overall hands-on experience in Python development.
• 5+ years of hands-on experience in Python web and application scraping.
• Strong proficiency in Python 3.
• Extensive hands-on experience with:
• Selenium
• Appium
• API integrations / requests
• Docker
• BrowserStack
• ScrapingBee
• Solid understanding of scraping best practices, anti-bot mitigation, and data extraction workflows.
• Experience deploying and maintaining applications in AWS.
• Exposure to large-scale or high-volume scraping systems.
• Strong problem-solving skills and the ability to work independently in complex environments.
• Excellent collaboration and communication skills.

We have an amazing team of 700+ individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), ISO 14001:2015 (EMS), ISO 45001:2018 (OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.

To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/