Posted May 13, 2025 404 views
We are looking for a talented and hands-on Web Scraping Developer with 2–3 years of experience to lead and scale our web scraping initiatives. This role involves both technical development and team coordination, ideal for someone ready to take the next step in leadership while still being deeply involved in coding and system design.
Key Responsibilities:
- Lead and support a small team of web scraping developers.
- Design, build, and maintain reliable scraping scripts and data pipelines.
- Monitor scraping jobs and ensure timely and accurate data collection.
- Troubleshoot and resolve scraping issues, including dealing with anti-bot systems.
- Ensure best practices in code quality, version control, and documentation.
- Collaborate with other departments to gather requirements and deliver clean datasets.
- Mentor junior developers and assign tasks effectively.
Required Skills & Qualifications:
- 2–3 years of hands-on experience in web scraping.
- Strong command of Python and libraries like Scrapy, Beautiful Soup, and Selenium.
- Expertise in scraping data from complex, JavaScript-heavy social platforms like TikTok, Instagram, and other social apps using headless browsers, mobile emulation, and anti-bot evasion techniques.
- Proficient in bypassing CAPTCHAs, Akamai, and advanced bot detection systems using techniques like headless browser fingerprinting, proxy rotation, CAPTCHA-solving services, and session spoofing.
- Basic understanding of HTML, CSS, and JavaScript.
- Knowledge of using proxies, rotating user agents, and headless browsers.
- Familiarity with database systems like MongoDB, MySQL, or PostgreSQL.
- Good communication and leadership skills.
- Ability to manage multiple tasks and meet deadlines.
Nice to Have:
- Experience with Puppeteer or Playwright for JavaScript-heavy sites.
- Familiarity with Docker or virtual environments.
- Knowledge of REST APIs and data formats like JSON/XML.
- Exposure to Git for version control.
Skills
Job Details
Agile Kode
What is your Competitive Advantage?
Similar Job Titles
Bark Lead Scraper / Lead Generation Executive
Ali Aziz
CEO
Shopistan
Sehrish Azhar
Motivational Speaker & Blogger
Living Upbeat
Babar Ahmed Khan
Territory Sales Manager
Engro Foods
Zubair Anjum
Business Excellence Specialist
Nestle Pakistan
Muzammil Baig
Digital Marketing Manager
IT Services Group
Mona Sharif
Senior Team Lead
Konext PVT. LTD
Ayesha Shaukat
Social Media Marketing Manager
Ivoke
Aqib Irshad
Head of HR, Training & OD
FINCA
Usman Habib
Recruitment & Training Executive
ACS Synergy (Pvt) Ltd.
Zohaib Ali
Marketing Manager
Digital Online Devices
