GradConnection Job Scraper
A web crawler using the Scrapy framework to extract job listings from GradConnection Australia.
Screenshot
Tech Stack
Python
Scrapy
Project Details
Developed a robust Scrapy-based crawler to collect and parse job listings including title, company, type, location, deadline, and direct link
Implemented pagination handling and flexible job category filtering through customizable start URLs for various disciplines
Structured data pipeline with modular components for items, pipelines, and custom middlewares