**** Only who have done similar project (Job Aggregator/Job Search Engine) NOT Job Portal will be considered***** IF YOU DO NOT HAVE EXPERIENCE WITH XML FEEDS AND AGGREGATOR WEBSITES,PLEASE DO NOT BID
we are looking for Job aggregator (Job Search Engine) similar to [url removed, login to view] and careerjet.com.
It will to crawl career pages for a given URLs for jobs (like the ones major companies have – please visit sites like [url removed, login to view] [url removed, login to view] / [url removed, login to view] / [url removed, login to view] / [url removed, login to view]), and return a list of jobs based on the search criteria input (automatically grab, scrape and index vacancies) in our web portal.
A scraper would downloads jobs from these career sites’ pages via HTML, parses jobs content and auto-posts to aggregator job board.
Scraped data: Job title, job description, location, company name, Publish Date & URL
At the same time, able to pull RSS feeds of jobs from designated URL and index them as well, This is needed when Some job source websites do not provide XML or RSS to aggregate jobs. And since different RSS might come in a different formats we will need advanced XML/RSS and HTML pages Parser allows to add new feeds with easy
- schedule daily or weekly download sessions
- synchronize jobs data with corporate website source for timely expiry
- jobs taxonomy for categorization based on job titles & keywords
- incremental scraping will only download new jobs to keep employer website workload low
- filter out jobs by keywords so only relevant jobs are posted
- clean up job formatting / HTML to suit job board design
I will also need email notification system that can send hundreds of thousands of job alerts per day
If you do not wish to build up an entirely new software product you may use [url removed, login to view] or [url removed, login to view] but I would prefer visualwebripper as it is a lot cheaper. Other web scraping engines/software are welcome as long as they prove to work just as good as visualwebripper or mozenda and they are not to expensive compare to visualwebripper. Build up a visualwebripper with the “must have” features above and it will do it
You must be able to provide previous work sample for AGGREGATOR previous work with refrence for refernece check