Scraping job postings from career pages, newspapers and more


I need a software to scrap / parse / aggregate / job postings mainly from career pages (like the ones majore companies have – please visit sites like [url removed, login to view] [url removed, login to view] / [url removed, login to view] / [url removed, login to view] / [url removed, login to view]) but also from newspapers or job boards.

„Must have” features of the project:

Spider jobs from websites (HTML or XML), ATS or via FTP.

Jobs taxonomy for categorization based on job titles & keywords.

Then the job ads should be converted into the correct format for my job board. Semantic analysis should be used, to ensure the content is accurately mapped onto my job board’s category schemes

The capture has to be at the highest possible data to be parsed on a job site and it would contain the entire job advertisement.

Incremental scraping feature only downloads new jobs.

Synchronize jobs to guarantee that only open jobs remain posted.

Filter jobs by keywords so only relevant jobs are posted.

Auto-replace keywords in content & clean up job formatting.

Schedule regular spidering / posting sessions.

Auto-post via XML, EXCEL or CSV to single or multiple websites or forward to a list of emails.

Post to HTTP interface, via API, SOAP, to FTP or email.

!!!The way I want it to work: I shall introduce the adress of the main career page of the hiring company

(for example only: [url removed, login to view]


[url removed, login to view]


[url removed, login to view]


[url removed, login to view])

and the software will scrap the entire posting of the job openings that will be found in the career pages of the website. The software product should be build in a way which will allow me to give only the web adress of the career section of the website to be parsed and the software product will do all the rest. This is really a must have. If needed I shall provide for you all the adresses of the career sections/pages to be parsed or at least most of them.

Very important: I need to have perfect accuracy of the scraped content - text, url, images. The engine has to be able to scrap at least 600000 career pages / day (which will come from arround 30000 web-sites/day), convert them into XML, EXCEL, or similar files and post them on my job board website or spread them to other job boards.

The software should be able to do at least what the following two are doing:

[url removed, login to view]

[url removed, login to view]

If you do not wish to build up an entirely new software product you may use [url removed, login to view] or [url removed, login to view] but I would prefer visualwebripper as it is a lot cheaper. Other web scraping engines/software are welcome as long as they prove to work just as good as visualwebripper or mozenda and they are not to expensive compare to visualwebripper. Build up a visualwebripper with the “must have” features above and it will do it.

Another very important thing: before paying for your work I have to make sure that the product meets all the above requirements. A free trial of 30 days or demo is compulsory.

Any of the above statements are subject to questions and discussions. Feel free to ask or comment on any of the above.

Kind regards


Kemahiran: Perlombongan Data, Pengikisan Web

Lihat lagi: scrap, scraping job postings, Advertisement, web scraping project, you and ibm, xml aggregate, work jobs from, what jobs are hiring, what is the highest paying job, what companies are hiring, web search engines list, web scraping software free, web scraping https, web scraping free, web scraping api, web content downloads, web analysis services, software scraping, semantic web search engine, semantic web jobs, search for a career, scraping website software free, scraping web content, scraping the web, scraping free

Tentang Majikan:
( 0 ulasan ) Romania

ID Projek: #4097914

9 pekerja bebas membida secara purata $396 untuk pekerjaan ini


Hi sir, please check PM, thx Kimi.

$250 USD dalam 5 hari
(65 Ulasan)

I worked on many similar projects, I have big experience in data mining projects. I can finish this task in short time, with the best quality.

$560 USD dalam 15 hari
(16 Ulasan)

Scrapping Experts here. Check the message and contact us.

$750 USD dalam 10 hari
(7 Ulasan)

Hi sir, please check PM, thx Presto.

$250 USD dalam 5 hari
(1 Ulasan)

I have plenty of experience developing these kind of applications. As a matter of fact I have just performed a similar application for real state offers scrapping a quantity of websites. Therefore I do believe I can ma Lagi

$500 USD dalam 7 hari
(0 Ulasan)

It all depends on the specific sites you would need to have scraped. I will explain further in the PM.

$750 USD dalam 7 hari
(0 Ulasan)

Good work doesn't come at easy price. Best work is assured.

$400 USD dalam 7 hari
(0 Ulasan)

..please check PMB for more detail....

$250 USD dalam sehari
(0 Ulasan)

[[[[[[[[ Better Than The Best - Scraping Guru Waiting Here To Complete It Now ]]]]]]]]

$250 USD dalam 6 hari
(0 Ulasan)

Greetings: Our company is interested in your bid and we can carry it out according to the features you [login to view URL] check our private message. Best regards,Manuel

$350 USD dalam 15 hari
(0 Ulasan)