What I need done:
I need a web crawler that is able to scrape information from websites. The information will vary so the crawler will need to have the ability to be used on different sites for slightly different uses.
Use 1. To collect information on products from supplier websites using a simple description such as a product id or sku. The aim will be to crawl the supplier website and collect relevant information such as RRP, detailed description, weight, product dimensions (X Y Z format), stock available, etc.
Use 2. to collect information from web comparison shopping sites, eBay and other websites for prices of products that we sell.
Other context/requirements that providers will need to know:
We want to be able to use the data so the data will need to be able to be downloaded into a CSV file.
Also I would like to see bids / solutions that possibly are hosted on a server and place the data into a mysql database. However, I would also like to see solutions that can be run from my desktop and possibly utilize either a CSV file or an access database.
Specific expertise that I am seeking:
If you can specify if you have built similar types of applications previously and please include links to these projects or descriptions of them in your bid.
Timeframe for delivery:
Please provide me with some details on how long you feel it would take to deliver such a project.