End result: easy to use program
we are an on-line business that sells approx 30,000 products via our web site. We require the creation of a pricing crawler / spider which will gather pricing data from [url removed, login to view], [url removed, login to view], [url removed, login to view] & other comparisment sites.
The program would need to be capable of searching one product across many (predetermined) web sites . We currently offer in excess of approx 30,000 product lines and the range of product will continue to expand dramatically.
We use a CSV/excel file for our products with SKU/EAN productnumbers. This file is placed on our server. Based on these SKU or/and EAN numbers the scrawler must find the cheapest price (including transportation costs) on all mentioned sites.
The data must be downloaded in CSV/excel format after scrawling.
After we download the data we must be able to see the lowest price of each product from the predetermined sites.