We need to find someone who can complete the following tasks for us:
1. Clean up database of >1 million products and filter database against [url removed, login to view] API (full detail on API, including XML xpath, available).
2. Build web spider to capture keyword data from [url removed, login to view] "Consumer Demand Index" pages ([url removed, login to view])
3. Setup schedule to refresh spider information weekly
4. Script to choose top products from spider/crawler information
Full documentation is attached.