Dibatalkan

SCREEN SCRAPE, DATA MINE, BUSINESS INTELLIGENCE, PRICE BOOKS, PRICE COMPARISON

This is a business intelligence gathering project - price monitoring and market monitoring.

The Project calls for the supply of automated services or scripts, for use by clerical staff, to look at pre-determined groups of online shop websites and pull out brand, part number, unit price, product category, product description.

The data to be placed in a database and made ready for business analysis - price monitoring and market monitoring.

Feel free to offer tools or systems from [[url removed, login to view]][1] or [[url removed, login to view]][2] or <[url removed, login to view]> or others that you are already familiar with.

The purchase of 3rd party software licenses will be arranged, if that is necessary.

Access to a VPS server and SQL database will be provided to the successful bidder.

Bidders should have previous experience in this type of work. Bidders should feel free to ask any additional information about the sites ( global Brands of ink and toner and domestic printers) and data fields and estimated work load they need.

It is expected that data be gathered from no more than 50 sites, with a range from 400 to 4,000 part numbers each.

## Deliverables

* * *This broadcast message was sent to all bidders on Tuesday Jul 10, 2012 9:23:16 PM:

This is a Broadcast Message. Thank you for your responses and the questions you put forward. The Project bidding deadline has been extended. An improved Project Brief is being written and will be posted within 24 hours. The next step would then be to review your approach to the Project, and estimates for labour and time, against the new information. Best Regards, TIME POOR

* * *This broadcast message was sent to all bidders on Friday Jul 13, 2012 3:34:15 AM:

Hello and sorry to be late....it's cold and flu season here and my head is exploding.... Would you review this revised Project description and comment where necessary. I hope the new information is sufficient for you to re-evaluate your interest in the Project, as well as check or adjust your time and labor estimates. ___________________________________ PROJECT DESCRIPTION Have a look at these sites: o [url removed, login to view] o [url removed, login to view] o [url removed, login to view] o [url removed, login to view] o [url removed, login to view] o [url removed, login to view] o [url removed, login to view] o [url removed, login to view] These are the first sites for this Project. More to be added later. The site owners are RESELLERS of printers, inks and toner cartridges and many other products. The Project is to collect Reseller market data for all the OEM Brands in the consumer toner, ink, printer and fax category. The focus is on Australia. The product Brands of interest are: Canon, LexMark, Fuji-Xerox, HP, Brother OKI Epson Dell Kyocera Samsung Ricoh Toshiba Sharp Panasonic When you look at the sample sites you will see that many Resellers use similar groupings to make their categories and sub-categories. ________________________ GENERAL COMMENTARY A./ There is no intention to scrape google or ebay or shopping comparison sites....BUT....if you have any ideas that looking into shopping comparison sites might make the project easier to do, you can check some of theses local price comparison sites: [url removed, login to view] and [url removed, login to view] and [url removed, login to view] Many Resellers of these printer and ink brands are represented in these price comparison engines and there is sufficient data in these sites to give an approximate low and high price for every part number. These engines will always be 12-24 hours out of date, when compared to the live Reseller sites. B./ There is no intention to copy Reseller websites. The Project has no interest in the Reseller web layout, images or branding. C./ The Project will provide a test sever with SQL / CPANEL / etc. so you can activate and configure a database for storage. The Project owners currently work with Linux, TOMCAT, Apache, javascript and jquery. _____________________ PROJECT OPERATION The Project calls for continuous updating - all Reseller shop prices change daily. Please fell free to suggest methods you think are most convenient to gather and store the data, and for clerical staff to run DAILY data collection and reports. Operators need a way to get daily price information for the nominated Brands in the nominated Reseller shops. For example, staff could want data for all the Lexmark Toner part numbers, what is the lowest price for each part and what is the highest price for each part? From there, they would calculate the market price ranges for these products. Price Comparison engines already do this ??" with the Resellers providing the approved data feeds, like googlebase. Please give me your thoughts about a way for generating Reports, too. One way to do this is by SQL queries, another way is to add a formal report generator. ________________________ LONG TERM OPERATIONS Once the sites are scraped, you may find that the Resellers notice this and block the next visit. Please provide your thoughts on a method for a long-term solution. For example, is it feasible to use proxy servers with randomly assigned IP addresses? To aid speed of operation, are multi-thread sessions a helpful idea? Can the activity be automated, so that all target sites are scraped at a set time, without Operator involvement? I am interested to see prototype solutions using the sample Reseller sites, or examples of previous work. ________________________ MAINTENANCE And….just to be sure I say it….this is not a one-time use. The solution is meant to be part of daily operations for the Project. Please comment about how the solution can be maintained to add and delete Reseller sites and how you would update or modify the application to see sites that change their structure. Best Regards, TIME POOR

Kemahiran: PHP

Lihat lagi: you proxy google, you may not need jquery, xerox com, www my business online, www clerical, work for dell, where to market products online, where to find work in australia, where is community set, where can i get javascript, what's online business, what need for an operator, what is online data, what is meant by data structure in c, what is data structure in c, what is data structure, what is data in data structure, what is clerical work, what is clerical, what is a data structure in c

Tentang Majikan:
( 42 ulasan ) Carnegie, Australia

ID Projek: #2757346

7 pekerja bebas membida secara purata $813 untuk pekerjaan ini

avosoft

See private message.

$1275 USD dalam 14 hari
(29 Ulasan)
4.8
raul27868

See private message.

$1258 USD dalam 14 hari
(9 Ulasan)
4.7
amirn2011

See private message.

$400 USD dalam 14 hari
(44 Ulasan)
4.6
eamattos

See private message.

$420.75 USD dalam 14 hari
(12 Ulasan)
3.4
mostacholoco

See private message.

$127.5 USD dalam 14 hari
(3 Ulasan)
2.7
anumitru

See private message.

$410.55 USD dalam 14 hari
(3 Ulasan)
1.5
YuzTechnologies

See private message.

$1800.3 USD dalam 14 hari
(1 Ulasan)
0.0