I need someone to build a web crawler that will do screen scrapes of a website and put the contents into a database. The page needs to be parsed - different sections of the web page needs to be put into the database as different fields. There will be 7 sites to begin with that need the data scraped and put into a database: [url removed, login to view] [url removed, login to view] [url removed, login to view] [url removed, login to view] [url removed, login to view] [url removed, login to view] The system will allow a user to log into a website and enter a name. When multiple names are retrieved, I want the system to be able to grab the data on all individuals retrieved. The information stored in the database will be keyed by session variables combining the username and date/time of the request. The web page will then collect the data from the different sources and display it to the user in a single, easy-to-read form. For example, if I want information on John Brown, there may be John E. Brown, John F. Brown and John Z. Brown for the State of Florida. I would want the data for all 3 stored in the database for this user. A sample of the information to be stored is name, license status, license number, date license issued, medical school information, disciplinary action, specialty information, criminal history, malpractice information and birthplace information. Please let me know if you have other questions. Thanks.
Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. Complete copyrights to all work purchased.
Must be either ASP page or COM component that will work with IIS.
## Deadline information
There would be bonus if the person could make it so that the crawler was customizable - meaning the same code could be used for several different websites by just changing a few parameters.