We have a project where we want to take 100 adult related web boards and scrap all the pages in real time and make a google like search engine for them. We need to get around the security of each site to allow us to spider all the pages. We need super fast queries, and allow searches to contain multiple keywords or search phrases. The point of the project is so that a user can search their company name or keyword on 100 web boards at once in case someone is talking about them and can respond.
The second part of this project is to have an auto login feature for each web board and account creator, so that once the program does find a keyword that matches in the search, they can auto login to the web board and repond to the post on our interface. This will allow the user to quickly and easily manage all the 100 web boards at a time and keep up with their company posts on all boards.
We need very fast programming for this and very cheap quotes!