URGENT : I would like to create an advanced search engine, crawler , spider for the world wide web and can follow endless external and internal links.
Also able to search and index web, images, audio, video links.
Admin can request a web site to crawl and index to the database based on category.
Search engine should create automatic category listing.
If you have a demo ready, I will pay you immediately as soon as I test the search engine.