-App is made in C#,
-Must be fully multi-threaded.
-So basically I need to insert a list of target URLS easily, like with copy paste.
program or script will then retrieve all links found on msn, yahoo and all the web
for every given url ,
IN EXAMPLE
Program will search for a string in the search engines. This string will be a command unique to each engine with url of one of the website urls on the list,
something like this "links:http://www.example.com", so this search string retrieves all links found on a search engine for that given url.
In search engines the results are shown in the following format:
The title of the found resource. (highlighted in blue)
The resource description (highlighted in black)
The resource URL address (highlighted in green)
In example of [login to view URL] Program will get something like this:
[login to view URL]
[login to view URL]
etc..
So i need the resource URL address of all results found to be stored in .txt files automatically (after searching for links is over),
named by given url. I.E. "www.example-url.com.txt".
So for [login to view URL] we could have:
[login to view URL] { 1-1010 urls }
[login to view URL] { 1-1010 urls}
[login to view URL] { 1-250 urls}
Because links results number is limited for each search engine.
The [login to view URL] search engine shows only 25 results pages (250 results links).
-After finished task it will automatically export all found links for an url to a .txt file named by that url.
Hi there
The project you describe is essentially a webscrape. This is all I do for clients. So I understand the framework required very quickly. it also benefits the client as I can turn around projects quickyl and professionally.
If you require any further information please do not heistate to contact me
regards
Andrew