I need a Windows application or php/mysql script that can spider a list of sites I feed it and that finds a link to a site of mine. In other words: I know one or more links to my site are likely to be somewhere on a list of domains and I want to know on which page(s).
For each pages that contains my link, I then want to know if it is indexed in Google.
I know what the list of sites that should be spidered (can be a domain, or a page on a domain).
I want to find links to my main domain or any subpages (e.g. I tell the script it should find links to [url removed, login to view] but it shoudl also report pages it finds with links to [url removed, login to view]).
There can be many pages on a domain with links on them. It could be on 1 page or 5 pages or all pages of the domain.
The application basically has to spider and report all the pages on a list of domains, that has links to any pages on my domain.
The results could be something like shown in the attached word document.
I should be able to save the results in a project and re-scan them another time. Also I want to be able to have multiple projects.
I should be able to sort the final result page (as in example screenshot) on each column.
Looking forward hearing from you!