I have a mysql database with url and keyword fields.
I need a script which scans earch url and retrieves (stores in this database) following info:
- meta keywords
- meta description
- full body text (some sentences or paragraphs where the specific keyword occurs (if this is not found, then a view paragraphs from the body))
Script should be capable of handling very large lists of urls, not time out and skip non-responding websites.
Please provide an online demo.