I need a simple [url removed, login to view] (CL) scraper program that does the following. I have seen other similar requests out here, so I'm sure some of you have already developed something like this.
1) Scrapes postings made in selected categories on CL. It will allow me to select one, many or all categories on CL. Included in this should be main categories listed on the home page and all sub-categories. For example, main category of "real estate for sale" ([url removed, login to view]) and sub-categories of "real estate - by broker" ([url removed, login to view]) & "real estate - by owner" ([url removed, login to view]).
2) Scrapes postings made in selected cities (US cities only) on CL. It will allow me to select one, many or all cities on CL.
3) Use keywords to limit posts that are returned.
4) Use negative keywords to further limit posts returned.
5) Extract email address and insert them into a txt or cvs file.