Between two lines is the project description.
We are using crawlera (of [login to view URL] - the same people who created scrapy) to scrape some classified sites. There are two sites which are are unable to scrape:
1. [login to view URL] (MT, uses distil networks)
2. [login to view URL] (TP)
but another site is scraping these sites successfully - [login to view URL] (UG) - you'll find the listings of #1 & 2 above on this site. So, I'd like to know - how is this site (UG) able to scrape in spite of distil network and anti-scraping tools being used by the above two sites which block our script hosted on crawlera?
You simply have to let me know what am I doing wrong and what UG is doing right. You can charge hourly or a flat fee.