Technology: PHP and Mysql
We consign collector cars, trucks, street rods and exotic vehicles for auctions throughout the country.
The web scraper must be able to crawl [url removed, login to view] and populate a mysql database with the results.
Example url: [url removed, login to view]
Must be able to search by a specific zip code radius
Must extract all available data including year, make, model, asking price, and seller details.
Must be able simulate a browser or robot or similar as [url removed, login to view] blocks multiple requests from the same ip address.
Must be modular as upon successful completion of this project several other sites will be added.