we need a web scrawling / scrapping engine (PERL) which will do the following tasks
Input to the engine (travel website):
all or some of the fields like origin, destination, departure date, .....
1) Please fill the above said form and click the “Search Flights” Button and see the resulting page
2) You will be redirected to another page:
3) You can see that there are various results in various combinations
4) Please check the attached images to see which area has to be scrapped.
This engine has to be run simultaneously for 30 to 90 instances per user.
i.e there will be some 90 search criteria and all the 90 should run simultaneously and fetch the result. The resulting data will be shown both as a text and graph. We already have the graph plotting software from a third party and it accepts XML as input.
Will be able to give more details once the bid is accepted.