I am scraping a bunch of data on a daily basis. I need a program that can import the scraped data and provide me with the ability to analyze the data. I need to answer a bunch of basic questions which I will provide in the specification.
My preference would be either an Excel or Web based analysis, but I'm open to a Windows desktop app or other solution. The interface is less important than making sure that the program works reliably and can give me the insight I need.
It's also ok to create one program/script that imports the data and another one to do the analysis.
## Deliverables
The attached files show output from an application that scrapes rental car data.
The 1st field is the date/time the scraper ran.
The 2nd field is the pickup location.
The 3rd field is the dropoff location. (this field can be ignored)
The 4th field is the pickup date.
The 5th field is the pickup time. (this field can be ignored)
The 6th field is the dropoff date.
The 7th field is the dropoff time. (this field can be ignored)
The 8th field is the rental company.
The 9th field is the car size/type.
The 10th field is the base price. (this field can be ignored)
The 11th field is the total price.
The main goal is to track how prices on a specific rental have changed over time. What I mean by a specific rental is a rental in a specific location, between 2 dates, for a specific company and specific car type. For example:
I want to query for all rentals at LAX, from 3/1/2010-3/2/2010 for an Economy car from Enterprise. Each output file has one entry that meet's this criteria. Here is the specific line from [login to view URL]:
"2/12/2010","12:50:35 AM","LAX","LAX","03/01/2010","12:00PM","03/02/2010","12:00PM","Enterprise","Economy","80","113.44",
The total price for this rental is 113.44. Each output file should have a similar entry in it. The goal is to find the price in each output file and show a list or a graph of all of the dates/prices for this rental. I need to know if the price has trended upward, downward or stayed the same.
I need a way of selecting any rental from the output files, and then seeing a list or graph showing what the trend is over time.
The output files attached here are what I collected so far. I am collecting more each day.
Please explain how you would accomplish what I am looking for (example: custom website, Excel Pivot Table, custom Windows app, etc.), how much you would charge and how long it would take to complete.
Thanks!