Stock Data Crawler Csv To MySQL

The project intends to gather stock data from the end of every trading day by using the Yahoo Finance API and import the data into a localhosted mySQL database. The program will be written in Python and/or mySQL query language and should be compatible with the OS X environment. The code will run manually at the end of every trading day. The Yahoo Finance API is simple and fetches a CSV-file based on dates and stock symbols: [login to view URL][[login to view URL]]?s=[Stock symbol]&a=[start month - 1]&b=[start day]&c=[start year]&d=[end month - 1]&e=[end day]&f=[end year]&g=d&ignore=.csv The input is a list of stock tickers in a text file separated by line shifts or any other easy to use solutions. Example of stock symbols: GOOG [login to view URL] [login to view URL] ^IXIC [login to view URL] [login to view URL] [login to view URL] [login to view URL] GE The other inputs [dates, etc] shall be easily changed by the user either in the beginning of the code. Example of datasource for the GOOG symbol from 1.1.2000 to 20.09.2015. [login to view URL] The output will typically be, but may vary: [Date] - [Open] - [High] - [Low] - [Close] - [Volume] - [Adjusted Close] The output shall be imported into a local mySQL database, each stock data into separate tables. Date formatting should be compatible with mySQL, the code should be robust and report any errors in the process. In addition each time-series should be identified by a unique [SymbolName] and [SymbolNbr] - The primary keys shall be the [date] and [Symbolid] - Table for each stock symbol, adding [SymbolName] and [Symbolid] for easy processing - Separate tables for symbols and other if deemed relevant by the coder - Separate table for Symbols and other relevant tables as needed - The code should be simple and easy to modify, with comments - Use Django for mySQL connection - Use only well maintained/supported python-packages. - Use virtualenv and be compatible with OS X-environment - Make a separate table to consolidate all stocks into one table sorted by date, looking something like this: [date] [stock1Adjustedclose] [stock1Volume] [stock2Adjustedclose] [stock2Volume] ... [stockNadjustedclose] [stockNvolume] This is a small part of a project, and a well written code will get you hired on other parts. Similar projects and inspiration: [login to view URL] [login to view URL] [login to view URL] - this one is almost identical to this project, but uses a different connector and stores everything in the same table.