Automated servers upload CSV files once a day to a FTP site. These files contain data from measurement devices in the field. Data has timestamps.
At the end of the month the data in these files must be combined to produce a monthly file in chronological order.
The headers in the data files must also be removed where redundant.
Is it better to do this on the FTP server (what are the security concerns as well as scripting language used)? Or is it better to post-process using an Excel Macro, for example? Or is it better to put this into a database and access it from there? In this case it would still be necessary to upload this data into a database.