Great! You fixed the VERY slow archiving. How did you do it? e.g. how were you reading the files, and how do you read them now?
This is some 400-700 times faster.
Edit: Memory consumption.
Takes over 250MB of RAM after archiving, while "Dumping buffer" for few minutes. It seems that longer I let it run, more it eats the RAM. Strange, since log files only take up some 15MB of diskspace.
It also keeps CPU usage quite high. 2.6GHz Athlon64 X2 goes around 50% for another core for every few seconds. I wonder what my old 1GHz Duron would like about that.
No offense, but right now this seems to be the most inefficient program I have seen so far, ever. But I believe it is just a bad way of doing things. But hey, this is great opportunity to learn to optimize your code better, so I am more than eager to get the new version, just to see the progress you have made.
