Dig in:

http://dbmsmusings.blogspot.com/2009/06/what-is-right-way-to-measure-scale.html

http://dbmsmusings.blogspot.com/

Also need to find a fast compression algo, that is not burdened with
GPL nonsense:
http://www.oberhumer.com/opensource/