Did you have a look at the optimized file format that Google Chrome uses for its Hunspell dictionaires? http://src.chromium.org/svn/trunk/src/chrome/tools/convert_dict/
I'm currently investigating that option in order to see if that gives better performance.