Option for float 4 bit, 8bit, 16bit, 32bit

[remco-pc]

Can you adjust the decoder to read faster, probably 4bit is a lot faster then the default 64bit, so we can choose the datatype. For computation of embeddings for example, also it compress better, keep the filesize smaller.