In order to reduce the size of the DB you should use the smallest charset that satisfies your needs. The utf* family is very big.
It depends really on what data is stored. If you use multi language characters (i.e. German, Hungarian, Arabic, Cyrillic) or special characters, not included in ascii (like integral or n-arry summation signs) the utf8 is a good choice.
However if you store only plain English (in the non-base64 column) use ASCII.
Otherwise consider making separate table(s) with the text (non-base64) values and when searching join them by index values.