If your input really is UTF-16, then you should use iconv
to convert your file from utf16
to something less cumbersome:
iconv -f utf16 -t utf8 < filename.csv > filename-utf8.csv
But I think that file
got that wrong because of the zero bytes (displayed as ^@
) in there.
You should have a look at your file using sth like this to be sure of the contents:
xxd filename.csv | less
or
od -c filename.csv | less
in case you don't have xxd
installed. This should show more accurately than cat
what you've got there byte-by-byte.