Question

i need to remove all multibyte characters from a file, i dont know what they are so i need to cover the whole range.

I can find them using grep like so: grep -P "[\x80-\xFF]" 'myfile'

Trying to do a simular thing with sed, but delete them instead.

Cheers

Was it helpful?

Solution

Give this a try:

LANG=C sed 's/[\x80-\xFF]//g' filename

OTHER TIPS

you can use iconv to convert from one encoding to another

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top