I finally got how to solve this question After we enabled the locale in the /etc/locale.gen and use locale-gen to generate it. I have to also set the locale system-wide, create the /etc/locale.conf file and set the default locale
localectl set-locale LANG="de_DE.UTF-8"
Then if I exit and log again, the oh-my-zsh will work fine.