You are getting an error when you enter because you get an empty string, so you can't convert it to char.
I would offer you to do that:
char result;
string input = Console.ReadLine();
if (char.TryParse(input, out result))
{
//The input is a char - write your code here.
}
//The input is not a char.