try read.table(comment.char="?" ...)
where what you use as a comment.char is something that isn't in your table:
read.table(
comment.char="?", header=T, check.names=F,
text="ColA ColB# ColC ColD ColE\n1 2 3 4 5"
)
# ColA ColB# ColC ColD ColE
# 1 1 2 3 4 5