a board game server with using combination of tcp,udp good idea?

Question

I am coding board game server using Netty. Using TCP at every part of the game. But I am having issues most of the time. Even though have posted several questions, tried many configuration parameters, I am still having issues (latency and un-expected disconnect issues at most)

My idea is, using TCP while visitors playing the game. Other than this, if you are exploring rooms, checking tables, looking for friends etc. will use UDP instead. Can I expect performance increase ?

Server: JAVA, Linux Client: Adobe Flash