You should have different layouts for different screen sizes. For example for xhdpi screens you create layout-xhdpi folder and put layout.xml for xhdpi screens in there. The same for other screen sizes. There is no way to have one layout looking exactly the same on all displays.
See this: http://developer.android.com/guide/practices/screens_support.html