If your application will be running for a while you don't really want to keep a constant connection open to a server since that will eat a lot of batteries.
It sounds like you're looking for this: http://developer.android.com/google/gcm/index.html
Using gcm your app can get a notification when there's an update on your server.