This isn't possible on cloudbees. Deploying a new version will start a new set of servers with the new binaries (deployment don't override existing servers, it creates a fresh new infrastructure, then stop the active one)
Seems you're trying to setup some A/B testing process ?
What you need is another application ID with the new version, get some users redirected here, and use blue/green switch so that all users use the latest one when you're fine with the new app usage stats.
Cloudbees platform don't (yet) provide any routing algorithm to help implementing traffic switch between A and B apps. Maybe your DNS provider can handle this ? Workaround is for you to have application A redirect some % of traffic to B.