No, that's not possible.
What you can do if you want to improve the connection utilization is to spawn a few goroutines and execute multiple upserts concurrently on the same session. They'll all block and receive results independently, but they'll all queue the requests to the server concurrently.