If I've read the sample correctly it is expected that you'll deploy this to Azure before running the tests.
The cache service is not designed to be used outside of the data centre that it's deployed in because then its performance will be constrained by the relatively high latency network connections. That average time of 100ms is likely the network latency between you and the cache service.