The cache store is set up during initialization of the application and cannot be change at runtime afaik. To achieve what you are trying to do you can persist the cache store configuration in a config file and restart the whole app. See a similar questions answers to get an idea how to do that.
Disclaimer: With that approach you can easily kill the application if the configuration is faulty.