There was a thread on the topic of updating the config, which you might find contains useful information here:
But in short, by default they would need to exit and reenter the project for it to recache.
It will only download the config if it doesn’t already have it locally. It caches it by the id of the uploaded file, so when you upload a new config the id will be different and if it doesn’t have that id locally it will pull it.