Currently it is not possible to have an active configuration set and at the same time test a new configuration set that is being developed.
It would be helpful if the users that are working on the new configuration set could be able to access it e.g. through a different URL.
It would reduce the need for an extra environment for development, and it could even be considered having it as a feature for assigning different configurations to different user groups e.g. in different business units.