Fix concurrency issue when using multiple custom constraint validator factories

This was originally fixed as part of but the last commit of the master PR was not backported.

We need to backport https://github.com/hibernate/hibernate-validator/commit/9e2c0d99e9ed856b8b57cbac3aac8a3bbb1d47a6 .