The tests seem to fail when I run them locally.
The test themselves or Hibernate Search is broken. This may have been the case for a while though, since running the tests on 5.8.0.Beta1 produces the same failures.
Or there is some setup required on machines executing the performance tests. If this is the case, they should be documented somewhere (in the README?).
In any case, we must at least know what's going on before we release 5.8.
I attached the test ouput. The relevant section: