In the scenario class, the deterministic parameter is set to false by default. This might have some unintended consequences. However on first glance it appears that everything works as expected due to the parameters n_seeds and max_config_calls.
However, this needs to be discussed, possibly reworked and definitely documented.