22d54408bf1bf47841a5798ebbeaba858f13fc76,test/test_intensify/test_successive_halving.py,TestSuccessiveHalving,test_eval_challenger_2,#TestSuccessiveHalving#,436

Before Change


        self.assertEqual(self.stats.inc_changed, 1)

        // config2 should be capped and config1 should still be the incumbent
        config, _ = intensifier.get_next_challenger(challengers=[self.config2], chooser=None, run_history=self.rh)
        inc, _ = intensifier.eval_challenger(challenger=config,
                                             incumbent=inc,
                                             run_history=self.rh,)

After Change


            incumbent=inc,
            run_history=self.rh
        )
        result = eval_challenger(run_info, taf, self.stats, self.rh)
        inc, inc_value = intensifier.process_results(
            challenger=run_info.config,
            incumbent=inc,
            run_history=self.rh,
            time_bound=np.inf,
            result=result,
        )
        self.assertEqual(inc, self.config1)
        self.assertEqual(self.stats.ta_runs, 3)
        self.assertEqual(list(self.rh.data.values())[2][2], StatusType.TIMEOUT)
Italian Trulli
In pattern: SUPERPATTERN

Frequency: 3

Non-data size: 5

Instances


Project Name: automl/SMAC3
Commit Name: 22d54408bf1bf47841a5798ebbeaba858f13fc76
Time: 2020-08-14
Author: 44504424+franchuterivera@users.noreply.github.com
File Name: test/test_intensify/test_successive_halving.py
Class Name: TestSuccessiveHalving
Method Name: test_eval_challenger_2


Project Name: automl/SMAC3
Commit Name: 22d54408bf1bf47841a5798ebbeaba858f13fc76
Time: 2020-08-14
Author: 44504424+franchuterivera@users.noreply.github.com
File Name: test/test_intensify/test_successive_halving.py
Class Name: TestSuccessiveHalving
Method Name: test_eval_challenger_capping


Project Name: automl/SMAC3
Commit Name: 22d54408bf1bf47841a5798ebbeaba858f13fc76
Time: 2020-08-14
Author: 44504424+franchuterivera@users.noreply.github.com
File Name: test/test_intensify/test_hyperband.py
Class Name: TestHyperband
Method Name: test_eval_challenger