Skip to content

Commit fe4e62f

Browse files
author
Github Actions
committed
Francisco Rivera Valverde: [Bug] Fix random halt problems on traditional pipelines (#147)
1 parent c017f5c commit fe4e62f

17 files changed

+383
-361
lines changed

‎refactor_development/_downloads/2f0f54a9831653ac5c12ee0e06324a62/basics_tabular_jupyter.zip

0 Bytes
Binary file not shown.

‎refactor_development/_downloads/8ef6602cf8ed40221edd89244fb031af/basics_tabular_python.zip

0 Bytes
Binary file not shown.

‎refactor_development/_downloads/b38295cf56f02b1c4547385a8f389f90/advanced_tabular_python.zip

0 Bytes
Binary file not shown.

‎refactor_development/_downloads/df038041811db9bd567de83692a8f994/advanced_tabular_jupyter.zip

0 Bytes
Binary file not shown.

‎refactor_development/_sources/advanced_tabular/example_custom_configuration_space.rst.txt

Lines changed: 30 additions & 78 deletions
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ the search. Currently, there are two changes that can be made to the space:-
4646

4747
.. code-block:: none
4848
49-
<smac.runhistory.runhistory.RunHistory object at 0x7ff8fe8a32e0> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
49+
<smac.runhistory.runhistory.RunHistory object at 0x7feb53ac81f0> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
5050
data_loader:batch_size, Value: 32
5151
encoder:__choice__, Value: 'OneHotEncoder'
5252
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
@@ -80,7 +80,7 @@ the search. Currently, there are two changes that can be made to the space:-
8080
scaler:__choice__, Value: 'StandardScaler'
8181
trainer:StandardTrainer:weighted_loss, Value: True
8282
trainer:__choice__, Value: 'StandardTrainer'
83-
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.0020105838775634766, budget=0), TrajEntry(train_perf=0.16374269005847952, incumbent_id=1, incumbent=Configuration:
83+
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.0019004344940185547, budget=0), TrajEntry(train_perf=0.15204678362573099, incumbent_id=1, incumbent=Configuration:
8484
data_loader:batch_size, Value: 32
8585
encoder:__choice__, Value: 'OneHotEncoder'
8686
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
@@ -114,70 +114,20 @@ the search. Currently, there are two changes that can be made to the space:-
114114
scaler:__choice__, Value: 'StandardScaler'
115115
trainer:StandardTrainer:weighted_loss, Value: True
116116
trainer:__choice__, Value: 'StandardTrainer'
117-
, ta_runs=1, ta_time_used=5.319528579711914, wallclock_time=6.774984359741211, budget=5.555555555555555), TrajEntry(train_perf=0.15204678362573099, incumbent_id=2, incumbent=Configuration:
118-
data_loader:batch_size, Value: 475
119-
encoder:__choice__, Value: 'OneHotEncoder'
120-
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
121-
imputer:categorical_strategy, Value: 'most_frequent'
122-
imputer:numerical_strategy, Value: 'constant_zero'
123-
lr_scheduler:__choice__, Value: 'NoScheduler'
124-
network_backbone:MLPBackbone:activation, Value: 'tanh'
125-
network_backbone:MLPBackbone:dropout_1, Value: 0.579891279191762
126-
network_backbone:MLPBackbone:dropout_2, Value: 0.43202885747368863
127-
network_backbone:MLPBackbone:dropout_3, Value: 0.2053050533304992
128-
network_backbone:MLPBackbone:dropout_4, Value: 0.3628626567848122
129-
network_backbone:MLPBackbone:dropout_5, Value: 0.000687232634536894
130-
network_backbone:MLPBackbone:dropout_6, Value: 0.30779918180581656
131-
network_backbone:MLPBackbone:dropout_7, Value: 0.4566654226669556
132-
network_backbone:MLPBackbone:num_groups, Value: 7
133-
network_backbone:MLPBackbone:num_units_1, Value: 749
134-
network_backbone:MLPBackbone:num_units_2, Value: 751
135-
network_backbone:MLPBackbone:num_units_3, Value: 759
136-
network_backbone:MLPBackbone:num_units_4, Value: 664
137-
network_backbone:MLPBackbone:num_units_5, Value: 219
138-
network_backbone:MLPBackbone:num_units_6, Value: 757
139-
network_backbone:MLPBackbone:num_units_7, Value: 1005
140-
network_backbone:MLPBackbone:use_dropout, Value: True
141-
network_backbone:__choice__, Value: 'MLPBackbone'
142-
network_embedding:LearnedEntityEmbedding:dimension_reduction_0, Value: 0.9640640623783606
143-
network_embedding:LearnedEntityEmbedding:dimension_reduction_1, Value: 0.017233504391813814
144-
network_embedding:LearnedEntityEmbedding:dimension_reduction_2, Value: 0.24122690885917664
145-
network_embedding:LearnedEntityEmbedding:dimension_reduction_3, Value: 0.31247176333246596
146-
network_embedding:LearnedEntityEmbedding:dimension_reduction_4, Value: 0.41504826813841933
147-
network_embedding:LearnedEntityEmbedding:dimension_reduction_5, Value: 0.8395119637200936
148-
network_embedding:LearnedEntityEmbedding:dimension_reduction_6, Value: 0.8208414027523236
149-
network_embedding:LearnedEntityEmbedding:dimension_reduction_7, Value: 0.4284420622613293
150-
network_embedding:LearnedEntityEmbedding:min_unique_values_for_embedding, Value: 7
151-
network_embedding:__choice__, Value: 'LearnedEntityEmbedding'
152-
network_head:__choice__, Value: 'fully_connected'
153-
network_head:fully_connected:num_layers, Value: 1
154-
network_init:KaimingInit:bias_strategy, Value: 'Zero'
155-
network_init:__choice__, Value: 'KaimingInit'
156-
optimizer:AdamOptimizer:beta1, Value: 0.9770847327434384
157-
optimizer:AdamOptimizer:beta2, Value: 0.9710627513919582
158-
optimizer:AdamOptimizer:lr, Value: 0.00010844892447274338
159-
optimizer:AdamOptimizer:weight_decay, Value: 0.05048412416506887
160-
optimizer:__choice__, Value: 'AdamOptimizer'
161-
scaler:Normalizer:norm, Value: 'max'
162-
scaler:__choice__, Value: 'Normalizer'
163-
trainer:StandardTrainer:weighted_loss, Value: False
164-
trainer:__choice__, Value: 'StandardTrainer'
165-
, ta_runs=11, ta_time_used=94.9950180053711, wallclock_time=118.93319940567017, budget=16.666666666666664)]
166-
{'accuracy': 0.8728323699421965}
167-
| | Preprocessing | Estimator | Weight |
168-
|---:|:------------------------------------------------------------------|:-------------------------------------------------------------|---------:|
169-
| 0 | None | CatBoostClassifier | 0.3 |
170-
| 1 | None | ExtraTreesClassifier | 0.2 |
171-
| 2 | SimpleImputer,OneHotEncoder,Normalizer,KernelPCA | embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.1 |
172-
| 3 | SimpleImputer,OneHotEncoder,Normalizer,NoFeaturePreprocessing | embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.08 |
173-
| 4 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.08 |
174-
| 5 | None | KNNClassifier | 0.06 |
175-
| 6 | SimpleImputer,OneHotEncoder,StandardScaler,PowerTransformer | no embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
176-
| 7 | SimpleImputer,OneHotEncoder,Normalizer,NoFeaturePreprocessing | embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
177-
| 8 | None | RFClassifier | 0.04 |
178-
| 9 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
179-
| 10 | None | LGBMClassifier | 0.02 |
180-
<smac.runhistory.runhistory.RunHistory object at 0x7ff8fc230d60> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
117+
, ta_runs=1, ta_time_used=4.839858293533325, wallclock_time=6.2596399784088135, budget=5.555555555555555)]
118+
{'accuracy': 0.8670520231213873}
119+
| | Preprocessing | Estimator | Weight |
120+
|---:|:------------------------------------------------------------------|:----------------------------------------------------------|---------:|
121+
| 0 | None | ExtraTreesClassifier | 0.26 |
122+
| 1 | None | CatBoostClassifier | 0.16 |
123+
| 2 | SimpleImputer,OneHotEncoder,Normalizer,KernelPCA | embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.14 |
124+
| 3 | None | RFClassifier | 0.14 |
125+
| 4 | SimpleImputer,OneHotEncoder,Normalizer,KernelPCA | embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.1 |
126+
| 5 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.1 |
127+
| 6 | None | KNNClassifier | 0.06 |
128+
| 7 | None | LGBMClassifier | 0.02 |
129+
| 8 | SimpleImputer,OneHotEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,MLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
130+
<smac.runhistory.runhistory.RunHistory object at 0x7feb6880ef40> [TrajEntry(train_perf=2147483648, incumbent_id=1, incumbent=Configuration:
181131
data_loader:batch_size, Value: 32
182132
encoder:__choice__, Value: 'NoEncoder'
183133
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
@@ -209,7 +159,7 @@ the search. Currently, there are two changes that can be made to the space:-
209159
scaler:__choice__, Value: 'StandardScaler'
210160
trainer:StandardTrainer:weighted_loss, Value: True
211161
trainer:__choice__, Value: 'StandardTrainer'
212-
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.001617431640625, budget=0), TrajEntry(train_perf=0.21052631578947367, incumbent_id=1, incumbent=Configuration:
162+
, ta_runs=0, ta_time_used=0.0, wallclock_time=0.0013895034790039062, budget=0), TrajEntry(train_perf=0.22807017543859653, incumbent_id=1, incumbent=Configuration:
213163
data_loader:batch_size, Value: 32
214164
encoder:__choice__, Value: 'NoEncoder'
215165
feature_preprocessor:__choice__, Value: 'NoFeaturePreprocessor'
@@ -241,16 +191,18 @@ the search. Currently, there are two changes that can be made to the space:-
241191
scaler:__choice__, Value: 'StandardScaler'
242192
trainer:StandardTrainer:weighted_loss, Value: True
243193
trainer:__choice__, Value: 'StandardTrainer'
244-
, ta_runs=1, ta_time_used=4.8831260204315186, wallclock_time=6.359606027603149, budget=5.555555555555555)]
245-
{'accuracy': 0.8670520231213873}
246-
| | Preprocessing | Estimator | Weight |
247-
|---:|:----------------|:---------------------|---------:|
248-
| 0 | None | ExtraTreesClassifier | 0.28 |
249-
| 1 | None | CatBoostClassifier | 0.22 |
250-
| 2 | None | RFClassifier | 0.22 |
251-
| 3 | None | KNNClassifier | 0.14 |
252-
| 4 | None | LGBMClassifier | 0.1 |
253-
| 5 | None | SVC | 0.04 |
194+
, ta_runs=1, ta_time_used=3.9459877014160156, wallclock_time=5.365888833999634, budget=5.555555555555555)]
195+
{'accuracy': 0.8554913294797688}
196+
| | Preprocessing | Estimator | Weight |
197+
|---:|:--------------------------------------------------------------|:-------------------------------------------------------------------|---------:|
198+
| 0 | None | CatBoostClassifier | 0.34 |
199+
| 1 | None | RFClassifier | 0.22 |
200+
| 2 | SimpleImputer,NoEncoder,MinMaxScaler,KitchenSink | no embedding,ResNetBackbone,FullyConnectedHead,nn.Sequential | 0.12 |
201+
| 3 | None | ExtraTreesClassifier | 0.1 |
202+
| 4 | None | KNNClassifier | 0.1 |
203+
| 5 | None | SVC | 0.06 |
204+
| 6 | SimpleImputer,NoEncoder,MinMaxScaler,KitchenSink | no embedding,ShapedResNetBackbone,FullyConnectedHead,nn.Sequential | 0.04 |
205+
| 7 | SimpleImputer,NoEncoder,StandardScaler,NoFeaturePreprocessing | no embedding,ShapedMLPBackbone,FullyConnectedHead,nn.Sequential | 0.02 |
254206
255207
256208
@@ -379,7 +331,7 @@ the search. Currently, there are two changes that can be made to the space:-
379331
380332
.. rst-class:: sphx-glr-timing
381333

382-
**Total running time of the script:** ( 11 minutes 42.274 seconds)
334+
**Total running time of the script:** ( 11 minutes 39.293 seconds)
383335

384336

385337
.. _sphx_glr_download_advanced_tabular_example_custom_configuration_space.py:

0 commit comments

Comments
 (0)