1164 lines
32 KiB
Plaintext
1164 lines
32 KiB
Plaintext
Scenario 2 — Superconduct
|
||
===============================
|
||
|
||
Loading dataset (superconduct.csv)...
|
||
Done: 21263 samples, 81 features + 1 target
|
||
|
||
Splitting dataset into Train/Val/Test [0.6/0.2/0.2] ...
|
||
Done: Train=12758, Val=4253, Test=4252
|
||
Preprocessing (Min–Max scaling to [0,1]) ...
|
||
Done (mode = minmax)
|
||
|
||
Starting 4×4 grid-search (5 folds per point)...
|
||
Combo: features= 5 | radius=0.25 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 236
|
||
Number of linear parameters: 114
|
||
Number of nonlinear parameters: 190
|
||
Total number of parameters: 304
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 19
|
||
Minimal training RMSE = 15.7836
|
||
Minimal checking RMSE = 16.9268
|
||
Done (val err=16.93, rules=19)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 200
|
||
Number of linear parameters: 96
|
||
Number of nonlinear parameters: 160
|
||
Total number of parameters: 256
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 16
|
||
Minimal training RMSE = 15.8171
|
||
Minimal checking RMSE = 16.3645
|
||
Done (val err=16.36, rules=16)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 236
|
||
Number of linear parameters: 114
|
||
Number of nonlinear parameters: 190
|
||
Total number of parameters: 304
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 19
|
||
Minimal training RMSE = 16.13
|
||
Minimal checking RMSE = 15.7719
|
||
Done (val err=15.77, rules=19)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 236
|
||
Number of linear parameters: 114
|
||
Number of nonlinear parameters: 190
|
||
Total number of parameters: 304
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 19
|
||
Minimal training RMSE = 16.5322
|
||
Minimal checking RMSE = 17.6514
|
||
Done (val err=17.65, rules=19)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 272
|
||
Number of linear parameters: 132
|
||
Number of nonlinear parameters: 220
|
||
Total number of parameters: 352
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 22
|
||
Minimal training RMSE = 14.9743
|
||
Minimal checking RMSE = 16.4571
|
||
Done (val err=16.46, rules=22)
|
||
Mean CV error=16.63 | Mean rules=19
|
||
|
||
Combo: features= 5 | radius=0.50 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 92
|
||
Number of linear parameters: 42
|
||
Number of nonlinear parameters: 70
|
||
Total number of parameters: 112
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 7
|
||
Minimal training RMSE = 17.9256
|
||
Minimal checking RMSE = 18.1179
|
||
Done (val err=18.12, rules=7)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 80
|
||
Number of linear parameters: 36
|
||
Number of nonlinear parameters: 60
|
||
Total number of parameters: 96
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 17.6373
|
||
Minimal checking RMSE = 17.7761
|
||
Done (val err=17.78, rules=6)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 92
|
||
Number of linear parameters: 42
|
||
Number of nonlinear parameters: 70
|
||
Total number of parameters: 112
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 7
|
||
Minimal training RMSE = 18.0589
|
||
Minimal checking RMSE = 17.5949
|
||
Done (val err=17.59, rules=7)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 80
|
||
Number of linear parameters: 36
|
||
Number of nonlinear parameters: 60
|
||
Total number of parameters: 96
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 18.2378
|
||
Minimal checking RMSE = 18.8867
|
||
Done (val err=18.89, rules=6)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 92
|
||
Number of linear parameters: 42
|
||
Number of nonlinear parameters: 70
|
||
Total number of parameters: 112
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 7
|
||
Minimal training RMSE = 17.3576
|
||
Minimal checking RMSE = 18.1061
|
||
Done (val err=18.11, rules=7)
|
||
Mean CV error=18.1 | Mean rules=7
|
||
|
||
Combo: features= 5 | radius=0.75 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 32
|
||
Number of linear parameters: 12
|
||
Number of nonlinear parameters: 20
|
||
Total number of parameters: 32
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 19.9419
|
||
Minimal checking RMSE = 20.0512
|
||
Done (val err=20.05, rules=2)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 32
|
||
Number of linear parameters: 12
|
||
Number of nonlinear parameters: 20
|
||
Total number of parameters: 32
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 20.1088
|
||
Minimal checking RMSE = 19.8173
|
||
Done (val err=19.82, rules=2)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 32
|
||
Number of linear parameters: 12
|
||
Number of nonlinear parameters: 20
|
||
Total number of parameters: 32
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 20.0146
|
||
Minimal checking RMSE = 19.2656
|
||
Done (val err=19.27, rules=2)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 32
|
||
Number of linear parameters: 12
|
||
Number of nonlinear parameters: 20
|
||
Total number of parameters: 32
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 19.1462
|
||
Minimal checking RMSE = 19.5171
|
||
Done (val err=19.52, rules=2)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 44
|
||
Number of linear parameters: 18
|
||
Number of nonlinear parameters: 30
|
||
Total number of parameters: 48
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 18.3565
|
||
Minimal checking RMSE = 18.9357
|
||
Done (val err=18.94, rules=3)
|
||
Mean CV error=19.52 | Mean rules=2
|
||
|
||
Combo: features= 5 | radius=1.00 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 32
|
||
Number of linear parameters: 12
|
||
Number of nonlinear parameters: 20
|
||
Total number of parameters: 32
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 20.4669
|
||
Minimal checking RMSE = 20.6894
|
||
Done (val err=20.69, rules=2)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 32
|
||
Number of linear parameters: 12
|
||
Number of nonlinear parameters: 20
|
||
Total number of parameters: 32
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 19.8095
|
||
Minimal checking RMSE = 19.9228
|
||
Done (val err=19.92, rules=2)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 32
|
||
Number of linear parameters: 12
|
||
Number of nonlinear parameters: 20
|
||
Total number of parameters: 32
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 20.7212
|
||
Minimal checking RMSE = 19.7373
|
||
Done (val err=19.74, rules=2)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 32
|
||
Number of linear parameters: 12
|
||
Number of nonlinear parameters: 20
|
||
Total number of parameters: 32
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 19.1987
|
||
Minimal checking RMSE = 19.5712
|
||
Done (val err=19.57, rules=2)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 32
|
||
Number of linear parameters: 12
|
||
Number of nonlinear parameters: 20
|
||
Total number of parameters: 32
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 18.6435
|
||
Minimal checking RMSE = 19.178
|
||
Done (val err=19.18, rules=2)
|
||
Mean CV error=19.82 | Mean rules=2
|
||
|
||
Combo: features= 8 | radius=0.25 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 281
|
||
Number of linear parameters: 135
|
||
Number of nonlinear parameters: 240
|
||
Total number of parameters: 375
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 15
|
||
Minimal training RMSE = 15.298
|
||
Minimal checking RMSE = 16.3193
|
||
Done (val err=16.32, rules=15)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 245
|
||
Number of linear parameters: 117
|
||
Number of nonlinear parameters: 208
|
||
Total number of parameters: 325
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 13
|
||
Minimal training RMSE = 14.7955
|
||
Minimal checking RMSE = 14.9195
|
||
Done (val err=14.92, rules=13)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 245
|
||
Number of linear parameters: 117
|
||
Number of nonlinear parameters: 208
|
||
Total number of parameters: 325
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 13
|
||
Minimal training RMSE = 15.6424
|
||
Minimal checking RMSE = 16.2224
|
||
Done (val err=16.22, rules=13)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 245
|
||
Number of linear parameters: 117
|
||
Number of nonlinear parameters: 208
|
||
Total number of parameters: 325
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 13
|
||
Minimal training RMSE = 15.4958
|
||
Minimal checking RMSE = 16.5262
|
||
Done (val err=16.53, rules=13)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 353
|
||
Number of linear parameters: 171
|
||
Number of nonlinear parameters: 304
|
||
Total number of parameters: 475
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 19
|
||
Minimal training RMSE = 14.2437
|
||
Minimal checking RMSE = 16.5257
|
||
Done (val err=16.53, rules=19)
|
||
Mean CV error=16.1 | Mean rules=15
|
||
|
||
Combo: features= 8 | radius=0.50 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 119
|
||
Number of linear parameters: 54
|
||
Number of nonlinear parameters: 96
|
||
Total number of parameters: 150
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 17.896
|
||
Minimal checking RMSE = 18.1968
|
||
Done (val err=18.2, rules=6)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 119
|
||
Number of linear parameters: 54
|
||
Number of nonlinear parameters: 96
|
||
Total number of parameters: 150
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 16.3278
|
||
Minimal checking RMSE = 16.4278
|
||
Done (val err=16.43, rules=6)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 119
|
||
Number of linear parameters: 54
|
||
Number of nonlinear parameters: 96
|
||
Total number of parameters: 150
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 17.7274
|
||
Minimal checking RMSE = 17.4127
|
||
Done (val err=17.41, rules=6)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 119
|
||
Number of linear parameters: 54
|
||
Number of nonlinear parameters: 96
|
||
Total number of parameters: 150
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 17.2612
|
||
Minimal checking RMSE = 17.9865
|
||
Done (val err=17.99, rules=6)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 155
|
||
Number of linear parameters: 72
|
||
Number of nonlinear parameters: 128
|
||
Total number of parameters: 200
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 8
|
||
Minimal training RMSE = 15.7811
|
||
Minimal checking RMSE = 17.1552
|
||
Done (val err=17.16, rules=8)
|
||
Mean CV error=17.44 | Mean rules=6
|
||
|
||
Combo: features= 8 | radius=0.75 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 47
|
||
Number of linear parameters: 18
|
||
Number of nonlinear parameters: 32
|
||
Total number of parameters: 50
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 19.4034
|
||
Minimal checking RMSE = 19.5553
|
||
Done (val err=19.56, rules=2)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 83
|
||
Number of linear parameters: 36
|
||
Number of nonlinear parameters: 64
|
||
Total number of parameters: 100
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 4
|
||
Minimal training RMSE = 17.0755
|
||
Minimal checking RMSE = 16.8688
|
||
Done (val err=16.87, rules=4)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 65
|
||
Number of linear parameters: 27
|
||
Number of nonlinear parameters: 48
|
||
Total number of parameters: 75
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 18.6173
|
||
Minimal checking RMSE = 17.8697
|
||
Done (val err=17.87, rules=3)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 65
|
||
Number of linear parameters: 27
|
||
Number of nonlinear parameters: 48
|
||
Total number of parameters: 75
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 18.83
|
||
Minimal checking RMSE = 19.202
|
||
Done (val err=19.2, rules=3)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 65
|
||
Number of linear parameters: 27
|
||
Number of nonlinear parameters: 48
|
||
Total number of parameters: 75
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 17.5332
|
||
Minimal checking RMSE = 18.2577
|
||
Done (val err=18.26, rules=3)
|
||
Mean CV error=18.35 | Mean rules=3
|
||
|
||
Combo: features= 8 | radius=1.00 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 47
|
||
Number of linear parameters: 18
|
||
Number of nonlinear parameters: 32
|
||
Total number of parameters: 50
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 19.5283
|
||
Minimal checking RMSE = 19.5691
|
||
Done (val err=19.57, rules=2)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 47
|
||
Number of linear parameters: 18
|
||
Number of nonlinear parameters: 32
|
||
Total number of parameters: 50
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 19.2033
|
||
Minimal checking RMSE = 19.1913
|
||
Done (val err=19.19, rules=2)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 47
|
||
Number of linear parameters: 18
|
||
Number of nonlinear parameters: 32
|
||
Total number of parameters: 50
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 19.1993
|
||
Minimal checking RMSE = 18.4481
|
||
Done (val err=18.45, rules=2)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 47
|
||
Number of linear parameters: 18
|
||
Number of nonlinear parameters: 32
|
||
Total number of parameters: 50
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 18.9938
|
||
Minimal checking RMSE = 19.3295
|
||
Done (val err=19.33, rules=2)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 47
|
||
Number of linear parameters: 18
|
||
Number of nonlinear parameters: 32
|
||
Total number of parameters: 50
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 17.9908
|
||
Minimal checking RMSE = 18.5687
|
||
Done (val err=18.57, rules=2)
|
||
Mean CV error=19.02 | Mean rules=2
|
||
|
||
Combo: features=11 | radius=0.25 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 446
|
||
Number of linear parameters: 216
|
||
Number of nonlinear parameters: 396
|
||
Total number of parameters: 612
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 18
|
||
Minimal training RMSE = 13.7504
|
||
Minimal checking RMSE = 15.2325
|
||
Done (val err=15.23, rules=18)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 254
|
||
Number of linear parameters: 120
|
||
Number of nonlinear parameters: 220
|
||
Total number of parameters: 340
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 10
|
||
Minimal training RMSE = 14.3238
|
||
Minimal checking RMSE = 14.6324
|
||
Done (val err=14.63, rules=10)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 302
|
||
Number of linear parameters: 144
|
||
Number of nonlinear parameters: 264
|
||
Total number of parameters: 408
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 12
|
||
Minimal training RMSE = 14.3775
|
||
Minimal checking RMSE = 14.6128
|
||
Done (val err=14.61, rules=12)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 350
|
||
Number of linear parameters: 168
|
||
Number of nonlinear parameters: 308
|
||
Total number of parameters: 476
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 14
|
||
Minimal training RMSE = 14.4699
|
||
Minimal checking RMSE = 15.743
|
||
Done (val err=15.74, rules=14)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 518
|
||
Number of linear parameters: 252
|
||
Number of nonlinear parameters: 462
|
||
Total number of parameters: 714
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 21
|
||
Minimal training RMSE = 13.0901
|
||
Minimal checking RMSE = 15.7968
|
||
Done (val err=15.8, rules=21)
|
||
Mean CV error=15.2 | Mean rules=15
|
||
|
||
Combo: features=11 | radius=0.50 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 182
|
||
Number of linear parameters: 84
|
||
Number of nonlinear parameters: 154
|
||
Total number of parameters: 238
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 7
|
||
Minimal training RMSE = 15.7456
|
||
Minimal checking RMSE = 16.1886
|
||
Done (val err=16.19, rules=7)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 134
|
||
Number of linear parameters: 60
|
||
Number of nonlinear parameters: 110
|
||
Total number of parameters: 170
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 5
|
||
Minimal training RMSE = 16.0329
|
||
Minimal checking RMSE = 15.9401
|
||
Done (val err=15.94, rules=5)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 158
|
||
Number of linear parameters: 72
|
||
Number of nonlinear parameters: 132
|
||
Total number of parameters: 204
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 15.9401
|
||
Minimal checking RMSE = 15.4687
|
||
Done (val err=15.47, rules=6)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 158
|
||
Number of linear parameters: 72
|
||
Number of nonlinear parameters: 132
|
||
Total number of parameters: 204
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 15.9801
|
||
Minimal checking RMSE = 16.4583
|
||
Done (val err=16.46, rules=6)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 230
|
||
Number of linear parameters: 108
|
||
Number of nonlinear parameters: 198
|
||
Total number of parameters: 306
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 9
|
||
Minimal training RMSE = 15.0653
|
||
Minimal checking RMSE = 17.0165
|
||
Done (val err=17.02, rules=9)
|
||
Mean CV error=16.21 | Mean rules=7
|
||
|
||
Combo: features=11 | radius=0.75 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 86
|
||
Number of linear parameters: 36
|
||
Number of nonlinear parameters: 66
|
||
Total number of parameters: 102
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 17.3221
|
||
Minimal checking RMSE = 17.4577
|
||
Done (val err=17.46, rules=3)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 110
|
||
Number of linear parameters: 48
|
||
Number of nonlinear parameters: 88
|
||
Total number of parameters: 136
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 4
|
||
Minimal training RMSE = 16.422
|
||
Minimal checking RMSE = 16.1376
|
||
Done (val err=16.14, rules=4)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 86
|
||
Number of linear parameters: 36
|
||
Number of nonlinear parameters: 66
|
||
Total number of parameters: 102
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 17.5334
|
||
Minimal checking RMSE = 16.7568
|
||
Done (val err=16.76, rules=3)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 86
|
||
Number of linear parameters: 36
|
||
Number of nonlinear parameters: 66
|
||
Total number of parameters: 102
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 17.2282
|
||
Minimal checking RMSE = 17.5204
|
||
Done (val err=17.52, rules=3)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 134
|
||
Number of linear parameters: 60
|
||
Number of nonlinear parameters: 110
|
||
Total number of parameters: 170
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 5
|
||
Minimal training RMSE = 16.7974
|
||
Minimal checking RMSE = 17.6722
|
||
Done (val err=17.67, rules=5)
|
||
Mean CV error=17.11 | Mean rules=4
|
||
|
||
Combo: features=11 | radius=1.00 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 62
|
||
Number of linear parameters: 24
|
||
Number of nonlinear parameters: 44
|
||
Total number of parameters: 68
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 17.853
|
||
Minimal checking RMSE = 17.8974
|
||
Done (val err=17.9, rules=2)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 86
|
||
Number of linear parameters: 36
|
||
Number of nonlinear parameters: 66
|
||
Total number of parameters: 102
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 16.8036
|
||
Minimal checking RMSE = 16.7501
|
||
Done (val err=16.75, rules=3)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 62
|
||
Number of linear parameters: 24
|
||
Number of nonlinear parameters: 44
|
||
Total number of parameters: 68
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 17.5991
|
||
Minimal checking RMSE = 16.8333
|
||
Done (val err=16.83, rules=2)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 62
|
||
Number of linear parameters: 24
|
||
Number of nonlinear parameters: 44
|
||
Total number of parameters: 68
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 17.5433
|
||
Minimal checking RMSE = 17.8776
|
||
Done (val err=17.88, rules=2)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 62
|
||
Number of linear parameters: 24
|
||
Number of nonlinear parameters: 44
|
||
Total number of parameters: 68
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 17.8157
|
||
Minimal checking RMSE = 18.436
|
||
Done (val err=18.44, rules=2)
|
||
Mean CV error=17.56 | Mean rules=2
|
||
|
||
Combo: features=15 | radius=0.25 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 530
|
||
Number of linear parameters: 256
|
||
Number of nonlinear parameters: 480
|
||
Total number of parameters: 736
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 16
|
||
Minimal training RMSE = 13.9086
|
||
Minimal checking RMSE = 16.0272
|
||
Done (val err=16.03, rules=16)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 370
|
||
Number of linear parameters: 176
|
||
Number of nonlinear parameters: 330
|
||
Total number of parameters: 506
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 11
|
||
Minimal training RMSE = 13.8836
|
||
Minimal checking RMSE = 14.6699
|
||
Done (val err=14.67, rules=11)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 338
|
||
Number of linear parameters: 160
|
||
Number of nonlinear parameters: 300
|
||
Total number of parameters: 460
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 10
|
||
Minimal training RMSE = 13.4554
|
||
Minimal checking RMSE = 13.9392
|
||
Done (val err=13.94, rules=10)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 466
|
||
Number of linear parameters: 224
|
||
Number of nonlinear parameters: 420
|
||
Total number of parameters: 644
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 14
|
||
Minimal training RMSE = 13.9538
|
||
Minimal checking RMSE = 14.9999
|
||
Done (val err=15, rules=14)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 594
|
||
Number of linear parameters: 288
|
||
Number of nonlinear parameters: 540
|
||
Total number of parameters: 828
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 18
|
||
Minimal training RMSE = 12.6612
|
||
Minimal checking RMSE = 15.832
|
||
Done (val err=15.83, rules=18)
|
||
Mean CV error=15.09 | Mean rules=14
|
||
|
||
Combo: features=15 | radius=0.50 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 274
|
||
Number of linear parameters: 128
|
||
Number of nonlinear parameters: 240
|
||
Total number of parameters: 368
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 8
|
||
Minimal training RMSE = 15.0209
|
||
Minimal checking RMSE = 15.4702
|
||
Done (val err=15.47, rules=8)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 210
|
||
Number of linear parameters: 96
|
||
Number of nonlinear parameters: 180
|
||
Total number of parameters: 276
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 14.5644
|
||
Minimal checking RMSE = 14.8088
|
||
Done (val err=14.81, rules=6)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 178
|
||
Number of linear parameters: 80
|
||
Number of nonlinear parameters: 150
|
||
Total number of parameters: 230
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 5
|
||
Minimal training RMSE = 15.3896
|
||
Minimal checking RMSE = 14.7756
|
||
Done (val err=14.78, rules=5)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 242
|
||
Number of linear parameters: 112
|
||
Number of nonlinear parameters: 210
|
||
Total number of parameters: 322
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 7
|
||
Minimal training RMSE = 15.0772
|
||
Minimal checking RMSE = 15.9323
|
||
Done (val err=15.93, rules=7)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 274
|
||
Number of linear parameters: 128
|
||
Number of nonlinear parameters: 240
|
||
Total number of parameters: 368
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 8
|
||
Minimal training RMSE = 14.7794
|
||
Minimal checking RMSE = 16.3325
|
||
Done (val err=16.33, rules=8)
|
||
Mean CV error=15.46 | Mean rules=7
|
||
|
||
Combo: features=15 | radius=0.75 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 146
|
||
Number of linear parameters: 64
|
||
Number of nonlinear parameters: 120
|
||
Total number of parameters: 184
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 4
|
||
Minimal training RMSE = 16.8091
|
||
Minimal checking RMSE = 16.822
|
||
Done (val err=16.82, rules=4)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 146
|
||
Number of linear parameters: 64
|
||
Number of nonlinear parameters: 120
|
||
Total number of parameters: 184
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 4
|
||
Minimal training RMSE = 15.8898
|
||
Minimal checking RMSE = 15.9417
|
||
Done (val err=15.94, rules=4)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 146
|
||
Number of linear parameters: 64
|
||
Number of nonlinear parameters: 120
|
||
Total number of parameters: 184
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 4
|
||
Minimal training RMSE = 15.818
|
||
Minimal checking RMSE = 15.1979
|
||
Done (val err=15.2, rules=4)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 178
|
||
Number of linear parameters: 80
|
||
Number of nonlinear parameters: 150
|
||
Total number of parameters: 230
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 5
|
||
Minimal training RMSE = 15.4317
|
||
Minimal checking RMSE = 16.0448
|
||
Done (val err=16.04, rules=5)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 210
|
||
Number of linear parameters: 96
|
||
Number of nonlinear parameters: 180
|
||
Total number of parameters: 276
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 6
|
||
Minimal training RMSE = 14.6559
|
||
Minimal checking RMSE = 16.1443
|
||
Done (val err=16.14, rules=6)
|
||
Mean CV error=16.03 | Mean rules=5
|
||
|
||
Combo: features=15 | radius=1.00 ...
|
||
Fold 1/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 82
|
||
Number of linear parameters: 32
|
||
Number of nonlinear parameters: 60
|
||
Total number of parameters: 92
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 17.4608
|
||
Minimal checking RMSE = 17.2872
|
||
Done (val err=17.29, rules=2)
|
||
Fold 2/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 146
|
||
Number of linear parameters: 64
|
||
Number of nonlinear parameters: 120
|
||
Total number of parameters: 184
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 4
|
||
Minimal training RMSE = 16.2855
|
||
Minimal checking RMSE = 16.1234
|
||
Done (val err=16.12, rules=4)
|
||
Fold 3/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 114
|
||
Number of linear parameters: 48
|
||
Number of nonlinear parameters: 90
|
||
Total number of parameters: 138
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 17.0386
|
||
Minimal checking RMSE = 16.3713
|
||
Done (val err=16.37, rules=3)
|
||
Fold 4/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 82
|
||
Number of linear parameters: 32
|
||
Number of nonlinear parameters: 60
|
||
Total number of parameters: 92
|
||
Number of training data pairs: 10206
|
||
Number of checking data pairs: 2552
|
||
Number of fuzzy rules: 2
|
||
Minimal training RMSE = 16.9646
|
||
Minimal checking RMSE = 17.534
|
||
Done (val err=17.53, rules=2)
|
||
Fold 5/5 ...
|
||
ANFIS info:
|
||
Number of nodes: 114
|
||
Number of linear parameters: 48
|
||
Number of nonlinear parameters: 90
|
||
Total number of parameters: 138
|
||
Number of training data pairs: 10207
|
||
Number of checking data pairs: 2551
|
||
Number of fuzzy rules: 3
|
||
Minimal training RMSE = 16.9582
|
||
Minimal checking RMSE = 17.919
|
||
Done (val err=17.92, rules=3)
|
||
Mean CV error=17.05 | Mean rules=3
|
||
|
||
Grid-search completed.
|
||
|
||
Best combo found: features=15, radius=0.25
|
||
Mean CV error : 15.09
|
||
===========================================
|
||
|
||
Final training using best hyper-parameters...
|
||
Selected 15 features (ReliefF top indices)
|
||
Building initial FIS (SC radius=0.25)...
|
||
Initial FIS created with 12 rules
|
||
Training ANFIS (Hybrid optimization)...
|
||
|
||
ANFIS info:
|
||
Number of nodes: 402
|
||
Number of linear parameters: 192
|
||
Number of nonlinear parameters: 360
|
||
Total number of parameters: 552
|
||
Number of training data pairs: 12758
|
||
Number of checking data pairs: 4253
|
||
Number of fuzzy rules: 12
|
||
|
||
|
||
Start training ANFIS ...
|
||
|
||
1 15.8964 16.1264
|
||
2 15.8212 16.341
|
||
3 15.6143 15.8382
|
||
4 15.5377 15.9095
|
||
5 15.4153 15.9569
|
||
6 15.4801 15.8686
|
||
7 15.3094 15.7575
|
||
8 15.1577 15.6762
|
||
9 15.0513 15.5203
|
||
10 14.9358 15.3711
|
||
11 14.8695 15.2892
|
||
12 14.7912 15.1338
|
||
13 14.7369 15.1482
|
||
14 14.6722 14.9784
|
||
15 14.6512 15.0368
|
||
16 14.6272 14.8674
|
||
17 14.5785 14.9091
|
||
18 14.5365 14.7692
|
||
19 14.5133 14.8321
|
||
20 14.5066 14.7143
|
||
21 14.454 14.7454
|
||
22 14.4295 14.6143
|
||
23 14.4029 14.6614
|
||
24 14.3453 14.5473
|
||
25 14.3936 14.6608
|
||
26 14.3325 14.5342
|
||
27 14.3455 14.499
|
||
28 14.2873 14.4988
|
||
29 14.2322 14.401
|
||
30 14.2347 14.4209
|
||
31 14.2012 14.4202
|
||
32 14.1669 14.3469
|
||
33 14.1984 14.4397
|
||
34 14.1767 14.3351
|
||
35 14.1241 14.307
|
||
36 14.1688 14.4055
|
||
37 14.1713 14.4336
|
||
38 14.1265 14.3434
|
||
39 14.1169 14.3065
|
||
40 14.0884 14.3818
|
||
41 14.104 14.3477
|
||
42 14.1383 14.4493
|
||
43 14.0954 14.3695
|
||
44 14.0311 14.3533
|
||
45 14.0552 14.342
|
||
46 14.0066 14.3103
|
||
47 14.0422 14.5049
|
||
48 14.0107 14.2627
|
||
49 14.0202 14.289
|
||
50 14.02 14.2614
|
||
51 13.9942 14.2584
|
||
52 13.9933 14.2332
|
||
53 13.9466 14.249
|
||
54 13.9297 14.1818
|
||
55 13.9887 14.2809
|
||
56 13.916 14.1474
|
||
57 13.9131 14.1983
|
||
58 14.1524 14.3588
|
||
59 13.9159 14.1661
|
||
60 14.0754 14.3011
|
||
61 13.9079 14.1572
|
||
62 14.0052 14.238
|
||
63 13.8786 14.1187
|
||
64 13.9068 14.1428
|
||
65 13.8803 14.1429
|
||
66 13.8724 14.1227
|
||
67 13.8628 14.0914
|
||
68 13.8432 14.0998
|
||
69 13.8531 14.1621
|
||
70 13.9369 14.1691
|
||
71 13.8268 14.1029
|
||
72 13.8963 14.1449
|
||
73 13.8232 14.0779
|
||
74 13.8351 14.0851
|
||
75 13.8179 14.138
|
||
76 13.8128 14.0779
|
||
77 13.811 14.1286
|
||
78 13.8003 14.069
|
||
79 13.8029 14.1302
|
||
80 13.8189 14.0866
|
||
81 13.795 14.1236
|
||
82 13.806 14.0719
|
||
83 13.7875 14.1262
|
||
84 13.7952 14.0809
|
||
85 13.7652 14.1097
|
||
86 13.7834 14.0785
|
||
87 13.7598 14.1051
|
||
88 13.7725 14.0755
|
||
89 13.74 14.0976
|
||
90 13.7626 14.0745
|
||
91 13.7352 14.0936
|
||
92 13.7529 14.0709
|
||
93 13.7178 14.0854
|
||
94 13.7431 14.0659
|
||
95 13.7131 14.0827
|
||
96 13.7342 14.0611
|
||
97 13.6983 14.0758
|
||
98 13.7247 14.0534
|
||
99 13.6939 14.0752
|
||
100 13.7163 14.0471
|
||
|
||
Designated epoch number reached. ANFIS training completed at epoch 100.
|
||
|
||
Minimal training RMSE = 13.6939
|
||
Minimal checking RMSE = 14.0471
|
||
Done. Final FIS has 12 rules.
|
||
|
||
Evaluating on Test set ...
|
||
|
||
FINAL MODEL PERFORMANCE (Test set)
|
||
-------------------------------------------
|
||
MSE : 208.506
|
||
RMSE: 14.4397
|
||
R2 : 0.820108
|
||
NMSE: 0.179892
|
||
NDEI: 0.424137
|
||
|
||
Generating diagnostic plots ...
|
||
All plots saved in ./figures_scn2
|