Whats best?

Across different pieces of the analyses we have provided support for a number of interesting, but potentially difficult to synthesize, findings. For example, support for existing parcellations performing better than random parcellations. This section of the project site is designed to focus in on only a subset of the results as informed by these prior findings. The foundational points focused on here are as follows:

Based on those findings, we plot two special subsets:

  1. Existing single parcellation results from only the SVM based pipeline (SVM Non-Random Existing)
  2. Fixed size only ensembled parcellation results from only the SVM based pipeline (SVM Ensemble)

The last plotted is the special ‘All’ ensembled results, which ensembles over both pipeline and parcellation (See Multiple Parcellations Evaluation).

Best

Also see a special extra comparison between these results and some even further special ensembles of existing parcellations here.

Results Table

This table includes just results from the subsets as plotted above. The mean relative rankings shown here are as computed only between these subsets (and as averaged across target variable). averaged across and computed across parcellation and ML pipeline. Mean R2 and ROC AUC are calculated only from their relevant subsets of 22 and 23 target variables respectively.

Table columns are sortable!

Parcellation Pipeline Mean Rank Size Mean R2 Mean ROC AUC
voted random 500 10 0 All 32.8889 5000 0.0960 0.6416
voted random 500 8 0 All 39.0000 4000 0.0957 0.6410
stacked random 500 10 1 All 43.9111 5000 0.1016 0.6373
voted random 500 10 1 All 44.1556 5000 0.0957 0.6406
stacked random 400 10 1 All 44.6000 4000 0.1000 0.6380
stacked random 500 10 0 All 45.3111 5000 0.1021 0.6369
stacked random 400 8 1 All 46.0889 3200 0.0994 0.6380
voted random 400 10 1 All 46.2889 4000 0.0945 0.6414
stacked random 500 8 1 All 46.6889 4000 0.1008 0.6376
voted random 500 10 0 SVM 47.1778 5000 0.0936 0.6399
stacked random 500 8 0 All 48.8000 4000 0.1017 0.6363
voted random 500 8 1 All 49.0889 4000 0.0953 0.6400
stacked random 400 10 0 All 49.4889 4000 0.1002 0.6366
stacked random 500 5 0 All 49.6222 2500 0.1008 0.6366
voted random 500 10 1 SVM 50.6222 5000 0.0933 0.6396
voted random 500 5 0 All 50.9556 2500 0.0955 0.6394
stacked random 400 8 0 All 52.4444 3200 0.1001 0.6368
voted random 500 8 0 SVM 52.6222 4000 0.0933 0.6393
voted random 400 8 1 All 53.9111 3200 0.0940 0.6405
voted random 400 10 0 All 54.6889 4000 0.0945 0.6399
stacked random 300 8 1 All 56.4444 2400 0.0984 0.6362
voted random 500 8 1 SVM 57.2667 4000 0.0927 0.6389
voted random 400 8 0 All 57.2889 3200 0.0944 0.6394
stacked random 300 10 1 All 57.6222 3000 0.0988 0.6361
stacked random 500 5 1 All 57.8444 2500 0.0994 0.6359
voted random 400 10 1 SVM 59.3111 4000 0.0928 0.6392
voted random 300 10 1 All 59.4444 3000 0.0923 0.6406
voted random 400 10 0 SVM 59.7778 4000 0.0930 0.6389
stacked random 500 3 0 All 60.1778 1500 0.0993 0.6347
stacked random 400 5 1 All 60.2667 2000 0.0983 0.6366
stacked random 400 5 0 All 60.2889 2000 0.0989 0.6348
voted random 300 8 1 All 61.8000 2400 0.0919 0.6402
voted random 400 8 0 SVM 62.1333 3200 0.0926 0.6388
voted random 300 10 0 All 62.2444 3000 0.0919 0.6396
voted random 500 5 1 All 62.3333 2500 0.0945 0.6390
stacked random 500 10 0 SVM 62.8000 5000 0.0951 0.6370
stacked random 500 10 1 SVM 63.7333 5000 0.0947 0.6373
voted random 500 5 0 SVM 64.0444 2500 0.0927 0.6380
stacked random 500 8 0 SVM 64.0889 4000 0.0947 0.6371
stacked random 200 10 1 All 64.4444 2000 0.0975 0.6355
voted random 400 5 0 All 65.2000 2000 0.0938 0.6383
voted random 400 8 1 SVM 65.3556 3200 0.0922 0.6386
stacked random 300 10 0 All 66.0222 3000 0.0989 0.6333
stacked random 200 10 0 All 66.4667 2000 0.0965 0.6364
stacked random 300 8 0 All 67.2667 2400 0.0983 0.6340
voted random 500 5 1 SVM 67.6000 2500 0.0919 0.6381
stacked random 500 8 1 SVM 68.2667 4000 0.0940 0.6369
stacked random 200 8 1 All 68.7778 1600 0.0967 0.6350
voted random 500 3 0 All 68.9778 1500 0.0948 0.6372
voted random 400 5 1 All 69.1333 2000 0.0935 0.6383
stacked random 400 10 0 SVM 69.8000 4000 0.0942 0.6369
voted random 300 8 0 All 69.8000 2400 0.0915 0.6387
stacked random 400 10 1 SVM 69.9333 4000 0.0940 0.6365
stacked random 500 3 1 All 70.2444 1500 0.0967 0.6356
voted random 300 10 1 SVM 70.5111 3000 0.0896 0.6390
stacked random 300 10 1 SVM 70.5556 3000 0.0921 0.6376
voted random 200 10 1 All 71.2667 2000 0.0906 0.6397
stacked random 400 8 0 SVM 71.5778 3200 0.0938 0.6366
voted random 400 5 0 SVM 72.5778 2000 0.0914 0.6380
stacked random 500 5 1 SVM 73.5556 2500 0.0929 0.6368
stacked random 500 5 0 SVM 73.9333 2500 0.0938 0.6362
stacked random 300 8 1 SVM 74.2222 2400 0.0914 0.6375
stacked random 300 5 1 All 74.6222 1500 0.0957 0.6350
stacked random 400 3 0 All 76.0222 1200 0.0965 0.6338
stacked random 400 8 1 SVM 76.0222 3200 0.0934 0.6358
voted random 300 10 0 SVM 76.2000 3000 0.0894 0.6380
voted random 400 5 1 SVM 76.2000 2000 0.0910 0.6379
voted random 200 8 1 All 76.4000 1600 0.0901 0.6391
stacked random 400 5 1 SVM 76.8444 2000 0.0921 0.6366
voted random 200 10 0 All 76.9111 2000 0.0897 0.6390
voted random 300 8 1 SVM 76.9333 2400 0.0891 0.6383
stacked random 400 5 0 SVM 76.9778 2000 0.0923 0.6365
stacked random 400 3 1 All 77.4222 1200 0.0958 0.6354
stacked random 200 8 0 All 78.3778 1600 0.0961 0.6351
stacked random 300 10 0 SVM 79.3333 3000 0.0918 0.6355
voted random 300 5 1 All 80.2000 1500 0.0905 0.6383
stacked random 300 5 0 All 80.6444 1500 0.0968 0.6330
stacked random 300 8 0 SVM 81.2889 2400 0.0911 0.6359
voted random 300 8 0 SVM 81.3556 2400 0.0889 0.6376
voted random 300 5 0 All 81.9111 1500 0.0908 0.6375
voted random 200 8 0 All 82.5778 1600 0.0895 0.6381
voted random 500 3 1 All 83.6667 1500 0.0924 0.6372
icosahedron 1442 (dlab) Existing 84.8889 2637 0.0920 0.6367
stacked random 200 5 1 All 86.3333 1000 0.0948 0.6342
voted random 500 3 0 SVM 87.1333 1500 0.0912 0.6361
voted random 500 3 1 SVM 87.4000 1500 0.0896 0.6370
voted random 400 3 0 All 87.4000 1200 0.0926 0.6358
stacked random 300 3 1 All 87.8889 900 0.0932 0.6354
voted random 400 3 1 All 88.4000 1200 0.0916 0.6373
stacked random 300 3 0 All 89.0444 900 0.0939 0.6329
stacked random 200 5 0 All 89.4889 1000 0.0946 0.6331
stacked random 500 3 0 SVM 90.8667 1500 0.0919 0.6350
voted random 200 10 1 SVM 91.1111 2000 0.0872 0.6374
icosahedron 1002 (dlab) Existing 91.7778 1838 0.0913 0.6358
stacked random 200 10 1 SVM 92.3333 2000 0.0512 0.6359
voted random 400 3 0 SVM 92.7333 1200 0.0895 0.6364
voted random 200 10 0 SVM 92.9556 2000 0.0865 0.6370
stacked random 500 3 1 SVM 92.9778 1500 0.0903 0.6357
voted random 300 5 0 SVM 93.1778 1500 0.0878 0.6368
stacked random 300 5 0 SVM 93.4889 1500 0.0896 0.6355
voted random 300 5 1 SVM 94.4222 1500 0.0871 0.6368
stacked random 300 5 1 SVM 94.8444 1500 0.0887 0.6365
voted random 200 8 1 SVM 95.8222 1600 0.0867 0.6369
stacked random 200 8 1 SVM 97.1778 1600 0.0522 0.6354
voted random 200 5 1 All 97.3556 1000 0.0888 0.6365
voted random 300 3 1 All 97.5778 900 0.0888 0.6369
voted random 200 8 0 SVM 99.5333 1600 0.0862 0.6362
stacked random 200 10 0 SVM 99.6444 2000 0.0681 0.6327
stacked random 200 8 0 SVM 99.7778 1600 0.0864 0.6346
icosahedron 642 (dlab) Existing 100.2000 1186 0.0895 0.6350
voted random 200 5 0 All 100.7333 1000 0.0888 0.6361
stacked random 400 3 0 SVM 101.4667 1200 0.0898 0.6337
voted random 400 3 1 SVM 101.6222 1200 0.0885 0.6363
stacked random 300 3 0 SVM 101.7556 900 0.0869 0.6355
stacked random 400 3 1 SVM 101.8222 1200 0.0896 0.6352
voted random 300 3 0 All 102.9111 900 0.0890 0.6355
stacked random 100 10 1 All 103.7778 1000 0.0927 0.6299
voted random 300 3 0 SVM 105.8667 900 0.0857 0.6357
difumo 1024 Existing 106.4222 949 0.0867 0.6352
stacked random 200 3 1 All 109.5111 600 0.0910 0.6327
stacked random 200 5 1 SVM 109.5556 1000 0.0577 0.6346
stacked random 100 8 1 All 109.7778 800 0.0917 0.6289
voted random 200 5 1 SVM 110.8444 1000 0.0848 0.6355
stacked random 200 3 0 All 112.8444 600 0.0922 0.6301
stacked random 100 10 0 All 113.4889 1000 0.0917 0.6295
stacked random 300 3 1 SVM 113.5111 900 0.0861 0.6345
voted random 200 5 0 SVM 113.9333 1000 0.0848 0.6350
voted random 300 3 1 SVM 113.9778 900 0.0850 0.6351
stacked random 200 5 0 SVM 114.6667 1000 0.0789 0.6334
voted random 100 10 1 All 114.8889 1000 0.0839 0.6336
voted random 100 10 0 All 117.5111 1000 0.0833 0.6339
voted random 200 3 1 All 120.4000 600 0.0861 0.6335
voted random 100 8 1 All 120.6444 800 0.0833 0.6329
voted random 200 3 0 All 121.2889 600 0.0875 0.6328
stacked random 100 8 0 All 123.2222 800 0.0916 0.6279
schaefer 1000 Existing 125.8667 998 0.0864 0.6336
voted random 100 8 0 All 126.6222 800 0.0832 0.6324
schaefer 900 Existing 127.3111 900 0.0860 0.6330
icosahedron 362 (dlab) Existing 127.4667 669 0.0863 0.6328
schaefer 800 Existing 127.5556 800 0.0859 0.6324
schaefer 700 Existing 128.2000 700 0.0853 0.6322
stacked random 100 5 1 All 128.2889 500 0.0898 0.6262
difumo 512 Existing 128.8889 478 0.0836 0.6323
sjh Existing 130.7111 507 0.0833 0.6336
voted random 200 3 1 SVM 132.4889 600 0.0812 0.6331
stacked random 100 5 0 All 133.1778 500 0.0901 0.6268
voted random 200 3 0 SVM 134.7556 600 0.0822 0.6321
voted random 100 5 1 All 135.8222 500 0.0825 0.6305
stacked random 100 10 0 SVM 136.0000 1000 0.0810 0.6288
voted random 100 10 0 SVM 138.2889 1000 0.0764 0.6311
voted random 100 10 1 SVM 138.6000 1000 0.0768 0.6314
voted random 100 5 0 All 138.8444 500 0.0826 0.6302
mist 444 Existing 139.8000 374 0.0811 0.6320
basc scale444 Existing 139.9111 374 0.0811 0.6320
stacked random 200 3 0 SVM 140.6222 600 0.0839 0.6290
schaefer 600 Existing 142.0889 600 0.0824 0.6318
voted random 100 8 1 SVM 142.8000 800 0.0759 0.6306
stacked random 100 10 1 SVM 143.0889 1000 0.0811 0.6270
stacked random 100 8 1 SVM 143.3556 800 0.0798 0.6282
stacked random 100 8 0 SVM 144.4000 800 0.0804 0.6279
icosahedron 162 (dlab) Existing 145.2000 305 0.0804 0.6303
stacked random 200 3 1 SVM 145.8000 600 0.0531 0.6272
voted random 100 8 0 SVM 147.4222 800 0.0762 0.6299
stacked random 100 3 1 All 148.8222 300 0.0864 0.6246
schaefer 400 Existing 150.7111 400 0.0804 0.6300
stacked random 100 3 0 All 152.1111 300 0.0863 0.6240
schaefer 500 Existing 152.3556 500 0.0822 0.6290
Slab1068 Existing 154.8222 699 0.0804 0.6289
voted random 100 5 1 SVM 156.0444 500 0.0741 0.6285
voted random 100 5 0 SVM 156.2667 500 0.0751 0.6284
voted random 100 3 1 All 156.5333 300 0.0804 0.6269
glasser 2016 (dlab) Existing 157.0222 360 0.0782 0.6294
hcp mmp Existing 157.2444 360 0.0782 0.6294
glasser (abox) Existing 157.3333 360 0.0782 0.6294
stacked random 100 5 1 SVM 157.8000 500 0.0771 0.6264
basc scale325 Existing 158.6444 273 0.0776 0.6297
mist 325 Existing 158.8444 273 0.0776 0.6297
Slab907 Existing 158.9333 661 0.0783 0.6277
stacked random 100 5 0 SVM 159.2889 500 0.0783 0.6234
gordon (abox) Existing 159.5556 333 0.0781 0.6286
voted random 100 3 0 All 159.9778 300 0.0800 0.6261
difumo 256 Existing 160.2000 240 0.0762 0.6280
CAPRSC Existing 162.7111 333 0.0762 0.6278
aicha Existing 164.7556 341 0.0777 0.6275
shen 368 Existing 166.0444 330 0.0757 0.6281
gordon Existing 169.0222 333 0.0754 0.6263
schaefer 300 Existing 169.4889 300 0.0766 0.6271
mist 197 Existing 170.6222 165 0.0737 0.6252
basc scale197 Existing 170.7333 165 0.0737 0.6252
voted random 100 3 1 SVM 170.7333 300 0.0714 0.6259
stacked random 100 3 1 SVM 170.8889 300 0.0731 0.6249
brainnetome Existing 174.6444 216 0.0742 0.6246
fan (abox) Existing 176.3111 210 0.0749 0.6239
destrieux (abox) Existing 176.9333 150 0.0725 0.6242
stacked random 100 3 0 SVM 177.8889 300 0.0731 0.6229
voted random 100 3 0 SVM 177.9333 300 0.0713 0.6239
shen (abox) Existing 180.0222 200 0.0724 0.6243
dextrieux (dlab) Existing 181.4667 149 0.0718 0.6236
shen 268 Existing 182.2222 207 0.0747 0.6237
smith rsn70 Existing 182.8667 70 0.0689 0.6196
CPAC200 Existing 185.1111 174 0.0691 0.6218
smith bm70 Existing 185.8889 70 0.0661 0.6198
freesurfer destr Existing 186.3778 150 0.0684 0.6215
allen Existing 186.8444 75 0.0706 0.6185
schaefer 200 Existing 190.7778 200 0.0697 0.6217
baldassano (abox) Existing 192.6000 171 0.0660 0.6181
basc scale122 Existing 197.8667 102 0.0661 0.6190
mist 122 Existing 197.8889 102 0.0661 0.6190
difumo 128 Existing 199.4000 124 0.0672 0.6179
nspn500 Existing 199.6444 156 0.0628 0.6174
harvard oxford cort 1mm Existing 202.9111 48 0.0646 0.6150
MICCAI Existing 203.2667 110 0.0646 0.6150
schaefer 100 Existing 203.8889 100 0.0629 0.6151
aal Existing 205.7111 84 0.0621 0.6136
mist 64 Existing 206.0000 55 0.0599 0.6121
power (abox) Existing 206.0444 130 0.0640 0.6161
basc scale064 Existing 206.2000 55 0.0599 0.6121
harvard oxford cort maxprob thr25 1mm Existing 208.5556 48 0.0611 0.6117
brodmann Existing 208.6222 41 0.0590 0.6114
harvard oxford cort maxprob thr0 1mm Existing 210.3333 48 0.0618 0.6099
icosahedron 42 (dlab) Existing 212.2889 81 0.0553 0.6114
aal (abox) Existing 214.1556 82 0.0579 0.6093
vdg11b Existing 214.8667 104 0.0596 0.6083
freesurfer desikan Existing 215.0222 68 0.0515 0.6073
harvard oxford cort maxprob thr50 1mm Existing 216.9333 47 0.0577 0.6091
yeo (abox) Existing 217.9556 96 0.0522 0.6088
economo Existing 218.8000 43 0.0584 0.6069
desikan (dlab) Existing 219.6889 69 0.0556 0.6072
desikan (abox) Existing 221.9556 70 0.0541 0.6071
difumo 64 Existing 222.0222 62 0.0511 0.6070
basc scale036 Existing 222.5778 30 0.0529 0.6030
mist 36 Existing 222.6444 30 0.0529 0.6030
Hammersmith Existing 223.7111 63 0.0501 0.6008
power2011 (dlab) Existing 224.7333 69 0.0476 0.6068
msdl Existing 226.1778 39 0.0475 0.6004
Juelich Existing 227.6444 92 0.0476 0.6019
basc scale020 Existing 228.4889 19 0.0450 0.5956
mist 20 Existing 228.5111 19 0.0450 0.5956
yeo 17networks Existing 230.2889 17 0.0422 0.5945
yeo 7networks Existing 234.4444 7 0.0352 0.5814
craddock tcorr mean Existing 239.0222 43 0.0282 0.5823
craddock tcorr 2level Existing 239.5111 43 0.0288 0.5841
basc scale007 Existing 239.9556 7 0.0278 0.5725
mist 7 Existing 239.9778 7 0.0278 0.5725
basc scale012 Existing 240.0667 12 0.0338 0.5809
mist 12 Existing 240.0889 12 0.0338 0.5809
craddock scorr 2level Existing 242.5111 43 0.0271 0.5761
Princetonvisual top Existing 242.9778 43 0.0233 0.5679
craddock scorr mean Existing 243.6222 43 0.0260 0.5767
oasis.chubs Existing 244.3778 8 0.0224 0.5578