Multiple regression

Multiple regression designs apply to at least two scenarios.

  • Analyzing a single subject’s data when trials are associated with one or multiple continuous variables.

  • Analyzing group data when subjects are associated with one or multiple individual difference variables.

Here the analysis is illustrated for a simulated dataset from a single subject. Group analysis works analogously, except that each case in the datatset would represent a different subject rather than a different trial.

For such group analysis, it is necessary to reduce each subject’s data to a single case first because multiple regression assumes a fixed effects model. Such designs are described under Two-stage test.

Simulated data

# sphinx_gallery_thumbnail_number = 2
from eelbrain import *


data = datasets.simulate_erp(snr=0.5)
data.head()
# cloze predictability n_chars
0 0.026139 low 4
1 0.99529 high 5
2 0.93062 high 3
3 0.82404 high 7
4 0.17041 low 4
5 0.18508 low 4
6 0.23345 low 4
7 0.80784 high 3
8 0.24979 low 7
9 0.26753 low 4
NDVars: eeg


The data represents 80 trials from a simulated word reading paradigm, where each word is associated with a word length (n_chars) and predictability (cloze).

p = plot.Scatter('cloze', 'n_chars', data=data, h=3)
sensor lm

Plot the average of each level on n_chars to illustrate the linear increase of the response around 130 ms with n_char.

p = plot.TopoButterfly('eeg', 'n_chars', data=data, t=.130, axh=2, w=6)
sensor lm

Multiple regression

Fit a multiple regression model. Estimate $p$-values using a cluster-based permuatation test, using a cluster-forming threshold of uncorrected $p$=.05 and 10,000 permutations (the default).

lm = testnd.LM('eeg', 'n_chars + cloze', data=data, tstart=0.050, tstop=0.500, pmin=0.05)
Permutation test:   0%|          | 0/10000 [00:00<?, ? permutations/s]
Permutation test:   0%|          | 10/10000 [00:00<01:48, 91.69 permutations/s]
Permutation test:   0%|          | 21/10000 [00:00<01:38, 101.38 permutations/s]
Permutation test:   0%|          | 32/10000 [00:00<01:50, 90.27 permutations/s]
Permutation test:   0%|          | 42/10000 [00:00<01:52, 88.73 permutations/s]
Permutation test:   1%|          | 51/10000 [00:00<01:57, 84.73 permutations/s]
Permutation test:   1%|          | 64/10000 [00:00<01:40, 98.42 permutations/s]
Permutation test:   1%|          | 76/10000 [00:00<01:40, 99.10 permutations/s]
Permutation test:   1%|          | 87/10000 [00:00<01:45, 94.07 permutations/s]
Permutation test:   1%|          | 97/10000 [00:01<01:44, 94.35 permutations/s]
Permutation test:   1%|          | 107/10000 [00:01<01:45, 93.40 permutations/s]
Permutation test:   1%|          | 117/10000 [00:01<01:51, 88.72 permutations/s]
Permutation test:   1%|▏         | 126/10000 [00:01<01:54, 86.53 permutations/s]
Permutation test:   1%|▏         | 135/10000 [00:01<01:54, 86.06 permutations/s]
Permutation test:   1%|▏         | 144/10000 [00:01<01:58, 82.96 permutations/s]
Permutation test:   2%|▏         | 154/10000 [00:01<01:58, 83.35 permutations/s]
Permutation test:   2%|▏         | 163/10000 [00:01<01:57, 83.76 permutations/s]
Permutation test:   2%|▏         | 172/10000 [00:01<02:01, 80.82 permutations/s]
Permutation test:   2%|▏         | 181/10000 [00:02<02:00, 81.74 permutations/s]
Permutation test:   2%|▏         | 190/10000 [00:02<01:59, 82.22 permutations/s]
Permutation test:   2%|▏         | 200/10000 [00:02<01:58, 82.36 permutations/s]
Permutation test:   2%|▏         | 209/10000 [00:02<01:57, 83.29 permutations/s]
Permutation test:   2%|▏         | 218/10000 [00:02<01:55, 84.47 permutations/s]
Permutation test:   2%|▏         | 227/10000 [00:02<01:57, 82.97 permutations/s]
Permutation test:   2%|▏         | 239/10000 [00:02<01:46, 91.30 permutations/s]
Permutation test:   2%|▏         | 249/10000 [00:02<01:44, 93.47 permutations/s]
Permutation test:   3%|▎         | 259/10000 [00:02<01:47, 90.45 permutations/s]
Permutation test:   3%|▎         | 269/10000 [00:03<01:50, 87.71 permutations/s]
Permutation test:   3%|▎         | 278/10000 [00:03<01:51, 87.14 permutations/s]
Permutation test:   3%|▎         | 287/10000 [00:03<01:56, 83.22 permutations/s]
Permutation test:   3%|▎         | 297/10000 [00:03<01:56, 83.32 permutations/s]
Permutation test:   3%|▎         | 307/10000 [00:03<01:53, 85.11 permutations/s]
Permutation test:   3%|▎         | 316/10000 [00:03<01:53, 85.06 permutations/s]
Permutation test:   3%|▎         | 325/10000 [00:03<01:56, 83.16 permutations/s]
Permutation test:   3%|▎         | 334/10000 [00:03<01:56, 83.23 permutations/s]
Permutation test:   3%|▎         | 343/10000 [00:03<01:55, 83.95 permutations/s]
Permutation test:   4%|▎         | 352/10000 [00:04<01:57, 82.41 permutations/s]
Permutation test:   4%|▎         | 361/10000 [00:04<01:54, 84.08 permutations/s]
Permutation test:   4%|▎         | 370/10000 [00:04<01:59, 80.90 permutations/s]
Permutation test:   4%|▍         | 379/10000 [00:04<01:57, 81.85 permutations/s]
Permutation test:   4%|▍         | 388/10000 [00:04<02:00, 79.89 permutations/s]
Permutation test:   4%|▍         | 397/10000 [00:04<01:57, 81.75 permutations/s]
Permutation test:   4%|▍         | 408/10000 [00:04<01:49, 87.40 permutations/s]
Permutation test:   4%|▍         | 417/10000 [00:04<01:50, 86.71 permutations/s]
Permutation test:   4%|▍         | 426/10000 [00:04<01:50, 86.69 permutations/s]
Permutation test:   4%|▍         | 436/10000 [00:05<01:46, 89.98 permutations/s]
Permutation test:   4%|▍         | 446/10000 [00:05<01:50, 86.85 permutations/s]
Permutation test:   5%|▍         | 455/10000 [00:05<01:50, 86.76 permutations/s]
Permutation test:   5%|▍         | 464/10000 [00:05<01:54, 83.44 permutations/s]
Permutation test:   5%|▍         | 473/10000 [00:05<01:52, 84.32 permutations/s]
Permutation test:   5%|▍         | 482/10000 [00:05<01:55, 82.66 permutations/s]
Permutation test:   5%|▍         | 491/10000 [00:05<01:52, 84.21 permutations/s]
Permutation test:   5%|▌         | 500/10000 [00:05<01:54, 82.83 permutations/s]
Permutation test:   5%|▌         | 509/10000 [00:05<01:53, 83.40 permutations/s]
Permutation test:   5%|▌         | 518/10000 [00:06<01:56, 81.53 permutations/s]
Permutation test:   5%|▌         | 527/10000 [00:06<01:54, 82.59 permutations/s]
Permutation test:   5%|▌         | 536/10000 [00:06<01:56, 81.46 permutations/s]
Permutation test:   5%|▌         | 545/10000 [00:06<01:53, 83.38 permutations/s]
Permutation test:   6%|▌         | 554/10000 [00:06<01:53, 82.91 permutations/s]
Permutation test:   6%|▌         | 563/10000 [00:06<01:54, 82.58 permutations/s]
Permutation test:   6%|▌         | 574/10000 [00:06<01:46, 88.13 permutations/s]
Permutation test:   6%|▌         | 584/10000 [00:06<01:43, 91.37 permutations/s]
Permutation test:   6%|▌         | 594/10000 [00:06<01:44, 89.78 permutations/s]
Permutation test:   6%|▌         | 605/10000 [00:07<01:41, 92.17 permutations/s]
Permutation test:   6%|▌         | 615/10000 [00:07<01:41, 92.73 permutations/s]
Permutation test:   6%|▋         | 625/10000 [00:07<01:42, 91.19 permutations/s]
Permutation test:   6%|▋         | 635/10000 [00:07<01:47, 86.85 permutations/s]
Permutation test:   6%|▋         | 644/10000 [00:07<01:50, 84.47 permutations/s]
Permutation test:   7%|▋         | 654/10000 [00:07<01:51, 83.68 permutations/s]
Permutation test:   7%|▋         | 664/10000 [00:07<01:51, 83.61 permutations/s]
Permutation test:   7%|▋         | 674/10000 [00:07<01:51, 83.96 permutations/s]
Permutation test:   7%|▋         | 683/10000 [00:07<01:51, 83.33 permutations/s]
Permutation test:   7%|▋         | 692/10000 [00:08<01:52, 82.47 permutations/s]
Permutation test:   7%|▋         | 702/10000 [00:08<01:51, 83.61 permutations/s]
Permutation test:   7%|▋         | 711/10000 [00:08<01:51, 83.08 permutations/s]
Permutation test:   7%|▋         | 720/10000 [00:08<01:54, 80.99 permutations/s]
Permutation test:   7%|▋         | 729/10000 [00:08<01:54, 81.22 permutations/s]
Permutation test:   7%|▋         | 739/10000 [00:08<01:53, 81.80 permutations/s]
Permutation test:   8%|▊         | 750/10000 [00:08<01:45, 87.86 permutations/s]
Permutation test:   8%|▊         | 760/10000 [00:08<01:46, 86.90 permutations/s]
Permutation test:   8%|▊         | 769/10000 [00:08<01:45, 87.48 permutations/s]
Permutation test:   8%|▊         | 778/10000 [00:09<01:49, 84.43 permutations/s]
Permutation test:   8%|▊         | 787/10000 [00:09<01:48, 85.02 permutations/s]
Permutation test:   8%|▊         | 796/10000 [00:09<01:48, 84.96 permutations/s]
Permutation test:   8%|▊         | 805/10000 [00:09<01:48, 84.75 permutations/s]
Permutation test:   8%|▊         | 814/10000 [00:09<01:49, 84.10 permutations/s]
Permutation test:   8%|▊         | 823/10000 [00:09<01:50, 82.72 permutations/s]
Permutation test:   8%|▊         | 832/10000 [00:09<01:49, 84.05 permutations/s]
Permutation test:   8%|▊         | 841/10000 [00:09<01:49, 83.84 permutations/s]
Permutation test:   8%|▊         | 850/10000 [00:09<01:49, 83.92 permutations/s]
Permutation test:   9%|▊         | 859/10000 [00:10<01:51, 82.08 permutations/s]
Permutation test:   9%|▊         | 869/10000 [00:10<01:48, 83.86 permutations/s]
Permutation test:   9%|▉         | 878/10000 [00:10<01:49, 83.22 permutations/s]
Permutation test:   9%|▉         | 888/10000 [00:10<01:48, 83.79 permutations/s]
Permutation test:   9%|▉         | 897/10000 [00:10<01:47, 84.51 permutations/s]
Permutation test:   9%|▉         | 906/10000 [00:10<01:51, 81.37 permutations/s]
Permutation test:   9%|▉         | 917/10000 [00:10<01:44, 86.51 permutations/s]
Permutation test:   9%|▉         | 926/10000 [00:10<01:45, 86.05 permutations/s]
Permutation test:   9%|▉         | 935/10000 [00:10<01:45, 85.72 permutations/s]
Permutation test:   9%|▉         | 944/10000 [00:11<01:47, 84.55 permutations/s]
Permutation test:  10%|▉         | 954/10000 [00:11<01:46, 84.61 permutations/s]
Permutation test:  10%|▉         | 963/10000 [00:11<01:45, 85.64 permutations/s]
Permutation test:  10%|▉         | 972/10000 [00:11<01:50, 81.35 permutations/s]
Permutation test:  10%|▉         | 982/10000 [00:11<01:49, 82.40 permutations/s]
Permutation test:  10%|▉         | 991/10000 [00:11<01:49, 82.22 permutations/s]
Permutation test:  10%|█         | 1000/10000 [00:11<01:50, 81.67 permutations/s]
Permutation test:  10%|█         | 1010/10000 [00:11<01:47, 83.95 permutations/s]
Permutation test:  10%|█         | 1019/10000 [00:11<01:47, 83.55 permutations/s]
Permutation test:  10%|█         | 1028/10000 [00:12<01:48, 82.42 permutations/s]
Permutation test:  10%|█         | 1037/10000 [00:12<01:51, 80.64 permutations/s]
Permutation test:  10%|█         | 1046/10000 [00:12<01:48, 82.30 permutations/s]
Permutation test:  11%|█         | 1055/10000 [00:12<01:49, 81.96 permutations/s]
Permutation test:  11%|█         | 1064/10000 [00:12<01:55, 77.70 permutations/s]
Permutation test:  11%|█         | 1074/10000 [00:12<01:50, 80.87 permutations/s]
Permutation test:  11%|█         | 1086/10000 [00:12<01:41, 87.67 permutations/s]
Permutation test:  11%|█         | 1095/10000 [00:12<01:44, 85.52 permutations/s]
Permutation test:  11%|█         | 1105/10000 [00:12<01:45, 83.97 permutations/s]
Permutation test:  11%|█         | 1115/10000 [00:13<01:46, 83.35 permutations/s]
Permutation test:  11%|█▏        | 1125/10000 [00:13<01:47, 82.93 permutations/s]
Permutation test:  11%|█▏        | 1135/10000 [00:13<01:45, 84.30 permutations/s]
Permutation test:  11%|█▏        | 1145/10000 [00:13<01:44, 84.36 permutations/s]
Permutation test:  12%|█▏        | 1154/10000 [00:13<01:43, 85.49 permutations/s]
Permutation test:  12%|█▏        | 1163/10000 [00:13<01:43, 85.35 permutations/s]
Permutation test:  12%|█▏        | 1172/10000 [00:13<01:43, 85.22 permutations/s]
Permutation test:  12%|█▏        | 1181/10000 [00:13<01:46, 82.83 permutations/s]
Permutation test:  12%|█▏        | 1190/10000 [00:14<01:44, 84.36 permutations/s]
Permutation test:  12%|█▏        | 1199/10000 [00:14<01:44, 84.05 permutations/s]
Permutation test:  12%|█▏        | 1208/10000 [00:14<01:47, 81.57 permutations/s]
Permutation test:  12%|█▏        | 1217/10000 [00:14<01:48, 81.21 permutations/s]
Permutation test:  12%|█▏        | 1226/10000 [00:14<01:48, 80.95 permutations/s]
Permutation test:  12%|█▏        | 1235/10000 [00:14<01:47, 81.65 permutations/s]
Permutation test:  12%|█▏        | 1245/10000 [00:14<01:45, 82.84 permutations/s]
Permutation test:  13%|█▎        | 1255/10000 [00:14<01:43, 84.48 permutations/s]
Permutation test:  13%|█▎        | 1265/10000 [00:14<01:40, 86.68 permutations/s]
Permutation test:  13%|█▎        | 1274/10000 [00:15<01:41, 85.70 permutations/s]
Permutation test:  13%|█▎        | 1283/10000 [00:15<01:43, 84.07 permutations/s]
Permutation test:  13%|█▎        | 1292/10000 [00:15<01:44, 82.95 permutations/s]
Permutation test:  13%|█▎        | 1301/10000 [00:15<01:44, 83.52 permutations/s]
Permutation test:  13%|█▎        | 1310/10000 [00:15<01:45, 82.56 permutations/s]
Permutation test:  13%|█▎        | 1319/10000 [00:15<01:44, 83.00 permutations/s]
Permutation test:  13%|█▎        | 1329/10000 [00:15<01:44, 83.11 permutations/s]
Permutation test:  13%|█▎        | 1339/10000 [00:15<01:44, 83.17 permutations/s]
Permutation test:  13%|█▎        | 1349/10000 [00:15<01:43, 83.22 permutations/s]
Permutation test:  14%|█▎        | 1358/10000 [00:16<01:42, 84.61 permutations/s]
Permutation test:  14%|█▎        | 1367/10000 [00:16<01:42, 84.24 permutations/s]
Permutation test:  14%|█▍        | 1376/10000 [00:16<01:41, 85.37 permutations/s]
Permutation test:  14%|█▍        | 1385/10000 [00:16<01:43, 82.92 permutations/s]
Permutation test:  14%|█▍        | 1394/10000 [00:16<01:44, 82.14 permutations/s]
Permutation test:  14%|█▍        | 1403/10000 [00:16<01:43, 83.41 permutations/s]
Permutation test:  14%|█▍        | 1412/10000 [00:16<01:41, 84.54 permutations/s]
Permutation test:  14%|█▍        | 1426/10000 [00:16<01:30, 95.15 permutations/s]
Permutation test:  14%|█▍        | 1436/10000 [00:16<01:32, 92.46 permutations/s]
Permutation test:  14%|█▍        | 1446/10000 [00:17<01:34, 90.20 permutations/s]
Permutation test:  15%|█▍        | 1456/10000 [00:17<01:32, 92.74 permutations/s]
Permutation test:  15%|█▍        | 1466/10000 [00:17<01:36, 88.32 permutations/s]
Permutation test:  15%|█▍        | 1475/10000 [00:17<01:36, 88.76 permutations/s]
Permutation test:  15%|█▍        | 1484/10000 [00:17<01:38, 86.70 permutations/s]
Permutation test:  15%|█▍        | 1493/10000 [00:17<01:39, 85.71 permutations/s]
Permutation test:  15%|█▌        | 1502/10000 [00:17<01:39, 85.00 permutations/s]
Permutation test:  15%|█▌        | 1511/10000 [00:17<01:43, 82.23 permutations/s]
Permutation test:  15%|█▌        | 1520/10000 [00:17<01:42, 82.54 permutations/s]
Permutation test:  15%|█▌        | 1529/10000 [00:18<01:45, 80.52 permutations/s]
Permutation test:  15%|█▌        | 1538/10000 [00:18<01:42, 82.50 permutations/s]
Permutation test:  15%|█▌        | 1547/10000 [00:18<01:42, 82.77 permutations/s]
Permutation test:  16%|█▌        | 1556/10000 [00:18<01:42, 82.44 permutations/s]
Permutation test:  16%|█▌        | 1565/10000 [00:18<01:43, 81.40 permutations/s]
Permutation test:  16%|█▌        | 1574/10000 [00:18<01:42, 82.36 permutations/s]
Permutation test:  16%|█▌        | 1583/10000 [00:18<01:40, 83.99 permutations/s]
Permutation test:  16%|█▌        | 1595/10000 [00:18<01:29, 93.45 permutations/s]
Permutation test:  16%|█▌        | 1605/10000 [00:18<01:33, 90.02 permutations/s]
Permutation test:  16%|█▌        | 1615/10000 [00:18<01:35, 88.13 permutations/s]
Permutation test:  16%|█▌        | 1624/10000 [00:19<01:37, 86.06 permutations/s]
Permutation test:  16%|█▋        | 1633/10000 [00:19<01:37, 86.03 permutations/s]
Permutation test:  16%|█▋        | 1642/10000 [00:19<01:42, 81.55 permutations/s]
Permutation test:  17%|█▋        | 1652/10000 [00:19<01:41, 82.43 permutations/s]
Permutation test:  17%|█▋        | 1663/10000 [00:19<01:37, 85.41 permutations/s]
Permutation test:  17%|█▋        | 1673/10000 [00:19<01:35, 86.99 permutations/s]
Permutation test:  17%|█▋        | 1682/10000 [00:19<01:36, 85.95 permutations/s]
Permutation test:  17%|█▋        | 1691/10000 [00:19<01:37, 85.19 permutations/s]
Permutation test:  17%|█▋        | 1700/10000 [00:20<01:38, 84.64 permutations/s]
Permutation test:  17%|█▋        | 1709/10000 [00:20<01:39, 83.34 permutations/s]
Permutation test:  17%|█▋        | 1718/10000 [00:20<01:41, 81.99 permutations/s]
Permutation test:  17%|█▋        | 1727/10000 [00:20<01:42, 80.57 permutations/s]
Permutation test:  17%|█▋        | 1737/10000 [00:20<01:40, 82.36 permutations/s]
Permutation test:  17%|█▋        | 1746/10000 [00:20<01:39, 82.64 permutations/s]
Permutation test:  18%|█▊        | 1756/10000 [00:20<01:36, 85.35 permutations/s]
Permutation test:  18%|█▊        | 1766/10000 [00:20<01:32, 88.90 permutations/s]
Permutation test:  18%|█▊        | 1775/10000 [00:20<01:34, 87.01 permutations/s]
Permutation test:  18%|█▊        | 1785/10000 [00:20<01:31, 90.18 permutations/s]
Permutation test:  18%|█▊        | 1795/10000 [00:21<01:28, 92.70 permutations/s]
Permutation test:  18%|█▊        | 1805/10000 [00:21<01:30, 90.62 permutations/s]
Permutation test:  18%|█▊        | 1815/10000 [00:21<01:32, 88.75 permutations/s]
Permutation test:  18%|█▊        | 1824/10000 [00:21<01:33, 87.16 permutations/s]
Permutation test:  18%|█▊        | 1833/10000 [00:21<01:34, 86.03 permutations/s]
Permutation test:  18%|█▊        | 1842/10000 [00:21<01:35, 85.23 permutations/s]
Permutation test:  19%|█▊        | 1851/10000 [00:21<01:37, 83.28 permutations/s]
Permutation test:  19%|█▊        | 1860/10000 [00:21<01:38, 82.39 permutations/s]
Permutation test:  19%|█▊        | 1869/10000 [00:21<01:37, 83.13 permutations/s]
Permutation test:  19%|█▉        | 1879/10000 [00:22<01:37, 83.63 permutations/s]
Permutation test:  19%|█▉        | 1888/10000 [00:22<01:37, 83.52 permutations/s]
Permutation test:  19%|█▉        | 1897/10000 [00:22<01:35, 84.89 permutations/s]
Permutation test:  19%|█▉        | 1906/10000 [00:22<01:35, 84.43 permutations/s]
Permutation test:  19%|█▉        | 1915/10000 [00:22<01:38, 82.26 permutations/s]
Permutation test:  19%|█▉        | 1924/10000 [00:22<01:37, 82.58 permutations/s]
Permutation test:  19%|█▉        | 1934/10000 [00:22<01:33, 85.90 permutations/s]
Permutation test:  19%|█▉        | 1943/10000 [00:22<01:33, 85.72 permutations/s]
Permutation test:  20%|█▉        | 1952/10000 [00:22<01:36, 83.59 permutations/s]
Permutation test:  20%|█▉        | 1961/10000 [00:23<01:35, 84.47 permutations/s]
Permutation test:  20%|█▉        | 1970/10000 [00:23<01:36, 83.17 permutations/s]
Permutation test:  20%|█▉        | 1979/10000 [00:23<01:35, 84.18 permutations/s]
Permutation test:  20%|█▉        | 1988/10000 [00:23<01:36, 83.01 permutations/s]
Permutation test:  20%|█▉        | 1997/10000 [00:23<01:34, 84.52 permutations/s]
Permutation test:  20%|██        | 2006/10000 [00:23<01:37, 82.30 permutations/s]
Permutation test:  20%|██        | 2015/10000 [00:23<01:36, 82.61 permutations/s]
Permutation test:  20%|██        | 2024/10000 [00:23<01:38, 81.03 permutations/s]
Permutation test:  20%|██        | 2034/10000 [00:23<01:35, 83.09 permutations/s]
Permutation test:  20%|██        | 2043/10000 [00:24<01:37, 81.82 permutations/s]
Permutation test:  21%|██        | 2052/10000 [00:24<01:38, 80.86 permutations/s]
Permutation test:  21%|██        | 2061/10000 [00:24<01:36, 82.56 permutations/s]
Permutation test:  21%|██        | 2070/10000 [00:24<01:36, 82.34 permutations/s]
Permutation test:  21%|██        | 2079/10000 [00:24<01:35, 82.63 permutations/s]
Permutation test:  21%|██        | 2088/10000 [00:24<01:37, 81.38 permutations/s]
Permutation test:  21%|██        | 2099/10000 [00:24<01:30, 87.77 permutations/s]
Permutation test:  21%|██        | 2108/10000 [00:24<01:31, 85.97 permutations/s]
Permutation test:  21%|██        | 2117/10000 [00:24<01:32, 85.67 permutations/s]
Permutation test:  21%|██▏       | 2126/10000 [00:25<01:35, 82.27 permutations/s]
Permutation test:  21%|██▏       | 2135/10000 [00:25<01:39, 79.05 permutations/s]
Permutation test:  21%|██▏       | 2144/10000 [00:25<01:37, 80.72 permutations/s]
Permutation test:  22%|██▏       | 2153/10000 [00:25<01:38, 79.52 permutations/s]
Permutation test:  22%|██▏       | 2162/10000 [00:25<01:38, 79.39 permutations/s]
Permutation test:  22%|██▏       | 2171/10000 [00:25<01:36, 81.45 permutations/s]
Permutation test:  22%|██▏       | 2180/10000 [00:25<01:36, 80.68 permutations/s]
Permutation test:  22%|██▏       | 2189/10000 [00:25<01:34, 82.79 permutations/s]
Permutation test:  22%|██▏       | 2198/10000 [00:25<01:36, 80.44 permutations/s]
Permutation test:  22%|██▏       | 2207/10000 [00:26<01:34, 82.88 permutations/s]
Permutation test:  22%|██▏       | 2216/10000 [00:26<01:35, 81.26 permutations/s]
Permutation test:  22%|██▏       | 2226/10000 [00:26<01:33, 82.82 permutations/s]
Permutation test:  22%|██▏       | 2235/10000 [00:26<01:33, 83.41 permutations/s]
Permutation test:  22%|██▏       | 2244/10000 [00:26<01:33, 82.94 permutations/s]
Permutation test:  23%|██▎       | 2253/10000 [00:26<01:34, 81.71 permutations/s]
Permutation test:  23%|██▎       | 2265/10000 [00:26<01:24, 91.08 permutations/s]
Permutation test:  23%|██▎       | 2275/10000 [00:26<01:26, 89.06 permutations/s]
Permutation test:  23%|██▎       | 2284/10000 [00:26<01:29, 86.02 permutations/s]
Permutation test:  23%|██▎       | 2293/10000 [00:27<01:31, 84.30 permutations/s]
Permutation test:  23%|██▎       | 2302/10000 [00:27<01:33, 82.67 permutations/s]
Permutation test:  23%|██▎       | 2311/10000 [00:27<01:31, 83.79 permutations/s]
Permutation test:  23%|██▎       | 2320/10000 [00:27<01:32, 82.75 permutations/s]
Permutation test:  23%|██▎       | 2329/10000 [00:27<01:33, 82.42 permutations/s]
Permutation test:  23%|██▎       | 2338/10000 [00:27<01:35, 79.97 permutations/s]
Permutation test:  23%|██▎       | 2347/10000 [00:27<01:35, 80.00 permutations/s]
Permutation test:  24%|██▎       | 2356/10000 [00:27<01:35, 80.33 permutations/s]
Permutation test:  24%|██▎       | 2365/10000 [00:27<01:34, 80.76 permutations/s]
Permutation test:  24%|██▍       | 2375/10000 [00:28<01:32, 82.17 permutations/s]
Permutation test:  24%|██▍       | 2388/10000 [00:28<01:23, 91.59 permutations/s]
Permutation test:  24%|██▍       | 2398/10000 [00:28<01:24, 89.71 permutations/s]
Permutation test:  24%|██▍       | 2408/10000 [00:28<01:22, 92.03 permutations/s]
Permutation test:  24%|██▍       | 2418/10000 [00:28<01:24, 89.75 permutations/s]
Permutation test:  24%|██▍       | 2427/10000 [00:28<01:28, 85.97 permutations/s]
Permutation test:  24%|██▍       | 2439/10000 [00:28<01:19, 94.75 permutations/s]
Permutation test:  24%|██▍       | 2449/10000 [00:28<01:20, 93.43 permutations/s]
Permutation test:  25%|██▍       | 2459/10000 [00:29<01:25, 88.34 permutations/s]
Permutation test:  25%|██▍       | 2468/10000 [00:29<01:26, 86.92 permutations/s]
Permutation test:  25%|██▍       | 2477/10000 [00:29<01:29, 84.51 permutations/s]
Permutation test:  25%|██▍       | 2486/10000 [00:29<01:30, 83.27 permutations/s]
Permutation test:  25%|██▍       | 2495/10000 [00:29<01:29, 83.74 permutations/s]
Permutation test:  25%|██▌       | 2504/10000 [00:29<01:30, 83.17 permutations/s]
Permutation test:  25%|██▌       | 2513/10000 [00:29<01:30, 82.77 permutations/s]
Permutation test:  25%|██▌       | 2522/10000 [00:29<01:29, 83.79 permutations/s]
Permutation test:  25%|██▌       | 2531/10000 [00:29<01:30, 82.35 permutations/s]
Permutation test:  25%|██▌       | 2540/10000 [00:29<01:29, 83.09 permutations/s]
Permutation test:  26%|██▌       | 2558/10000 [00:30<01:07, 110.44 permutations/s]
Permutation test:  26%|██▌       | 2574/10000 [00:30<01:00, 123.71 permutations/s]
Permutation test:  26%|██▌       | 2587/10000 [00:30<01:00, 121.72 permutations/s]
Permutation test:  26%|██▌       | 2600/10000 [00:30<01:09, 106.31 permutations/s]
Permutation test:  26%|██▌       | 2612/10000 [00:30<01:14, 99.08 permutations/s]
Permutation test:  26%|██▌       | 2623/10000 [00:30<01:15, 97.84 permutations/s]
Permutation test:  26%|██▋       | 2634/10000 [00:30<01:18, 94.25 permutations/s]
Permutation test:  26%|██▋       | 2644/10000 [00:30<01:21, 89.77 permutations/s]
Permutation test:  27%|██▋       | 2654/10000 [00:31<01:22, 88.76 permutations/s]
Permutation test:  27%|██▋       | 2663/10000 [00:31<01:25, 85.96 permutations/s]
Permutation test:  27%|██▋       | 2672/10000 [00:31<01:25, 85.24 permutations/s]
Permutation test:  27%|██▋       | 2681/10000 [00:31<01:26, 84.70 permutations/s]
Permutation test:  27%|██▋       | 2690/10000 [00:31<01:28, 82.55 permutations/s]
Permutation test:  27%|██▋       | 2699/10000 [00:31<01:29, 81.88 permutations/s]
Permutation test:  27%|██▋       | 2708/10000 [00:31<01:28, 82.32 permutations/s]
Permutation test:  27%|██▋       | 2717/10000 [00:31<01:31, 79.17 permutations/s]
Permutation test:  27%|██▋       | 2725/10000 [00:31<01:32, 78.97 permutations/s]
Permutation test:  27%|██▋       | 2735/10000 [00:32<01:28, 82.08 permutations/s]
Permutation test:  27%|██▋       | 2747/10000 [00:32<01:20, 90.10 permutations/s]
Permutation test:  28%|██▊       | 2757/10000 [00:32<01:22, 87.50 permutations/s]
Permutation test:  28%|██▊       | 2766/10000 [00:32<01:26, 84.05 permutations/s]
Permutation test:  28%|██▊       | 2775/10000 [00:32<01:24, 85.64 permutations/s]
Permutation test:  28%|██▊       | 2784/10000 [00:32<01:27, 82.91 permutations/s]
Permutation test:  28%|██▊       | 2796/10000 [00:32<01:21, 88.30 permutations/s]
Permutation test:  28%|██▊       | 2805/10000 [00:32<01:21, 88.05 permutations/s]
Permutation test:  28%|██▊       | 2814/10000 [00:32<01:22, 86.68 permutations/s]
Permutation test:  28%|██▊       | 2823/10000 [00:33<01:25, 83.85 permutations/s]
Permutation test:  28%|██▊       | 2832/10000 [00:33<01:27, 82.33 permutations/s]
Permutation test:  28%|██▊       | 2841/10000 [00:33<01:25, 84.00 permutations/s]
Permutation test:  28%|██▊       | 2850/10000 [00:33<01:25, 83.81 permutations/s]
Permutation test:  29%|██▊       | 2859/10000 [00:33<01:25, 83.68 permutations/s]
Permutation test:  29%|██▊       | 2868/10000 [00:33<01:25, 83.56 permutations/s]
Permutation test:  29%|██▉       | 2877/10000 [00:33<01:24, 83.96 permutations/s]
Permutation test:  29%|██▉       | 2886/10000 [00:33<01:26, 81.93 permutations/s]
Permutation test:  29%|██▉       | 2896/10000 [00:33<01:24, 83.73 permutations/s]
Permutation test:  29%|██▉       | 2905/10000 [00:34<01:24, 84.07 permutations/s]
Permutation test:  29%|██▉       | 2916/10000 [00:34<01:19, 89.38 permutations/s]
Permutation test:  29%|██▉       | 2925/10000 [00:34<01:20, 87.77 permutations/s]
Permutation test:  29%|██▉       | 2934/10000 [00:34<01:23, 85.04 permutations/s]
Permutation test:  29%|██▉       | 2943/10000 [00:34<01:23, 84.99 permutations/s]
Permutation test:  30%|██▉       | 2952/10000 [00:34<01:25, 82.23 permutations/s]
Permutation test:  30%|██▉       | 2964/10000 [00:34<01:17, 91.17 permutations/s]
Permutation test:  30%|██▉       | 2974/10000 [00:34<01:19, 88.46 permutations/s]
Permutation test:  30%|██▉       | 2983/10000 [00:34<01:21, 85.82 permutations/s]
Permutation test:  30%|██▉       | 2992/10000 [00:35<01:22, 85.09 permutations/s]
Permutation test:  30%|███       | 3001/10000 [00:35<01:26, 80.65 permutations/s]
Permutation test:  30%|███       | 3011/10000 [00:35<01:24, 82.28 permutations/s]
Permutation test:  30%|███       | 3020/10000 [00:35<01:23, 83.94 permutations/s]
Permutation test:  30%|███       | 3029/10000 [00:35<01:24, 82.88 permutations/s]
Permutation test:  30%|███       | 3038/10000 [00:35<01:24, 82.56 permutations/s]
Permutation test:  30%|███       | 3047/10000 [00:35<01:25, 81.02 permutations/s]
Permutation test:  31%|███       | 3059/10000 [00:35<01:18, 87.92 permutations/s]
Permutation test:  31%|███       | 3069/10000 [00:35<01:15, 91.21 permutations/s]
Permutation test:  31%|███       | 3079/10000 [00:36<01:19, 87.23 permutations/s]
Permutation test:  31%|███       | 3088/10000 [00:36<01:19, 87.31 permutations/s]
Permutation test:  31%|███       | 3097/10000 [00:36<01:24, 81.45 permutations/s]
Permutation test:  31%|███       | 3107/10000 [00:36<01:23, 82.46 permutations/s]
Permutation test:  31%|███       | 3116/10000 [00:36<01:22, 83.62 permutations/s]
Permutation test:  31%|███▏      | 3125/10000 [00:36<01:23, 82.21 permutations/s]
Permutation test:  31%|███▏      | 3137/10000 [00:36<01:16, 90.11 permutations/s]
Permutation test:  31%|███▏      | 3147/10000 [00:36<01:16, 89.86 permutations/s]
Permutation test:  32%|███▏      | 3157/10000 [00:37<01:17, 87.82 permutations/s]
Permutation test:  32%|███▏      | 3166/10000 [00:37<01:20, 85.16 permutations/s]
Permutation test:  32%|███▏      | 3176/10000 [00:37<01:21, 84.16 permutations/s]
Permutation test:  32%|███▏      | 3185/10000 [00:37<01:20, 84.80 permutations/s]
Permutation test:  32%|███▏      | 3194/10000 [00:37<01:20, 84.25 permutations/s]
Permutation test:  32%|███▏      | 3203/10000 [00:37<01:19, 85.28 permutations/s]
Permutation test:  32%|███▏      | 3212/10000 [00:37<01:20, 84.71 permutations/s]
Permutation test:  32%|███▏      | 3221/10000 [00:37<01:22, 82.46 permutations/s]
Permutation test:  32%|███▏      | 3230/10000 [00:37<01:21, 83.16 permutations/s]
Permutation test:  32%|███▏      | 3239/10000 [00:38<01:23, 81.43 permutations/s]
Permutation test:  32%|███▏      | 3248/10000 [00:38<01:21, 83.34 permutations/s]
Permutation test:  33%|███▎      | 3257/10000 [00:38<01:21, 82.44 permutations/s]
Permutation test:  33%|███▎      | 3266/10000 [00:38<01:21, 82.26 permutations/s]
Permutation test:  33%|███▎      | 3275/10000 [00:38<01:21, 82.56 permutations/s]
Permutation test:  33%|███▎      | 3284/10000 [00:38<01:22, 81.01 permutations/s]
Permutation test:  33%|███▎      | 3293/10000 [00:38<01:22, 81.70 permutations/s]
Permutation test:  33%|███▎      | 3305/10000 [00:38<01:12, 91.85 permutations/s]
Permutation test:  33%|███▎      | 3315/10000 [00:38<01:16, 87.64 permutations/s]
Permutation test:  33%|███▎      | 3324/10000 [00:39<01:18, 84.67 permutations/s]
Permutation test:  33%|███▎      | 3333/10000 [00:39<01:20, 82.93 permutations/s]
Permutation test:  33%|███▎      | 3342/10000 [00:39<01:18, 84.42 permutations/s]
Permutation test:  34%|███▎      | 3351/10000 [00:39<01:20, 82.73 permutations/s]
Permutation test:  34%|███▎      | 3360/10000 [00:39<01:20, 82.88 permutations/s]
Permutation test:  34%|███▎      | 3369/10000 [00:39<01:18, 84.44 permutations/s]
Permutation test:  34%|███▍      | 3378/10000 [00:39<01:20, 82.71 permutations/s]
Permutation test:  34%|███▍      | 3387/10000 [00:39<01:20, 82.63 permutations/s]
Permutation test:  34%|███▍      | 3396/10000 [00:39<01:21, 81.49 permutations/s]
Permutation test:  34%|███▍      | 3405/10000 [00:39<01:19, 83.44 permutations/s]
Permutation test:  34%|███▍      | 3414/10000 [00:40<01:17, 84.84 permutations/s]
Permutation test:  34%|███▍      | 3423/10000 [00:40<01:19, 82.52 permutations/s]
Permutation test:  34%|███▍      | 3432/10000 [00:40<01:19, 82.77 permutations/s]
Permutation test:  34%|███▍      | 3441/10000 [00:40<01:19, 82.01 permutations/s]
Permutation test:  34%|███▍      | 3450/10000 [00:40<01:20, 81.01 permutations/s]
Permutation test:  35%|███▍      | 3459/10000 [00:40<01:19, 82.19 permutations/s]
Permutation test:  35%|███▍      | 3469/10000 [00:40<01:15, 86.49 permutations/s]
Permutation test:  35%|███▍      | 3479/10000 [00:40<01:13, 88.77 permutations/s]
Permutation test:  35%|███▍      | 3488/10000 [00:40<01:13, 88.95 permutations/s]
Permutation test:  35%|███▍      | 3497/10000 [00:41<01:14, 87.12 permutations/s]
Permutation test:  35%|███▌      | 3506/10000 [00:41<01:15, 86.06 permutations/s]
Permutation test:  35%|███▌      | 3515/10000 [00:41<01:15, 85.72 permutations/s]
Permutation test:  35%|███▌      | 3524/10000 [00:41<01:16, 85.00 permutations/s]
Permutation test:  35%|███▌      | 3533/10000 [00:41<01:16, 84.51 permutations/s]
Permutation test:  35%|███▌      | 3542/10000 [00:41<01:16, 84.15 permutations/s]
Permutation test:  36%|███▌      | 3551/10000 [00:41<01:18, 82.06 permutations/s]
Permutation test:  36%|███▌      | 3561/10000 [00:41<01:16, 84.28 permutations/s]
Permutation test:  36%|███▌      | 3570/10000 [00:41<01:17, 82.60 permutations/s]
Permutation test:  36%|███▌      | 3579/10000 [00:42<01:17, 82.80 permutations/s]
Permutation test:  36%|███▌      | 3588/10000 [00:42<01:17, 82.32 permutations/s]
Permutation test:  36%|███▌      | 3597/10000 [00:42<01:17, 83.06 permutations/s]
Permutation test:  36%|███▌      | 3607/10000 [00:42<01:15, 84.53 permutations/s]
Permutation test:  36%|███▌      | 3616/10000 [00:42<01:15, 84.62 permutations/s]
Permutation test:  36%|███▋      | 3625/10000 [00:42<01:16, 82.82 permutations/s]
Permutation test:  36%|███▋      | 3634/10000 [00:42<01:17, 82.06 permutations/s]
Permutation test:  36%|███▋      | 3643/10000 [00:42<01:16, 82.73 permutations/s]
Permutation test:  37%|███▋      | 3652/10000 [00:42<01:17, 81.97 permutations/s]
Permutation test:  37%|███▋      | 3661/10000 [00:43<01:17, 81.97 permutations/s]
Permutation test:  37%|███▋      | 3670/10000 [00:43<01:17, 81.47 permutations/s]
Permutation test:  37%|███▋      | 3679/10000 [00:43<01:17, 81.12 permutations/s]
Permutation test:  37%|███▋      | 3688/10000 [00:43<01:17, 81.55 permutations/s]
Permutation test:  37%|███▋      | 3697/10000 [00:43<01:18, 80.77 permutations/s]
Permutation test:  37%|███▋      | 3706/10000 [00:43<01:16, 82.42 permutations/s]
Permutation test:  37%|███▋      | 3715/10000 [00:43<01:16, 81.70 permutations/s]
Permutation test:  37%|███▋      | 3724/10000 [00:43<01:16, 82.23 permutations/s]
Permutation test:  37%|███▋      | 3733/10000 [00:43<01:15, 82.83 permutations/s]
Permutation test:  37%|███▋      | 3742/10000 [00:44<01:15, 82.51 permutations/s]
Permutation test:  38%|███▊      | 3751/10000 [00:44<01:16, 81.86 permutations/s]
Permutation test:  38%|███▊      | 3760/10000 [00:44<01:17, 80.95 permutations/s]
Permutation test:  38%|███▊      | 3769/10000 [00:44<01:20, 77.64 permutations/s]
Permutation test:  38%|███▊      | 3778/10000 [00:44<01:17, 80.71 permutations/s]
Permutation test:  38%|███▊      | 3787/10000 [00:44<01:18, 79.20 permutations/s]
Permutation test:  38%|███▊      | 3802/10000 [00:44<01:06, 92.89 permutations/s]
Permutation test:  38%|███▊      | 3812/10000 [00:44<01:08, 89.74 permutations/s]
Permutation test:  38%|███▊      | 3822/10000 [00:44<01:09, 89.20 permutations/s]
Permutation test:  38%|███▊      | 3831/10000 [00:45<01:11, 86.62 permutations/s]
Permutation test:  38%|███▊      | 3840/10000 [00:45<01:11, 86.12 permutations/s]
Permutation test:  38%|███▊      | 3849/10000 [00:45<01:12, 84.80 permutations/s]
Permutation test:  39%|███▊      | 3858/10000 [00:45<01:12, 84.66 permutations/s]
Permutation test:  39%|███▊      | 3867/10000 [00:45<01:12, 84.25 permutations/s]
Permutation test:  39%|███▉      | 3876/10000 [00:45<01:12, 84.92 permutations/s]
Permutation test:  39%|███▉      | 3885/10000 [00:45<01:14, 81.67 permutations/s]
Permutation test:  39%|███▉      | 3894/10000 [00:45<01:14, 81.74 permutations/s]
Permutation test:  39%|███▉      | 3903/10000 [00:45<01:15, 80.70 permutations/s]
Permutation test:  39%|███▉      | 3913/10000 [00:46<01:12, 83.50 permutations/s]
Permutation test:  39%|███▉      | 3922/10000 [00:46<01:14, 81.65 permutations/s]
Permutation test:  39%|███▉      | 3931/10000 [00:46<01:13, 82.17 permutations/s]
Permutation test:  39%|███▉      | 3940/10000 [00:46<01:13, 82.06 permutations/s]
Permutation test:  39%|███▉      | 3949/10000 [00:46<01:12, 83.58 permutations/s]
Permutation test:  40%|███▉      | 3958/10000 [00:46<01:12, 83.05 permutations/s]
Permutation test:  40%|███▉      | 3968/10000 [00:46<01:11, 84.49 permutations/s]
Permutation test:  40%|███▉      | 3977/10000 [00:46<01:11, 84.53 permutations/s]
Permutation test:  40%|███▉      | 3986/10000 [00:46<01:12, 83.34 permutations/s]
Permutation test:  40%|███▉      | 3995/10000 [00:47<01:10, 84.75 permutations/s]
Permutation test:  40%|████      | 4004/10000 [00:47<01:11, 84.32 permutations/s]
Permutation test:  40%|████      | 4013/10000 [00:47<01:11, 84.02 permutations/s]
Permutation test:  40%|████      | 4022/10000 [00:47<01:12, 82.40 permutations/s]
Permutation test:  40%|████      | 4031/10000 [00:47<01:13, 80.85 permutations/s]
Permutation test:  40%|████      | 4041/10000 [00:47<01:12, 81.65 permutations/s]
Permutation test:  40%|████      | 4050/10000 [00:47<01:11, 83.52 permutations/s]
Permutation test:  41%|████      | 4059/10000 [00:47<01:13, 80.41 permutations/s]
Permutation test:  41%|████      | 4068/10000 [00:47<01:13, 80.80 permutations/s]
Permutation test:  41%|████      | 4077/10000 [00:48<01:15, 78.14 permutations/s]
Permutation test:  41%|████      | 4086/10000 [00:48<01:15, 78.82 permutations/s]
Permutation test:  41%|████      | 4095/10000 [00:48<01:13, 80.13 permutations/s]
Permutation test:  41%|████      | 4104/10000 [00:48<01:14, 79.36 permutations/s]
Permutation test:  41%|████      | 4112/10000 [00:48<01:14, 79.44 permutations/s]
Permutation test:  41%|████      | 4121/10000 [00:48<01:11, 82.04 permutations/s]
Permutation test:  41%|████▏     | 4130/10000 [00:48<01:10, 83.85 permutations/s]
Permutation test:  41%|████▏     | 4142/10000 [00:48<01:02, 93.11 permutations/s]
Permutation test:  42%|████▏     | 4152/10000 [00:48<01:02, 93.55 permutations/s]
Permutation test:  42%|████▏     | 4163/10000 [00:49<01:00, 96.08 permutations/s]
Permutation test:  42%|████▏     | 4173/10000 [00:49<01:03, 91.92 permutations/s]
Permutation test:  42%|████▏     | 4183/10000 [00:49<01:05, 88.25 permutations/s]
Permutation test:  42%|████▏     | 4192/10000 [00:49<01:05, 88.70 permutations/s]
Permutation test:  42%|████▏     | 4201/10000 [00:49<01:06, 87.15 permutations/s]
Permutation test:  42%|████▏     | 4210/10000 [00:49<01:06, 86.99 permutations/s]
Permutation test:  42%|████▏     | 4219/10000 [00:49<01:08, 84.69 permutations/s]
Permutation test:  42%|████▏     | 4228/10000 [00:49<01:08, 84.53 permutations/s]
Permutation test:  42%|████▏     | 4237/10000 [00:49<01:08, 84.17 permutations/s]
Permutation test:  42%|████▏     | 4246/10000 [00:50<01:08, 83.92 permutations/s]
Permutation test:  43%|████▎     | 4255/10000 [00:50<01:10, 81.92 permutations/s]
Permutation test:  43%|████▎     | 4264/10000 [00:50<01:09, 82.28 permutations/s]
Permutation test:  43%|████▎     | 4273/10000 [00:50<01:10, 80.70 permutations/s]
Permutation test:  43%|████▎     | 4282/10000 [00:50<01:08, 83.23 permutations/s]
Permutation test:  43%|████▎     | 4291/10000 [00:50<01:09, 81.87 permutations/s]
Permutation test:  43%|████▎     | 4300/10000 [00:50<01:10, 80.99 permutations/s]
Permutation test:  43%|████▎     | 4311/10000 [00:50<01:04, 88.10 permutations/s]
Permutation test:  43%|████▎     | 4320/10000 [00:50<01:05, 86.49 permutations/s]
Permutation test:  43%|████▎     | 4329/10000 [00:51<01:06, 85.82 permutations/s]
Permutation test:  43%|████▎     | 4338/10000 [00:51<01:06, 85.71 permutations/s]
Permutation test:  43%|████▎     | 4347/10000 [00:51<01:06, 84.51 permutations/s]
Permutation test:  44%|████▎     | 4356/10000 [00:51<01:07, 84.14 permutations/s]
Permutation test:  44%|████▎     | 4365/10000 [00:51<01:06, 85.34 permutations/s]
Permutation test:  44%|████▎     | 4374/10000 [00:51<01:06, 84.74 permutations/s]
Permutation test:  44%|████▍     | 4383/10000 [00:51<01:06, 84.31 permutations/s]
Permutation test:  44%|████▍     | 4392/10000 [00:51<01:06, 84.02 permutations/s]
Permutation test:  44%|████▍     | 4401/10000 [00:51<01:07, 82.39 permutations/s]
Permutation test:  44%|████▍     | 4410/10000 [00:51<01:06, 84.10 permutations/s]
Permutation test:  44%|████▍     | 4419/10000 [00:52<01:08, 82.03 permutations/s]
Permutation test:  44%|████▍     | 4428/10000 [00:52<01:07, 82.87 permutations/s]
Permutation test:  44%|████▍     | 4437/10000 [00:52<01:05, 84.41 permutations/s]
Permutation test:  44%|████▍     | 4446/10000 [00:52<01:06, 84.08 permutations/s]
Permutation test:  45%|████▍     | 4455/10000 [00:52<01:06, 83.87 permutations/s]
Permutation test:  45%|████▍     | 4464/10000 [00:52<01:07, 81.43 permutations/s]
Permutation test:  45%|████▍     | 4475/10000 [00:52<01:03, 86.86 permutations/s]
Permutation test:  45%|████▍     | 4485/10000 [00:52<01:01, 89.41 permutations/s]
Permutation test:  45%|████▍     | 4494/10000 [00:52<01:03, 87.11 permutations/s]
Permutation test:  45%|████▌     | 4503/10000 [00:53<01:04, 85.73 permutations/s]
Permutation test:  45%|████▌     | 4512/10000 [00:53<01:03, 86.73 permutations/s]
Permutation test:  45%|████▌     | 4521/10000 [00:53<01:05, 84.26 permutations/s]
Permutation test:  45%|████▌     | 4530/10000 [00:53<01:04, 85.42 permutations/s]
Permutation test:  45%|████▌     | 4539/10000 [00:53<01:04, 84.54 permutations/s]
Permutation test:  45%|████▌     | 4548/10000 [00:53<01:06, 81.89 permutations/s]
Permutation test:  46%|████▌     | 4558/10000 [00:53<01:05, 82.73 permutations/s]
Permutation test:  46%|████▌     | 4567/10000 [00:53<01:04, 84.28 permutations/s]
Permutation test:  46%|████▌     | 4576/10000 [00:53<01:06, 81.79 permutations/s]
Permutation test:  46%|████▌     | 4586/10000 [00:54<01:05, 82.21 permutations/s]
Permutation test:  46%|████▌     | 4596/10000 [00:54<01:05, 82.61 permutations/s]
Permutation test:  46%|████▌     | 4606/10000 [00:54<01:04, 83.72 permutations/s]
Permutation test:  46%|████▌     | 4615/10000 [00:54<01:03, 84.49 permutations/s]
Permutation test:  46%|████▌     | 4624/10000 [00:54<01:04, 83.26 permutations/s]
Permutation test:  46%|████▋     | 4633/10000 [00:54<01:03, 84.19 permutations/s]
Permutation test:  46%|████▋     | 4643/10000 [00:54<01:00, 87.91 permutations/s]
Permutation test:  47%|████▋     | 4653/10000 [00:54<00:59, 89.96 permutations/s]
Permutation test:  47%|████▋     | 4663/10000 [00:54<01:00, 87.89 permutations/s]
Permutation test:  47%|████▋     | 4672/10000 [00:55<01:02, 85.13 permutations/s]
Permutation test:  47%|████▋     | 4681/10000 [00:55<01:01, 86.03 permutations/s]
Permutation test:  47%|████▋     | 4690/10000 [00:55<01:03, 83.84 permutations/s]
Permutation test:  47%|████▋     | 4699/10000 [00:55<01:02, 84.62 permutations/s]
Permutation test:  47%|████▋     | 4708/10000 [00:55<01:03, 83.31 permutations/s]
Permutation test:  47%|████▋     | 4717/10000 [00:55<01:03, 83.33 permutations/s]
Permutation test:  47%|████▋     | 4726/10000 [00:55<01:04, 82.40 permutations/s]
Permutation test:  47%|████▋     | 4735/10000 [00:55<01:05, 80.92 permutations/s]
Permutation test:  47%|████▋     | 4744/10000 [00:55<01:03, 82.51 permutations/s]
Permutation test:  48%|████▊     | 4753/10000 [00:56<01:04, 80.95 permutations/s]
Permutation test:  48%|████▊     | 4762/10000 [00:56<01:03, 83.02 permutations/s]
Permutation test:  48%|████▊     | 4771/10000 [00:56<01:05, 80.01 permutations/s]
Permutation test:  48%|████▊     | 4780/10000 [00:56<01:04, 81.42 permutations/s]
Permutation test:  48%|████▊     | 4789/10000 [00:56<01:02, 83.37 permutations/s]
Permutation test:  48%|████▊     | 4798/10000 [00:56<01:02, 83.81 permutations/s]
Permutation test:  48%|████▊     | 4807/10000 [00:56<01:02, 83.14 permutations/s]
Permutation test:  48%|████▊     | 4818/10000 [00:56<01:00, 86.30 permutations/s]
Permutation test:  48%|████▊     | 4828/10000 [00:56<01:00, 85.45 permutations/s]
Permutation test:  48%|████▊     | 4837/10000 [00:57<00:59, 86.22 permutations/s]
Permutation test:  48%|████▊     | 4846/10000 [00:57<01:01, 84.48 permutations/s]
Permutation test:  49%|████▊     | 4855/10000 [00:57<01:00, 85.05 permutations/s]
Permutation test:  49%|████▊     | 4864/10000 [00:57<01:02, 82.26 permutations/s]
Permutation test:  49%|████▊     | 4873/10000 [00:57<01:01, 83.93 permutations/s]
Permutation test:  49%|████▉     | 4882/10000 [00:57<01:01, 82.86 permutations/s]
Permutation test:  49%|████▉     | 4891/10000 [00:57<01:01, 82.54 permutations/s]
Permutation test:  49%|████▉     | 4900/10000 [00:57<01:03, 80.11 permutations/s]
Permutation test:  49%|████▉     | 4909/10000 [00:57<01:02, 81.03 permutations/s]
Permutation test:  49%|████▉     | 4918/10000 [00:58<01:02, 81.10 permutations/s]
Permutation test:  49%|████▉     | 4927/10000 [00:58<01:01, 82.65 permutations/s]
Permutation test:  49%|████▉     | 4936/10000 [00:58<01:02, 81.05 permutations/s]
Permutation test:  49%|████▉     | 4945/10000 [00:58<01:01, 82.16 permutations/s]
Permutation test:  50%|████▉     | 4954/10000 [00:58<01:02, 80.76 permutations/s]
Permutation test:  50%|████▉     | 4963/10000 [00:58<01:01, 81.95 permutations/s]
Permutation test:  50%|████▉     | 4972/10000 [00:58<01:02, 80.38 permutations/s]
Permutation test:  50%|████▉     | 4983/10000 [00:58<00:56, 88.34 permutations/s]
Permutation test:  50%|████▉     | 4992/10000 [00:58<00:58, 85.89 permutations/s]
Permutation test:  50%|█████     | 5001/10000 [00:59<00:59, 84.43 permutations/s]
Permutation test:  50%|█████     | 5010/10000 [00:59<01:00, 82.73 permutations/s]
Permutation test:  50%|█████     | 5019/10000 [00:59<00:59, 83.84 permutations/s]
Permutation test:  50%|█████     | 5028/10000 [00:59<01:00, 81.74 permutations/s]
Permutation test:  50%|█████     | 5038/10000 [00:59<00:59, 83.26 permutations/s]
Permutation test:  50%|█████     | 5047/10000 [00:59<00:59, 83.73 permutations/s]
Permutation test:  51%|█████     | 5056/10000 [00:59<00:59, 83.60 permutations/s]
Permutation test:  51%|█████     | 5065/10000 [00:59<00:58, 83.75 permutations/s]
Permutation test:  51%|█████     | 5074/10000 [00:59<00:58, 83.56 permutations/s]
Permutation test:  51%|█████     | 5083/10000 [01:00<00:59, 83.12 permutations/s]
Permutation test:  51%|█████     | 5093/10000 [01:00<00:57, 85.01 permutations/s]
Permutation test:  51%|█████     | 5102/10000 [01:00<00:57, 84.99 permutations/s]
Permutation test:  51%|█████     | 5111/10000 [01:00<00:57, 84.50 permutations/s]
Permutation test:  51%|█████     | 5120/10000 [01:00<00:57, 84.15 permutations/s]
Permutation test:  51%|█████▏    | 5129/10000 [01:00<00:57, 84.37 permutations/s]
Permutation test:  51%|█████▏    | 5138/10000 [01:00<00:59, 81.77 permutations/s]
Permutation test:  51%|█████▏    | 5149/10000 [01:00<00:54, 89.15 permutations/s]
Permutation test:  52%|█████▏    | 5158/10000 [01:00<00:56, 86.44 permutations/s]
Permutation test:  52%|█████▏    | 5167/10000 [01:01<00:57, 83.67 permutations/s]
Permutation test:  52%|█████▏    | 5177/10000 [01:01<00:57, 84.46 permutations/s]
Permutation test:  52%|█████▏    | 5186/10000 [01:01<00:58, 82.79 permutations/s]
Permutation test:  52%|█████▏    | 5195/10000 [01:01<00:58, 82.06 permutations/s]
Permutation test:  52%|█████▏    | 5204/10000 [01:01<00:57, 83.11 permutations/s]
Permutation test:  52%|█████▏    | 5213/10000 [01:01<00:57, 82.73 permutations/s]
Permutation test:  52%|█████▏    | 5222/10000 [01:01<00:57, 82.45 permutations/s]
Permutation test:  52%|█████▏    | 5231/10000 [01:01<00:58, 80.94 permutations/s]
Permutation test:  52%|█████▏    | 5240/10000 [01:01<00:58, 81.42 permutations/s]
Permutation test:  52%|█████▏    | 5249/10000 [01:02<00:59, 79.81 permutations/s]
Permutation test:  53%|█████▎    | 5259/10000 [01:02<00:57, 83.09 permutations/s]
Permutation test:  53%|█████▎    | 5268/10000 [01:02<00:56, 83.16 permutations/s]
Permutation test:  53%|█████▎    | 5277/10000 [01:02<00:57, 82.74 permutations/s]
Permutation test:  53%|█████▎    | 5286/10000 [01:02<00:57, 82.02 permutations/s]
Permutation test:  53%|█████▎    | 5295/10000 [01:02<00:58, 81.05 permutations/s]
Permutation test:  53%|█████▎    | 5304/10000 [01:02<00:57, 81.96 permutations/s]
Permutation test:  53%|█████▎    | 5314/10000 [01:02<00:56, 82.85 permutations/s]
Permutation test:  53%|█████▎    | 5323/10000 [01:02<00:56, 82.98 permutations/s]
Permutation test:  53%|█████▎    | 5332/10000 [01:03<00:56, 83.10 permutations/s]
Permutation test:  53%|█████▎    | 5343/10000 [01:03<00:52, 89.12 permutations/s]
Permutation test:  54%|█████▎    | 5352/10000 [01:03<00:53, 87.37 permutations/s]
Permutation test:  54%|█████▎    | 5361/10000 [01:03<00:55, 83.87 permutations/s]
Permutation test:  54%|█████▎    | 5371/10000 [01:03<00:54, 85.51 permutations/s]
Permutation test:  54%|█████▍    | 5380/10000 [01:03<00:54, 84.87 permutations/s]
Permutation test:  54%|█████▍    | 5389/10000 [01:03<00:54, 84.17 permutations/s]
Permutation test:  54%|█████▍    | 5398/10000 [01:03<00:56, 82.12 permutations/s]
Permutation test:  54%|█████▍    | 5407/10000 [01:03<00:54, 83.85 permutations/s]
Permutation test:  54%|█████▍    | 5416/10000 [01:04<00:54, 83.71 permutations/s]
Permutation test:  54%|█████▍    | 5425/10000 [01:04<00:55, 83.11 permutations/s]
Permutation test:  54%|█████▍    | 5434/10000 [01:04<00:55, 81.80 permutations/s]
Permutation test:  54%|█████▍    | 5443/10000 [01:04<00:55, 81.82 permutations/s]
Permutation test:  55%|█████▍    | 5452/10000 [01:04<00:54, 83.44 permutations/s]
Permutation test:  55%|█████▍    | 5461/10000 [01:04<00:54, 83.88 permutations/s]
Permutation test:  55%|█████▍    | 5470/10000 [01:04<00:54, 83.70 permutations/s]
Permutation test:  55%|█████▍    | 5480/10000 [01:04<00:51, 87.87 permutations/s]
Permutation test:  55%|█████▍    | 5490/10000 [01:04<00:49, 90.30 permutations/s]
Permutation test:  55%|█████▌    | 5500/10000 [01:04<00:51, 88.02 permutations/s]
Permutation test:  55%|█████▌    | 5509/10000 [01:05<00:52, 85.21 permutations/s]
Permutation test:  55%|█████▌    | 5518/10000 [01:05<00:52, 85.34 permutations/s]
Permutation test:  55%|█████▌    | 5527/10000 [01:05<00:54, 81.58 permutations/s]
Permutation test:  55%|█████▌    | 5536/10000 [01:05<00:54, 82.12 permutations/s]
Permutation test:  55%|█████▌    | 5545/10000 [01:05<00:55, 80.45 permutations/s]
Permutation test:  56%|█████▌    | 5554/10000 [01:05<00:54, 82.00 permutations/s]
Permutation test:  56%|█████▌    | 5563/10000 [01:05<00:54, 80.87 permutations/s]
Permutation test:  56%|█████▌    | 5572/10000 [01:05<00:54, 81.58 permutations/s]
Permutation test:  56%|█████▌    | 5581/10000 [01:05<00:53, 83.01 permutations/s]
Permutation test:  56%|█████▌    | 5590/10000 [01:06<00:54, 81.30 permutations/s]
Permutation test:  56%|█████▌    | 5599/10000 [01:06<00:54, 81.45 permutations/s]
Permutation test:  56%|█████▌    | 5608/10000 [01:06<00:54, 80.25 permutations/s]
Permutation test:  56%|█████▌    | 5618/10000 [01:06<00:53, 82.52 permutations/s]
Permutation test:  56%|█████▋    | 5627/10000 [01:06<00:52, 83.21 permutations/s]
Permutation test:  56%|█████▋    | 5636/10000 [01:06<00:53, 82.34 permutations/s]
Permutation test:  56%|█████▋    | 5647/10000 [01:06<00:48, 89.78 permutations/s]
Permutation test:  57%|█████▋    | 5659/10000 [01:06<00:44, 98.12 permutations/s]
Permutation test:  57%|█████▋    | 5669/10000 [01:06<00:46, 94.05 permutations/s]
Permutation test:  57%|█████▋    | 5679/10000 [01:07<00:47, 90.13 permutations/s]
Permutation test:  57%|█████▋    | 5689/10000 [01:07<00:48, 88.01 permutations/s]
Permutation test:  57%|█████▋    | 5698/10000 [01:07<00:49, 86.66 permutations/s]
Permutation test:  57%|█████▋    | 5707/10000 [01:07<00:51, 83.46 permutations/s]
Permutation test:  57%|█████▋    | 5716/10000 [01:07<00:51, 83.42 permutations/s]
Permutation test:  57%|█████▋    | 5725/10000 [01:07<00:52, 82.06 permutations/s]
Permutation test:  57%|█████▋    | 5734/10000 [01:07<00:50, 83.79 permutations/s]
Permutation test:  57%|█████▋    | 5743/10000 [01:07<00:52, 81.78 permutations/s]
Permutation test:  58%|█████▊    | 5753/10000 [01:07<00:50, 84.12 permutations/s]
Permutation test:  58%|█████▊    | 5762/10000 [01:08<00:51, 82.53 permutations/s]
Permutation test:  58%|█████▊    | 5771/10000 [01:08<00:50, 84.15 permutations/s]
Permutation test:  58%|█████▊    | 5780/10000 [01:08<00:51, 82.51 permutations/s]
Permutation test:  58%|█████▊    | 5789/10000 [01:08<00:50, 82.77 permutations/s]
Permutation test:  58%|█████▊    | 5798/10000 [01:08<00:52, 80.67 permutations/s]
Permutation test:  58%|█████▊    | 5808/10000 [01:08<00:51, 81.99 permutations/s]
Permutation test:  58%|█████▊    | 5819/10000 [01:08<00:46, 89.15 permutations/s]
Permutation test:  58%|█████▊    | 5830/10000 [01:08<00:44, 93.93 permutations/s]
Permutation test:  58%|█████▊    | 5840/10000 [01:08<00:45, 90.98 permutations/s]
Permutation test:  58%|█████▊    | 5850/10000 [01:09<00:46, 88.83 permutations/s]
Permutation test:  59%|█████▊    | 5860/10000 [01:09<00:46, 89.91 permutations/s]
Permutation test:  59%|█████▊    | 5870/10000 [01:09<00:46, 89.73 permutations/s]
Permutation test:  59%|█████▉    | 5881/10000 [01:09<00:43, 94.54 permutations/s]
Permutation test:  59%|█████▉    | 5891/10000 [01:09<00:45, 90.96 permutations/s]
Permutation test:  59%|█████▉    | 5901/10000 [01:09<00:46, 88.10 permutations/s]
Permutation test:  59%|█████▉    | 5910/10000 [01:09<00:49, 83.43 permutations/s]
Permutation test:  59%|█████▉    | 5919/10000 [01:09<00:48, 84.28 permutations/s]
Permutation test:  59%|█████▉    | 5928/10000 [01:10<00:48, 83.12 permutations/s]
Permutation test:  59%|█████▉    | 5937/10000 [01:10<00:48, 83.61 permutations/s]
Permutation test:  59%|█████▉    | 5946/10000 [01:10<00:49, 81.77 permutations/s]
Permutation test:  60%|█████▉    | 5955/10000 [01:10<00:48, 83.11 permutations/s]
Permutation test:  60%|█████▉    | 5964/10000 [01:10<00:49, 81.84 permutations/s]
Permutation test:  60%|█████▉    | 5973/10000 [01:10<00:48, 82.72 permutations/s]
Permutation test:  60%|█████▉    | 5982/10000 [01:10<00:49, 81.11 permutations/s]
Permutation test:  60%|█████▉    | 5992/10000 [01:10<00:47, 84.26 permutations/s]
Permutation test:  60%|██████    | 6002/10000 [01:10<00:47, 83.97 permutations/s]
Permutation test:  60%|██████    | 6012/10000 [01:11<00:47, 84.19 permutations/s]
Permutation test:  60%|██████    | 6021/10000 [01:11<00:46, 85.30 permutations/s]
Permutation test:  60%|██████    | 6030/10000 [01:11<00:48, 81.84 permutations/s]
Permutation test:  60%|██████    | 6039/10000 [01:11<00:47, 84.06 permutations/s]
Permutation test:  60%|██████    | 6048/10000 [01:11<00:46, 84.56 permutations/s]
Permutation test:  61%|██████    | 6057/10000 [01:11<00:46, 84.20 permutations/s]
Permutation test:  61%|██████    | 6066/10000 [01:11<00:46, 83.94 permutations/s]
Permutation test:  61%|██████    | 6075/10000 [01:11<00:46, 83.75 permutations/s]
Permutation test:  61%|██████    | 6084/10000 [01:11<00:48, 81.36 permutations/s]
Permutation test:  61%|██████    | 6093/10000 [01:12<00:47, 81.50 permutations/s]
Permutation test:  61%|██████    | 6102/10000 [01:12<00:47, 82.49 permutations/s]
Permutation test:  61%|██████    | 6111/10000 [01:12<00:46, 82.75 permutations/s]
Permutation test:  61%|██████    | 6120/10000 [01:12<00:47, 81.50 permutations/s]
Permutation test:  61%|██████▏   | 6129/10000 [01:12<00:47, 81.57 permutations/s]
Permutation test:  61%|██████▏   | 6138/10000 [01:12<00:47, 81.95 permutations/s]
Permutation test:  61%|██████▏   | 6147/10000 [01:12<00:46, 82.34 permutations/s]
Permutation test:  62%|██████▏   | 6158/10000 [01:12<00:42, 89.46 permutations/s]
Permutation test:  62%|██████▏   | 6169/10000 [01:12<00:41, 93.14 permutations/s]
Permutation test:  62%|██████▏   | 6179/10000 [01:13<00:44, 86.83 permutations/s]
Permutation test:  62%|██████▏   | 6188/10000 [01:13<00:45, 84.12 permutations/s]
Permutation test:  62%|██████▏   | 6197/10000 [01:13<00:44, 85.27 permutations/s]
Permutation test:  62%|██████▏   | 6206/10000 [01:13<00:44, 84.70 permutations/s]
Permutation test:  62%|██████▏   | 6215/10000 [01:13<00:44, 84.29 permutations/s]
Permutation test:  62%|██████▏   | 6224/10000 [01:13<00:45, 82.63 permutations/s]
Permutation test:  62%|██████▏   | 6233/10000 [01:13<00:44, 84.00 permutations/s]
Permutation test:  62%|██████▏   | 6242/10000 [01:13<00:45, 82.40 permutations/s]
Permutation test:  63%|██████▎   | 6251/10000 [01:13<00:44, 84.09 permutations/s]
Permutation test:  63%|██████▎   | 6260/10000 [01:13<00:44, 83.87 permutations/s]
Permutation test:  63%|██████▎   | 6269/10000 [01:14<00:45, 82.75 permutations/s]
Permutation test:  63%|██████▎   | 6278/10000 [01:14<00:45, 81.82 permutations/s]
Permutation test:  63%|██████▎   | 6288/10000 [01:14<00:43, 84.55 permutations/s]
Permutation test:  63%|██████▎   | 6297/10000 [01:14<00:44, 82.79 permutations/s]
Permutation test:  63%|██████▎   | 6306/10000 [01:14<00:43, 84.36 permutations/s]
Permutation test:  63%|██████▎   | 6315/10000 [01:14<00:43, 84.06 permutations/s]
Permutation test:  63%|██████▎   | 6324/10000 [01:14<00:44, 82.92 permutations/s]
Permutation test:  63%|██████▎   | 6337/10000 [01:14<00:38, 94.04 permutations/s]
Permutation test:  63%|██████▎   | 6347/10000 [01:14<00:40, 91.09 permutations/s]
Permutation test:  64%|██████▎   | 6357/10000 [01:15<00:41, 87.27 permutations/s]
Permutation test:  64%|██████▎   | 6366/10000 [01:15<00:42, 84.78 permutations/s]
Permutation test:  64%|██████▍   | 6375/10000 [01:15<00:42, 84.40 permutations/s]
Permutation test:  64%|██████▍   | 6384/10000 [01:15<00:43, 84.09 permutations/s]
Permutation test:  64%|██████▍   | 6393/10000 [01:15<00:43, 82.50 permutations/s]
Permutation test:  64%|██████▍   | 6402/10000 [01:15<00:43, 83.44 permutations/s]
Permutation test:  64%|██████▍   | 6411/10000 [01:15<00:44, 81.18 permutations/s]
Permutation test:  64%|██████▍   | 6420/10000 [01:15<00:42, 83.56 permutations/s]
Permutation test:  64%|██████▍   | 6429/10000 [01:15<00:43, 81.97 permutations/s]
Permutation test:  64%|██████▍   | 6438/10000 [01:16<00:43, 82.16 permutations/s]
Permutation test:  64%|██████▍   | 6447/10000 [01:16<00:43, 80.92 permutations/s]
Permutation test:  65%|██████▍   | 6456/10000 [01:16<00:44, 79.25 permutations/s]
Permutation test:  65%|██████▍   | 6466/10000 [01:16<00:43, 81.13 permutations/s]
Permutation test:  65%|██████▍   | 6475/10000 [01:16<00:42, 83.35 permutations/s]
Permutation test:  65%|██████▍   | 6484/10000 [01:16<00:43, 81.58 permutations/s]
Permutation test:  65%|██████▍   | 6494/10000 [01:16<00:41, 83.94 permutations/s]
Permutation test:  65%|██████▌   | 6504/10000 [01:16<00:40, 86.89 permutations/s]
Permutation test:  65%|██████▌   | 6513/10000 [01:16<00:40, 85.34 permutations/s]
Permutation test:  65%|██████▌   | 6522/10000 [01:17<00:40, 85.24 permutations/s]
Permutation test:  65%|██████▌   | 6531/10000 [01:17<00:41, 83.29 permutations/s]
Permutation test:  65%|██████▌   | 6540/10000 [01:17<00:40, 84.69 permutations/s]
Permutation test:  65%|██████▌   | 6549/10000 [01:17<00:41, 82.40 permutations/s]
Permutation test:  66%|██████▌   | 6559/10000 [01:17<00:40, 84.79 permutations/s]
Permutation test:  66%|██████▌   | 6568/10000 [01:17<00:40, 84.35 permutations/s]
Permutation test:  66%|██████▌   | 6577/10000 [01:17<00:40, 84.52 permutations/s]
Permutation test:  66%|██████▌   | 6586/10000 [01:17<00:42, 81.00 permutations/s]
Permutation test:  66%|██████▌   | 6595/10000 [01:17<00:41, 83.04 permutations/s]
Permutation test:  66%|██████▌   | 6604/10000 [01:18<00:40, 83.14 permutations/s]
Permutation test:  66%|██████▌   | 6613/10000 [01:18<00:41, 81.80 permutations/s]
Permutation test:  66%|██████▌   | 6622/10000 [01:18<00:40, 83.65 permutations/s]
Permutation test:  66%|██████▋   | 6631/10000 [01:18<00:40, 83.79 permutations/s]
Permutation test:  66%|██████▋   | 6640/10000 [01:18<00:40, 82.26 permutations/s]
Permutation test:  66%|██████▋   | 6649/10000 [01:18<00:41, 81.24 permutations/s]
Permutation test:  67%|██████▋   | 6658/10000 [01:18<00:40, 81.91 permutations/s]
Permutation test:  67%|██████▋   | 6669/10000 [01:18<00:37, 88.24 permutations/s]
Permutation test:  67%|██████▋   | 6678/10000 [01:18<00:37, 87.44 permutations/s]
Permutation test:  67%|██████▋   | 6687/10000 [01:19<00:39, 84.87 permutations/s]
Permutation test:  67%|██████▋   | 6697/10000 [01:19<00:38, 86.22 permutations/s]
Permutation test:  67%|██████▋   | 6706/10000 [01:19<00:38, 85.07 permutations/s]
Permutation test:  67%|██████▋   | 6715/10000 [01:19<00:39, 83.02 permutations/s]
Permutation test:  67%|██████▋   | 6724/10000 [01:19<00:39, 82.17 permutations/s]
Permutation test:  67%|██████▋   | 6733/10000 [01:19<00:39, 81.90 permutations/s]
Permutation test:  67%|██████▋   | 6742/10000 [01:19<00:40, 81.43 permutations/s]
Permutation test:  68%|██████▊   | 6751/10000 [01:19<00:41, 78.93 permutations/s]
Permutation test:  68%|██████▊   | 6761/10000 [01:19<00:39, 81.61 permutations/s]
Permutation test:  68%|██████▊   | 6770/10000 [01:20<00:39, 81.89 permutations/s]
Permutation test:  68%|██████▊   | 6779/10000 [01:20<00:39, 82.31 permutations/s]
Permutation test:  68%|██████▊   | 6788/10000 [01:20<00:39, 81.72 permutations/s]
Permutation test:  68%|██████▊   | 6797/10000 [01:20<00:39, 80.81 permutations/s]
Permutation test:  68%|██████▊   | 6807/10000 [01:20<00:38, 82.99 permutations/s]
Permutation test:  68%|██████▊   | 6816/10000 [01:20<00:38, 82.60 permutations/s]
Permutation test:  68%|██████▊   | 6825/10000 [01:20<00:38, 81.49 permutations/s]
Permutation test:  68%|██████▊   | 6836/10000 [01:20<00:36, 87.21 permutations/s]
Permutation test:  68%|██████▊   | 6845/10000 [01:20<00:36, 87.52 permutations/s]
Permutation test:  69%|██████▊   | 6854/10000 [01:21<00:37, 83.71 permutations/s]
Permutation test:  69%|██████▊   | 6863/10000 [01:21<00:36, 85.00 permutations/s]
Permutation test:  69%|██████▊   | 6872/10000 [01:21<00:37, 83.09 permutations/s]
Permutation test:  69%|██████▉   | 6881/10000 [01:21<00:37, 83.57 permutations/s]
Permutation test:  69%|██████▉   | 6890/10000 [01:21<00:38, 80.86 permutations/s]
Permutation test:  69%|██████▉   | 6899/10000 [01:21<00:37, 82.67 permutations/s]
Permutation test:  69%|██████▉   | 6908/10000 [01:21<00:38, 80.91 permutations/s]
Permutation test:  69%|██████▉   | 6917/10000 [01:21<00:37, 82.97 permutations/s]
Permutation test:  69%|██████▉   | 6926/10000 [01:21<00:37, 81.74 permutations/s]
Permutation test:  69%|██████▉   | 6935/10000 [01:22<00:37, 82.65 permutations/s]
Permutation test:  69%|██████▉   | 6944/10000 [01:22<00:37, 81.51 permutations/s]
Permutation test:  70%|██████▉   | 6953/10000 [01:22<00:37, 82.05 permutations/s]
Permutation test:  70%|██████▉   | 6962/10000 [01:22<00:36, 82.89 permutations/s]
Permutation test:  70%|██████▉   | 6971/10000 [01:22<00:36, 83.03 permutations/s]
Permutation test:  70%|██████▉   | 6980/10000 [01:22<00:36, 83.11 permutations/s]
Permutation test:  70%|██████▉   | 6989/10000 [01:22<00:36, 83.18 permutations/s]
Permutation test:  70%|███████   | 7000/10000 [01:22<00:33, 88.28 permutations/s]
Permutation test:  70%|███████   | 7010/10000 [01:22<00:33, 88.13 permutations/s]
Permutation test:  70%|███████   | 7019/10000 [01:23<00:34, 87.41 permutations/s]
Permutation test:  70%|███████   | 7028/10000 [01:23<00:34, 86.68 permutations/s]
Permutation test:  70%|███████   | 7037/10000 [01:23<00:35, 84.24 permutations/s]
Permutation test:  70%|███████   | 7046/10000 [01:23<00:34, 85.41 permutations/s]
Permutation test:  71%|███████   | 7055/10000 [01:23<00:34, 85.14 permutations/s]
Permutation test:  71%|███████   | 7064/10000 [01:23<00:34, 84.88 permutations/s]
Permutation test:  71%|███████   | 7073/10000 [01:23<00:34, 84.72 permutations/s]
Permutation test:  71%|███████   | 7082/10000 [01:23<00:34, 84.29 permutations/s]
Permutation test:  71%|███████   | 7091/10000 [01:23<00:35, 82.58 permutations/s]
Permutation test:  71%|███████   | 7101/10000 [01:24<00:35, 81.95 permutations/s]
Permutation test:  71%|███████   | 7111/10000 [01:24<00:34, 83.30 permutations/s]
Permutation test:  71%|███████   | 7120/10000 [01:24<00:34, 83.73 permutations/s]
Permutation test:  71%|███████▏  | 7129/10000 [01:24<00:35, 81.79 permutations/s]
Permutation test:  71%|███████▏  | 7138/10000 [01:24<00:34, 82.50 permutations/s]
Permutation test:  71%|███████▏  | 7147/10000 [01:24<00:34, 82.76 permutations/s]
Permutation test:  72%|███████▏  | 7156/10000 [01:24<00:34, 82.48 permutations/s]
Permutation test:  72%|███████▏  | 7167/10000 [01:24<00:31, 88.71 permutations/s]
Permutation test:  72%|███████▏  | 7176/10000 [01:24<00:31, 88.81 permutations/s]
Permutation test:  72%|███████▏  | 7185/10000 [01:25<00:31, 88.65 permutations/s]
Permutation test:  72%|███████▏  | 7194/10000 [01:25<00:32, 87.01 permutations/s]
Permutation test:  72%|███████▏  | 7203/10000 [01:25<00:32, 86.15 permutations/s]
Permutation test:  72%|███████▏  | 7212/10000 [01:25<00:32, 85.79 permutations/s]
Permutation test:  72%|███████▏  | 7221/10000 [01:25<00:32, 85.03 permutations/s]
Permutation test:  72%|███████▏  | 7230/10000 [01:25<00:32, 84.52 permutations/s]
Permutation test:  72%|███████▏  | 7239/10000 [01:25<00:32, 84.17 permutations/s]
Permutation test:  72%|███████▏  | 7248/10000 [01:25<00:32, 84.15 permutations/s]
Permutation test:  73%|███████▎  | 7257/10000 [01:25<00:32, 83.44 permutations/s]
Permutation test:  73%|███████▎  | 7266/10000 [01:25<00:33, 82.03 permutations/s]
Permutation test:  73%|███████▎  | 7275/10000 [01:26<00:33, 81.97 permutations/s]
Permutation test:  73%|███████▎  | 7284/10000 [01:26<00:32, 82.82 permutations/s]
Permutation test:  73%|███████▎  | 7293/10000 [01:26<00:32, 83.21 permutations/s]
Permutation test:  73%|███████▎  | 7302/10000 [01:26<00:32, 81.89 permutations/s]
Permutation test:  73%|███████▎  | 7311/10000 [01:26<00:32, 82.77 permutations/s]
Permutation test:  73%|███████▎  | 7320/10000 [01:26<00:33, 79.19 permutations/s]
Permutation test:  73%|███████▎  | 7329/10000 [01:26<00:32, 81.27 permutations/s]
Permutation test:  73%|███████▎  | 7348/10000 [01:26<00:23, 110.63 permutations/s]
Permutation test:  74%|███████▎  | 7367/10000 [01:26<00:20, 130.92 permutations/s]
Permutation test:  74%|███████▍  | 7381/10000 [01:27<00:21, 120.82 permutations/s]
Permutation test:  74%|███████▍  | 7394/10000 [01:27<00:24, 106.64 permutations/s]
Permutation test:  74%|███████▍  | 7406/10000 [01:27<00:26, 99.11 permutations/s]
Permutation test:  74%|███████▍  | 7417/10000 [01:27<00:28, 91.51 permutations/s]
Permutation test:  74%|███████▍  | 7427/10000 [01:27<00:28, 90.54 permutations/s]
Permutation test:  74%|███████▍  | 7437/10000 [01:27<00:29, 88.07 permutations/s]
Permutation test:  74%|███████▍  | 7446/10000 [01:27<00:29, 87.69 permutations/s]
Permutation test:  75%|███████▍  | 7455/10000 [01:28<00:29, 85.14 permutations/s]
Permutation test:  75%|███████▍  | 7464/10000 [01:28<00:30, 83.54 permutations/s]
Permutation test:  75%|███████▍  | 7473/10000 [01:28<00:30, 82.85 permutations/s]
Permutation test:  75%|███████▍  | 7482/10000 [01:28<00:30, 83.82 permutations/s]
Permutation test:  75%|███████▍  | 7491/10000 [01:28<00:30, 81.78 permutations/s]
Permutation test:  75%|███████▌  | 7503/10000 [01:28<00:27, 90.32 permutations/s]
Permutation test:  75%|███████▌  | 7513/10000 [01:28<00:28, 87.59 permutations/s]
Permutation test:  75%|███████▌  | 7524/10000 [01:28<00:26, 93.67 permutations/s]
Permutation test:  75%|███████▌  | 7534/10000 [01:28<00:27, 88.75 permutations/s]
Permutation test:  75%|███████▌  | 7543/10000 [01:29<00:28, 85.84 permutations/s]
Permutation test:  76%|███████▌  | 7552/10000 [01:29<00:28, 85.12 permutations/s]
Permutation test:  76%|███████▌  | 7561/10000 [01:29<00:28, 84.60 permutations/s]
Permutation test:  76%|███████▌  | 7570/10000 [01:29<00:29, 83.31 permutations/s]
Permutation test:  76%|███████▌  | 7579/10000 [01:29<00:29, 81.10 permutations/s]
Permutation test:  76%|███████▌  | 7589/10000 [01:29<00:29, 81.78 permutations/s]
Permutation test:  76%|███████▌  | 7598/10000 [01:29<00:28, 83.84 permutations/s]
Permutation test:  76%|███████▌  | 7607/10000 [01:29<00:29, 82.09 permutations/s]
Permutation test:  76%|███████▌  | 7617/10000 [01:29<00:28, 83.81 permutations/s]
Permutation test:  76%|███████▋  | 7626/10000 [01:30<00:28, 82.36 permutations/s]
Permutation test:  76%|███████▋  | 7635/10000 [01:30<00:28, 82.63 permutations/s]
Permutation test:  76%|███████▋  | 7644/10000 [01:30<00:28, 82.85 permutations/s]
Permutation test:  77%|███████▋  | 7653/10000 [01:30<00:28, 82.07 permutations/s]
Permutation test:  77%|███████▋  | 7662/10000 [01:30<00:27, 83.83 permutations/s]
Permutation test:  77%|███████▋  | 7671/10000 [01:30<00:27, 83.68 permutations/s]
Permutation test:  77%|███████▋  | 7680/10000 [01:30<00:27, 83.57 permutations/s]
Permutation test:  77%|███████▋  | 7689/10000 [01:30<00:27, 84.26 permutations/s]
Permutation test:  77%|███████▋  | 7700/10000 [01:30<00:26, 88.23 permutations/s]
Permutation test:  77%|███████▋  | 7710/10000 [01:31<00:25, 88.36 permutations/s]
Permutation test:  77%|███████▋  | 7719/10000 [01:31<00:26, 85.44 permutations/s]
Permutation test:  77%|███████▋  | 7728/10000 [01:31<00:26, 84.85 permutations/s]
Permutation test:  77%|███████▋  | 7737/10000 [01:31<00:26, 84.41 permutations/s]
Permutation test:  77%|███████▋  | 7746/10000 [01:31<00:26, 84.54 permutations/s]
Permutation test:  78%|███████▊  | 7755/10000 [01:31<00:26, 84.18 permutations/s]
Permutation test:  78%|███████▊  | 7764/10000 [01:31<00:26, 84.41 permutations/s]
Permutation test:  78%|███████▊  | 7773/10000 [01:31<00:26, 83.61 permutations/s]
Permutation test:  78%|███████▊  | 7782/10000 [01:31<00:26, 83.54 permutations/s]
Permutation test:  78%|███████▊  | 7791/10000 [01:31<00:26, 83.46 permutations/s]
Permutation test:  78%|███████▊  | 7800/10000 [01:32<00:26, 82.96 permutations/s]
Permutation test:  78%|███████▊  | 7809/10000 [01:32<00:26, 82.15 permutations/s]
Permutation test:  78%|███████▊  | 7818/10000 [01:32<00:26, 82.51 permutations/s]
Permutation test:  78%|███████▊  | 7827/10000 [01:32<00:26, 81.37 permutations/s]
Permutation test:  78%|███████▊  | 7837/10000 [01:32<00:26, 82.44 permutations/s]
Permutation test:  78%|███████▊  | 7846/10000 [01:32<00:25, 83.97 permutations/s]
Permutation test:  79%|███████▊  | 7855/10000 [01:32<00:26, 81.67 permutations/s]
Permutation test:  79%|███████▊  | 7865/10000 [01:32<00:24, 86.22 permutations/s]
Permutation test:  79%|███████▉  | 7875/10000 [01:32<00:24, 87.67 permutations/s]
Permutation test:  79%|███████▉  | 7888/10000 [01:33<00:21, 96.36 permutations/s]
Permutation test:  79%|███████▉  | 7898/10000 [01:33<00:22, 93.21 permutations/s]
Permutation test:  79%|███████▉  | 7908/10000 [01:33<00:23, 88.57 permutations/s]
Permutation test:  79%|███████▉  | 7917/10000 [01:33<00:23, 88.35 permutations/s]
Permutation test:  79%|███████▉  | 7926/10000 [01:33<00:23, 86.89 permutations/s]
Permutation test:  79%|███████▉  | 7935/10000 [01:33<00:24, 84.45 permutations/s]
Permutation test:  79%|███████▉  | 7945/10000 [01:33<00:24, 85.00 permutations/s]
Permutation test:  80%|███████▉  | 7954/10000 [01:33<00:23, 85.91 permutations/s]
Permutation test:  80%|███████▉  | 7963/10000 [01:33<00:24, 84.68 permutations/s]
Permutation test:  80%|███████▉  | 7972/10000 [01:34<00:24, 84.29 permutations/s]
Permutation test:  80%|███████▉  | 7981/10000 [01:34<00:24, 83.07 permutations/s]
Permutation test:  80%|███████▉  | 7990/10000 [01:34<00:24, 83.15 permutations/s]
Permutation test:  80%|███████▉  | 7999/10000 [01:34<00:23, 85.04 permutations/s]
Permutation test:  80%|████████  | 8008/10000 [01:34<00:23, 84.10 permutations/s]
Permutation test:  80%|████████  | 8017/10000 [01:34<00:24, 82.48 permutations/s]
Permutation test:  80%|████████  | 8026/10000 [01:34<00:23, 83.66 permutations/s]
Permutation test:  80%|████████  | 8037/10000 [01:34<00:21, 89.37 permutations/s]
Permutation test:  80%|████████  | 8047/10000 [01:34<00:21, 91.86 permutations/s]
Permutation test:  81%|████████  | 8059/10000 [01:35<00:20, 94.93 permutations/s]
Permutation test:  81%|████████  | 8069/10000 [01:35<00:21, 91.11 permutations/s]
Permutation test:  81%|████████  | 8079/10000 [01:35<00:21, 88.67 permutations/s]
Permutation test:  81%|████████  | 8088/10000 [01:35<00:21, 87.58 permutations/s]
Permutation test:  81%|████████  | 8097/10000 [01:35<00:22, 84.00 permutations/s]
Permutation test:  81%|████████  | 8107/10000 [01:35<00:22, 83.85 permutations/s]
Permutation test:  81%|████████  | 8116/10000 [01:35<00:22, 82.43 permutations/s]
Permutation test:  81%|████████▏ | 8125/10000 [01:35<00:22, 82.25 permutations/s]
Permutation test:  81%|████████▏ | 8134/10000 [01:35<00:23, 80.83 permutations/s]
Permutation test:  81%|████████▏ | 8144/10000 [01:36<00:22, 83.13 permutations/s]
Permutation test:  82%|████████▏ | 8153/10000 [01:36<00:22, 83.83 permutations/s]
Permutation test:  82%|████████▏ | 8162/10000 [01:36<00:22, 81.05 permutations/s]
Permutation test:  82%|████████▏ | 8172/10000 [01:36<00:22, 82.16 permutations/s]
Permutation test:  82%|████████▏ | 8182/10000 [01:36<00:21, 82.98 permutations/s]
Permutation test:  82%|████████▏ | 8191/10000 [01:36<00:21, 83.54 permutations/s]
Permutation test:  82%|████████▏ | 8200/10000 [01:36<00:21, 83.00 permutations/s]
Permutation test:  82%|████████▏ | 8210/10000 [01:36<00:20, 86.28 permutations/s]
Permutation test:  82%|████████▏ | 8219/10000 [01:36<00:20, 85.88 permutations/s]
Permutation test:  82%|████████▏ | 8228/10000 [01:37<00:20, 86.08 permutations/s]
Permutation test:  82%|████████▏ | 8237/10000 [01:37<00:20, 85.73 permutations/s]
Permutation test:  82%|████████▏ | 8246/10000 [01:37<00:20, 85.00 permutations/s]
Permutation test:  83%|████████▎ | 8255/10000 [01:37<00:21, 82.65 permutations/s]
Permutation test:  83%|████████▎ | 8265/10000 [01:37<00:20, 84.68 permutations/s]
Permutation test:  83%|████████▎ | 8274/10000 [01:37<00:20, 82.86 permutations/s]
Permutation test:  83%|████████▎ | 8283/10000 [01:37<00:20, 82.60 permutations/s]
Permutation test:  83%|████████▎ | 8292/10000 [01:37<00:20, 83.24 permutations/s]
Permutation test:  83%|████████▎ | 8301/10000 [01:37<00:20, 84.23 permutations/s]
Permutation test:  83%|████████▎ | 8310/10000 [01:38<00:20, 84.44 permutations/s]
Permutation test:  83%|████████▎ | 8319/10000 [01:38<00:20, 83.64 permutations/s]
Permutation test:  83%|████████▎ | 8328/10000 [01:38<00:20, 82.60 permutations/s]
Permutation test:  83%|████████▎ | 8337/10000 [01:38<00:20, 82.86 permutations/s]
Permutation test:  83%|████████▎ | 8346/10000 [01:38<00:20, 80.32 permutations/s]
Permutation test:  84%|████████▎ | 8355/10000 [01:38<00:20, 79.44 permutations/s]
Permutation test:  84%|████████▎ | 8365/10000 [01:38<00:20, 81.08 permutations/s]
Permutation test:  84%|████████▍ | 8375/10000 [01:38<00:19, 84.43 permutations/s]
Permutation test:  84%|████████▍ | 8385/10000 [01:38<00:19, 84.75 permutations/s]
Permutation test:  84%|████████▍ | 8394/10000 [01:39<00:19, 83.90 permutations/s]
Permutation test:  84%|████████▍ | 8403/10000 [01:39<00:19, 83.95 permutations/s]
Permutation test:  84%|████████▍ | 8412/10000 [01:39<00:19, 80.89 permutations/s]
Permutation test:  84%|████████▍ | 8422/10000 [01:39<00:19, 81.50 permutations/s]
Permutation test:  84%|████████▍ | 8432/10000 [01:39<00:18, 83.53 permutations/s]
Permutation test:  84%|████████▍ | 8441/10000 [01:39<00:18, 83.46 permutations/s]
Permutation test:  84%|████████▍ | 8450/10000 [01:39<00:18, 83.43 permutations/s]
Permutation test:  85%|████████▍ | 8459/10000 [01:39<00:18, 83.84 permutations/s]
Permutation test:  85%|████████▍ | 8468/10000 [01:39<00:18, 83.70 permutations/s]
Permutation test:  85%|████████▍ | 8477/10000 [01:40<00:18, 82.02 permutations/s]
Permutation test:  85%|████████▍ | 8486/10000 [01:40<00:18, 80.63 permutations/s]
Permutation test:  85%|████████▍ | 8495/10000 [01:40<00:18, 80.99 permutations/s]
Permutation test:  85%|████████▌ | 8504/10000 [01:40<00:18, 82.01 permutations/s]
Permutation test:  85%|████████▌ | 8513/10000 [01:40<00:18, 82.06 permutations/s]
Permutation test:  85%|████████▌ | 8522/10000 [01:40<00:18, 81.97 permutations/s]
Permutation test:  85%|████████▌ | 8531/10000 [01:40<00:17, 82.62 permutations/s]
Permutation test:  85%|████████▌ | 8542/10000 [01:40<00:16, 89.83 permutations/s]
Permutation test:  86%|████████▌ | 8552/10000 [01:40<00:16, 90.17 permutations/s]
Permutation test:  86%|████████▌ | 8562/10000 [01:41<00:16, 87.50 permutations/s]
Permutation test:  86%|████████▌ | 8571/10000 [01:41<00:16, 86.28 permutations/s]
Permutation test:  86%|████████▌ | 8580/10000 [01:41<00:16, 85.40 permutations/s]
Permutation test:  86%|████████▌ | 8589/10000 [01:41<00:16, 84.79 permutations/s]
Permutation test:  86%|████████▌ | 8598/10000 [01:41<00:16, 82.54 permutations/s]
Permutation test:  86%|████████▌ | 8607/10000 [01:41<00:16, 84.17 permutations/s]
Permutation test:  86%|████████▌ | 8616/10000 [01:41<00:16, 84.13 permutations/s]
Permutation test:  86%|████████▋ | 8625/10000 [01:41<00:16, 82.95 permutations/s]
Permutation test:  86%|████████▋ | 8634/10000 [01:41<00:16, 82.40 permutations/s]
Permutation test:  86%|████████▋ | 8644/10000 [01:42<00:16, 84.04 permutations/s]
Permutation test:  87%|████████▋ | 8653/10000 [01:42<00:16, 82.48 permutations/s]
Permutation test:  87%|████████▋ | 8662/10000 [01:42<00:16, 82.72 permutations/s]
Permutation test:  87%|████████▋ | 8671/10000 [01:42<00:15, 83.10 permutations/s]
Permutation test:  87%|████████▋ | 8680/10000 [01:42<00:15, 83.19 permutations/s]
Permutation test:  87%|████████▋ | 8689/10000 [01:42<00:15, 82.80 permutations/s]
Permutation test:  87%|████████▋ | 8699/10000 [01:42<00:15, 86.42 permutations/s]
Permutation test:  87%|████████▋ | 8709/10000 [01:42<00:14, 90.02 permutations/s]
Permutation test:  87%|████████▋ | 8719/10000 [01:42<00:14, 86.89 permutations/s]
Permutation test:  87%|████████▋ | 8728/10000 [01:43<00:14, 85.92 permutations/s]
Permutation test:  87%|████████▋ | 8737/10000 [01:43<00:15, 83.02 permutations/s]
Permutation test:  87%|████████▋ | 8746/10000 [01:43<00:15, 81.37 permutations/s]
Permutation test:  88%|████████▊ | 8755/10000 [01:43<00:15, 81.50 permutations/s]
Permutation test:  88%|████████▊ | 8764/10000 [01:43<00:15, 82.04 permutations/s]
Permutation test:  88%|████████▊ | 8773/10000 [01:43<00:15, 81.55 permutations/s]
Permutation test:  88%|████████▊ | 8782/10000 [01:43<00:14, 81.58 permutations/s]
Permutation test:  88%|████████▊ | 8791/10000 [01:43<00:14, 80.80 permutations/s]
Permutation test:  88%|████████▊ | 8800/10000 [01:43<00:14, 82.43 permutations/s]
Permutation test:  88%|████████▊ | 8809/10000 [01:44<00:15, 78.97 permutations/s]
Permutation test:  88%|████████▊ | 8818/10000 [01:44<00:14, 81.79 permutations/s]
Permutation test:  88%|████████▊ | 8827/10000 [01:44<00:14, 81.59 permutations/s]
Permutation test:  88%|████████▊ | 8836/10000 [01:44<00:14, 82.33 permutations/s]
Permutation test:  88%|████████▊ | 8845/10000 [01:44<00:13, 83.09 permutations/s]
Permutation test:  89%|████████▊ | 8854/10000 [01:44<00:13, 82.23 permutations/s]
Permutation test:  89%|████████▊ | 8863/10000 [01:44<00:13, 81.24 permutations/s]
Permutation test:  89%|████████▊ | 8874/10000 [01:44<00:13, 85.86 permutations/s]
Permutation test:  89%|████████▉ | 8884/10000 [01:44<00:12, 86.24 permutations/s]
Permutation test:  89%|████████▉ | 8893/10000 [01:45<00:12, 85.85 permutations/s]
Permutation test:  89%|████████▉ | 8902/10000 [01:45<00:13, 83.74 permutations/s]
Permutation test:  89%|████████▉ | 8911/10000 [01:45<00:12, 84.54 permutations/s]
Permutation test:  89%|████████▉ | 8920/10000 [01:45<00:12, 84.19 permutations/s]
Permutation test:  89%|████████▉ | 8929/10000 [01:45<00:12, 83.89 permutations/s]
Permutation test:  89%|████████▉ | 8938/10000 [01:45<00:13, 81.51 permutations/s]
Permutation test:  89%|████████▉ | 8947/10000 [01:45<00:12, 82.49 permutations/s]
Permutation test:  90%|████████▉ | 8956/10000 [01:45<00:12, 83.17 permutations/s]
Permutation test:  90%|████████▉ | 8965/10000 [01:45<00:12, 83.23 permutations/s]
Permutation test:  90%|████████▉ | 8974/10000 [01:46<00:12, 84.21 permutations/s]
Permutation test:  90%|████████▉ | 8983/10000 [01:46<00:12, 84.42 permutations/s]
Permutation test:  90%|████████▉ | 8992/10000 [01:46<00:12, 82.24 permutations/s]
Permutation test:  90%|█████████ | 9002/10000 [01:46<00:11, 83.71 permutations/s]
Permutation test:  90%|█████████ | 9011/10000 [01:46<00:12, 82.25 permutations/s]
Permutation test:  90%|█████████ | 9020/10000 [01:46<00:11, 82.58 permutations/s]
Permutation test:  90%|█████████ | 9029/10000 [01:46<00:11, 82.81 permutations/s]
Permutation test:  90%|█████████ | 9039/10000 [01:46<00:10, 87.50 permutations/s]
Permutation test:  90%|█████████ | 9050/10000 [01:46<00:10, 91.19 permutations/s]
Permutation test:  91%|█████████ | 9060/10000 [01:47<00:10, 89.14 permutations/s]
Permutation test:  91%|█████████ | 9069/10000 [01:47<00:10, 84.65 permutations/s]
Permutation test:  91%|█████████ | 9078/10000 [01:47<00:10, 84.52 permutations/s]
Permutation test:  91%|█████████ | 9087/10000 [01:47<00:10, 85.57 permutations/s]
Permutation test:  91%|█████████ | 9096/10000 [01:47<00:10, 85.36 permutations/s]
Permutation test:  91%|█████████ | 9105/10000 [01:47<00:10, 84.76 permutations/s]
Permutation test:  91%|█████████ | 9114/10000 [01:47<00:10, 84.32 permutations/s]
Permutation test:  91%|█████████ | 9123/10000 [01:47<00:10, 82.30 permutations/s]
Permutation test:  91%|█████████▏| 9132/10000 [01:47<00:10, 84.11 permutations/s]
Permutation test:  91%|█████████▏| 9141/10000 [01:48<00:10, 82.49 permutations/s]
Permutation test:  92%|█████████▏| 9150/10000 [01:48<00:10, 82.75 permutations/s]
Permutation test:  92%|█████████▏| 9159/10000 [01:48<00:10, 80.25 permutations/s]
Permutation test:  92%|█████████▏| 9168/10000 [01:48<00:10, 82.22 permutations/s]
Permutation test:  92%|█████████▏| 9177/10000 [01:48<00:10, 81.25 permutations/s]
Permutation test:  92%|█████████▏| 9186/10000 [01:48<00:09, 83.24 permutations/s]
Permutation test:  92%|█████████▏| 9195/10000 [01:48<00:09, 81.90 permutations/s]
Permutation test:  92%|█████████▏| 9204/10000 [01:48<00:09, 82.55 permutations/s]
Permutation test:  92%|█████████▏| 9214/10000 [01:48<00:09, 85.57 permutations/s]
Permutation test:  92%|█████████▏| 9223/10000 [01:49<00:09, 83.04 permutations/s]
Permutation test:  92%|█████████▏| 9232/10000 [01:49<00:09, 82.68 permutations/s]
Permutation test:  92%|█████████▏| 9241/10000 [01:49<00:09, 83.28 permutations/s]
Permutation test:  92%|█████████▎| 9250/10000 [01:49<00:09, 81.55 permutations/s]
Permutation test:  93%|█████████▎| 9259/10000 [01:49<00:09, 81.63 permutations/s]
Permutation test:  93%|█████████▎| 9268/10000 [01:49<00:08, 81.91 permutations/s]
Permutation test:  93%|█████████▎| 9277/10000 [01:49<00:08, 81.44 permutations/s]
Permutation test:  93%|█████████▎| 9287/10000 [01:49<00:08, 84.28 permutations/s]
Permutation test:  93%|█████████▎| 9296/10000 [01:49<00:08, 83.54 permutations/s]
Permutation test:  93%|█████████▎| 9305/10000 [01:50<00:08, 83.33 permutations/s]
Permutation test:  93%|█████████▎| 9314/10000 [01:50<00:08, 83.49 permutations/s]
Permutation test:  93%|█████████▎| 9323/10000 [01:50<00:08, 82.51 permutations/s]
Permutation test:  93%|█████████▎| 9332/10000 [01:50<00:08, 80.78 permutations/s]
Permutation test:  93%|█████████▎| 9341/10000 [01:50<00:08, 80.64 permutations/s]
Permutation test:  94%|█████████▎| 9350/10000 [01:50<00:08, 80.55 permutations/s]
Permutation test:  94%|█████████▎| 9360/10000 [01:50<00:07, 81.84 permutations/s]
Permutation test:  94%|█████████▎| 9370/10000 [01:50<00:07, 84.50 permutations/s]
Permutation test:  94%|█████████▍| 9384/10000 [01:50<00:06, 98.73 permutations/s]
Permutation test:  94%|█████████▍| 9394/10000 [01:51<00:06, 92.34 permutations/s]
Permutation test:  94%|█████████▍| 9404/10000 [01:51<00:06, 91.45 permutations/s]
Permutation test:  94%|█████████▍| 9414/10000 [01:51<00:06, 87.09 permutations/s]
Permutation test:  94%|█████████▍| 9423/10000 [01:51<00:06, 86.44 permutations/s]
Permutation test:  94%|█████████▍| 9432/10000 [01:51<00:06, 86.53 permutations/s]
Permutation test:  94%|█████████▍| 9441/10000 [01:51<00:06, 82.25 permutations/s]
Permutation test:  94%|█████████▍| 9450/10000 [01:51<00:06, 82.58 permutations/s]
Permutation test:  95%|█████████▍| 9459/10000 [01:51<00:06, 81.90 permutations/s]
Permutation test:  95%|█████████▍| 9468/10000 [01:51<00:06, 81.89 permutations/s]
Permutation test:  95%|█████████▍| 9477/10000 [01:52<00:06, 81.38 permutations/s]
Permutation test:  95%|█████████▍| 9486/10000 [01:52<00:06, 81.98 permutations/s]
Permutation test:  95%|█████████▍| 9495/10000 [01:52<00:06, 80.17 permutations/s]
Permutation test:  95%|█████████▌| 9504/10000 [01:52<00:06, 82.43 permutations/s]
Permutation test:  95%|█████████▌| 9513/10000 [01:52<00:06, 79.84 permutations/s]
Permutation test:  95%|█████████▌| 9523/10000 [01:52<00:05, 83.13 permutations/s]
Permutation test:  95%|█████████▌| 9532/10000 [01:52<00:05, 82.25 permutations/s]
Permutation test:  95%|█████████▌| 9542/10000 [01:52<00:05, 85.45 permutations/s]
Permutation test:  96%|█████████▌| 9551/10000 [01:52<00:05, 83.78 permutations/s]
Permutation test:  96%|█████████▌| 9560/10000 [01:53<00:05, 82.52 permutations/s]
Permutation test:  96%|█████████▌| 9569/10000 [01:53<00:05, 82.72 permutations/s]
Permutation test:  96%|█████████▌| 9578/10000 [01:53<00:05, 83.94 permutations/s]
Permutation test:  96%|█████████▌| 9587/10000 [01:53<00:04, 82.99 permutations/s]
Permutation test:  96%|█████████▌| 9596/10000 [01:53<00:04, 83.55 permutations/s]
Permutation test:  96%|█████████▌| 9605/10000 [01:53<00:04, 82.54 permutations/s]
Permutation test:  96%|█████████▌| 9614/10000 [01:53<00:04, 83.75 permutations/s]
Permutation test:  96%|█████████▌| 9623/10000 [01:53<00:04, 84.08 permutations/s]
Permutation test:  96%|█████████▋| 9632/10000 [01:53<00:04, 83.86 permutations/s]
Permutation test:  96%|█████████▋| 9641/10000 [01:54<00:04, 83.22 permutations/s]
Permutation test:  96%|█████████▋| 9650/10000 [01:54<00:04, 82.81 permutations/s]
Permutation test:  97%|█████████▋| 9659/10000 [01:54<00:04, 83.42 permutations/s]
Permutation test:  97%|█████████▋| 9668/10000 [01:54<00:04, 82.47 permutations/s]
Permutation test:  97%|█████████▋| 9677/10000 [01:54<00:03, 81.83 permutations/s]
Permutation test:  97%|█████████▋| 9686/10000 [01:54<00:03, 83.18 permutations/s]
Permutation test:  97%|█████████▋| 9695/10000 [01:54<00:03, 82.15 permutations/s]
Permutation test:  97%|█████████▋| 9704/10000 [01:54<00:03, 82.44 permutations/s]
Permutation test:  97%|█████████▋| 9714/10000 [01:54<00:03, 86.67 permutations/s]
Permutation test:  97%|█████████▋| 9723/10000 [01:54<00:03, 86.15 permutations/s]
Permutation test:  97%|█████████▋| 9732/10000 [01:55<00:03, 84.35 permutations/s]
Permutation test:  97%|█████████▋| 9741/10000 [01:55<00:03, 82.64 permutations/s]
Permutation test:  98%|█████████▊| 9750/10000 [01:55<00:02, 84.27 permutations/s]
Permutation test:  98%|█████████▊| 9759/10000 [01:55<00:02, 83.02 permutations/s]
Permutation test:  98%|█████████▊| 9768/10000 [01:55<00:02, 82.89 permutations/s]
Permutation test:  98%|█████████▊| 9777/10000 [01:55<00:02, 83.50 permutations/s]
Permutation test:  98%|█████████▊| 9786/10000 [01:55<00:02, 79.91 permutations/s]
Permutation test:  98%|█████████▊| 9796/10000 [01:55<00:02, 83.16 permutations/s]
Permutation test:  98%|█████████▊| 9806/10000 [01:55<00:02, 87.64 permutations/s]
Permutation test:  98%|█████████▊| 9816/10000 [01:56<00:02, 90.29 permutations/s]
Permutation test:  98%|█████████▊| 9826/10000 [01:56<00:01, 88.54 permutations/s]
Permutation test:  98%|█████████▊| 9835/10000 [01:56<00:01, 85.57 permutations/s]
Permutation test:  98%|█████████▊| 9846/10000 [01:56<00:01, 91.34 permutations/s]
Permutation test:  99%|█████████▊| 9857/10000 [01:56<00:01, 95.79 permutations/s]
Permutation test:  99%|█████████▊| 9867/10000 [01:56<00:01, 95.10 permutations/s]
Permutation test:  99%|█████████▉| 9877/10000 [01:56<00:01, 93.30 permutations/s]
Permutation test:  99%|█████████▉| 9891/10000 [01:56<00:01, 105.96 permutations/s]
Permutation test:  99%|█████████▉| 9902/10000 [01:56<00:00, 99.38 permutations/s]
Permutation test:  99%|█████████▉| 9913/10000 [01:57<00:00, 94.49 permutations/s]
Permutation test:  99%|█████████▉| 9923/10000 [01:57<00:00, 89.75 permutations/s]
Permutation test:  99%|█████████▉| 9933/10000 [01:57<00:00, 85.69 permutations/s]
Permutation test:  99%|█████████▉| 9942/10000 [01:57<00:00, 83.35 permutations/s]
Permutation test: 100%|█████████▉| 9952/10000 [01:57<00:00, 84.63 permutations/s]
Permutation test: 100%|█████████▉| 9961/10000 [01:57<00:00, 83.38 permutations/s]
Permutation test: 100%|█████████▉| 9970/10000 [01:57<00:00, 82.94 permutations/s]
Permutation test: 100%|█████████▉| 9979/10000 [01:57<00:00, 81.74 permutations/s]
Permutation test: 100%|█████████▉| 9988/10000 [01:58<00:00, 82.63 permutations/s]
Permutation test: 100%|█████████▉| 9997/10000 [01:58<00:00, 84.22 permutations/s]
Permutation test: 100%|██████████| 10000/10000 [01:58<00:00, 84.62 permutations/s]

A quick plot suggests an early effect related to n_chars around 130 ms, and a later effect of cloze around 400 ms:

p = plot.TopoButterfly(lm, t=0.130, axh=2, w=6)
sensor lm

Detailed plots of the two effects show that the cluster is quite variable due to noise in the data.

p = plot.TopoArray(lm.masked_parameter_map('n_chars'), t=[0.110, 0.130, 0.150], title='N Chars')
p = plot.TopoArray(lm.masked_parameter_map('cloze'), t=[0.380, 0.400, 0.420], title='Cloze')
  • N Chars
  • Cloze

To access some of the test results we need to know the index of different effects:

('intercept', 'n_chars', 'cloze')

Create a plot that shows the spatial cluster extent across time.

EFFECTS = [
    ('n_chars', (0.110, 0.150)),
    ('cloze', (0.380, 0.420)),
]

t_maps = []
for effect, time in EFFECTS:
    # t-maps are retrieved by effect name
    t = lm.t(effect).mean(time=time)
    # p-maps are stored in a list, so we need to know the index of te effect
    index = lm.effects.index(effect)
    # We are interested in the maximal spatial cluster extent, i.e., any sensor that is part of the cluster at any time
    p = lm.p[index].min(time=time)
    # Create a masked average t map
    t_av = t.mask(p > 0.05)
    t_maps.append(t_av)

p = plot.Topomap(t_maps, columns=2)
n_chars, cloze

Total running time of the script: (2 minutes 3.896 seconds)

Gallery generated by Sphinx-Gallery