Multiple regression

Multiple regression designs apply to at least two scenarios.

  • Analyzing a single subject’s data when trials are associated with one or multiple continuous variables.

  • Analyzing group data when subjects are associated with one or multiple individual difference variables.

Here the analysis is illustrated for a simulated dataset from a single subject. Group analysis works analogously, except that each case in the datatset would represent a different subject rather than a different trial.

For such group analysis, it is necessary to reduce each subject’s data to a single case first because multiple regression assumes a fixed effects model. Such designs are described under Two-stage test.

Simulated data

# sphinx_gallery_thumbnail_number = 2
from eelbrain import *


data = datasets.simulate_erp(snr=0.5)
data.head()
# cloze predictability n_chars
0 0.026139 low 4
1 0.99529 high 5
2 0.93062 high 3
3 0.82404 high 7
4 0.17041 low 4
5 0.18508 low 4
6 0.23345 low 4
7 0.80784 high 3
8 0.24979 low 7
9 0.26753 low 4
NDVars: eeg


The data represents 80 trials from a simulated word reading paradigm, where each word is associated with a word length (n_chars) and predictability (cloze).

p = plot.Scatter('cloze', 'n_chars', data=data, h=3)
sensor lm

Plot the average of each level on n_chars to illustrate the linear increase of the response around 130 ms with n_char.

p = plot.TopoButterfly('eeg', 'n_chars', data=data, t=.130, axh=2, w=6)
sensor lm

Multiple regression

Fit a multiple regression model. Estimate $p$-values using a cluster-based permuatation test, using a cluster-forming threshold of uncorrected $p$=.05 and 10,000 permutations (the default).

lm = testnd.LM('eeg', 'n_chars + cloze', data=data, tstart=0.050, tstop=0.500, pmin=0.05)
Permutation test:   0%|          | 0/10000 [00:00<?, ? permutations/s]
Permutation test:   0%|          | 8/10000 [00:00<02:10, 76.84 permutations/s]
Permutation test:   0%|          | 18/10000 [00:00<01:52, 88.84 permutations/s]
Permutation test:   0%|          | 27/10000 [00:00<02:27, 67.52 permutations/s]
Permutation test:   0%|          | 35/10000 [00:00<02:21, 70.23 permutations/s]
Permutation test:   0%|          | 45/10000 [00:00<02:16, 72.69 permutations/s]
Permutation test:   1%|          | 59/10000 [00:00<01:47, 92.20 permutations/s]
Permutation test:   1%|          | 72/10000 [00:00<01:36, 103.00 permutations/s]
Permutation test:   1%|          | 83/10000 [00:00<01:44, 95.08 permutations/s]
Permutation test:   1%|          | 93/10000 [00:01<01:48, 91.55 permutations/s]
Permutation test:   1%|          | 103/10000 [00:01<01:52, 87.87 permutations/s]
Permutation test:   1%|          | 112/10000 [00:01<01:53, 87.36 permutations/s]
Permutation test:   1%|          | 121/10000 [00:01<01:58, 83.60 permutations/s]
Permutation test:   1%|▏         | 130/10000 [00:01<02:03, 80.18 permutations/s]
Permutation test:   1%|▏         | 140/10000 [00:01<02:01, 81.34 permutations/s]
Permutation test:   1%|▏         | 149/10000 [00:01<02:01, 80.84 permutations/s]
Permutation test:   2%|▏         | 158/10000 [00:01<02:03, 79.87 permutations/s]
Permutation test:   2%|▏         | 167/10000 [00:02<02:18, 70.80 permutations/s]
Permutation test:   2%|▏         | 176/10000 [00:02<02:10, 75.33 permutations/s]
Permutation test:   2%|▏         | 185/10000 [00:02<02:04, 79.13 permutations/s]
Permutation test:   2%|▏         | 194/10000 [00:02<02:01, 80.53 permutations/s]
Permutation test:   2%|▏         | 204/10000 [00:02<02:03, 79.61 permutations/s]
Permutation test:   2%|▏         | 215/10000 [00:02<01:55, 84.71 permutations/s]
Permutation test:   2%|▏         | 224/10000 [00:02<01:56, 84.18 permutations/s]
Permutation test:   2%|▏         | 234/10000 [00:02<01:53, 86.17 permutations/s]
Permutation test:   2%|▏         | 246/10000 [00:02<01:44, 92.97 permutations/s]
Permutation test:   3%|▎         | 256/10000 [00:03<01:50, 88.26 permutations/s]
Permutation test:   3%|▎         | 265/10000 [00:03<01:51, 87.31 permutations/s]
Permutation test:   3%|▎         | 274/10000 [00:03<02:02, 79.39 permutations/s]
Permutation test:   3%|▎         | 286/10000 [00:03<01:49, 88.58 permutations/s]
Permutation test:   3%|▎         | 296/10000 [00:03<02:04, 77.67 permutations/s]
Permutation test:   3%|▎         | 305/10000 [00:03<02:03, 78.31 permutations/s]
Permutation test:   3%|▎         | 314/10000 [00:03<02:17, 70.38 permutations/s]
Permutation test:   3%|▎         | 323/10000 [00:03<02:09, 74.44 permutations/s]
Permutation test:   3%|▎         | 331/10000 [00:04<02:08, 75.24 permutations/s]
Permutation test:   3%|▎         | 339/10000 [00:04<02:22, 67.91 permutations/s]
Permutation test:   4%|▎         | 350/10000 [00:04<02:06, 76.04 permutations/s]
Permutation test:   4%|▎         | 361/10000 [00:04<01:56, 83.01 permutations/s]
Permutation test:   4%|▎         | 370/10000 [00:04<01:57, 81.61 permutations/s]
Permutation test:   4%|▍         | 380/10000 [00:04<01:54, 83.70 permutations/s]
Permutation test:   4%|▍         | 389/10000 [00:04<01:54, 84.07 permutations/s]
Permutation test:   4%|▍         | 398/10000 [00:04<01:55, 83.26 permutations/s]
Permutation test:   4%|▍         | 407/10000 [00:04<01:59, 80.06 permutations/s]
Permutation test:   4%|▍         | 416/10000 [00:05<02:08, 74.70 permutations/s]
Permutation test:   4%|▍         | 426/10000 [00:05<01:59, 80.35 permutations/s]
Permutation test:   4%|▍         | 438/10000 [00:05<01:54, 83.85 permutations/s]
Permutation test:   4%|▍         | 447/10000 [00:05<01:59, 80.23 permutations/s]
Permutation test:   5%|▍         | 456/10000 [00:05<01:56, 81.85 permutations/s]
Permutation test:   5%|▍         | 468/10000 [00:05<01:45, 90.18 permutations/s]
Permutation test:   5%|▍         | 478/10000 [00:05<01:54, 83.14 permutations/s]
Permutation test:   5%|▍         | 487/10000 [00:05<01:55, 82.12 permutations/s]
Permutation test:   5%|▍         | 496/10000 [00:06<01:58, 80.02 permutations/s]
Permutation test:   5%|▌         | 505/10000 [00:06<01:54, 82.64 permutations/s]
Permutation test:   5%|▌         | 514/10000 [00:06<02:00, 78.74 permutations/s]
Permutation test:   5%|▌         | 524/10000 [00:06<01:54, 82.57 permutations/s]
Permutation test:   5%|▌         | 536/10000 [00:06<01:45, 89.93 permutations/s]
Permutation test:   5%|▌         | 546/10000 [00:06<01:53, 83.61 permutations/s]
Permutation test:   6%|▌         | 557/10000 [00:06<01:44, 90.24 permutations/s]
Permutation test:   6%|▌         | 567/10000 [00:06<01:49, 86.27 permutations/s]
Permutation test:   6%|▌         | 576/10000 [00:07<01:53, 82.95 permutations/s]
Permutation test:   6%|▌         | 585/10000 [00:07<02:00, 78.38 permutations/s]
Permutation test:   6%|▌         | 598/10000 [00:07<01:44, 89.60 permutations/s]
Permutation test:   6%|▌         | 608/10000 [00:07<01:47, 87.73 permutations/s]
Permutation test:   6%|▌         | 617/10000 [00:07<02:00, 77.84 permutations/s]
Permutation test:   6%|▋         | 626/10000 [00:07<01:57, 80.02 permutations/s]
Permutation test:   6%|▋         | 635/10000 [00:07<01:58, 79.31 permutations/s]
Permutation test:   6%|▋         | 646/10000 [00:07<01:48, 86.56 permutations/s]
Permutation test:   7%|▋         | 655/10000 [00:07<01:56, 80.50 permutations/s]
Permutation test:   7%|▋         | 667/10000 [00:08<01:47, 87.21 permutations/s]
Permutation test:   7%|▋         | 680/10000 [00:08<01:36, 96.24 permutations/s]
Permutation test:   7%|▋         | 690/10000 [00:08<01:50, 84.56 permutations/s]
Permutation test:   7%|▋         | 702/10000 [00:08<01:40, 92.40 permutations/s]
Permutation test:   7%|▋         | 716/10000 [00:08<01:29, 103.86 permutations/s]
Permutation test:   7%|▋         | 727/10000 [00:08<01:41, 91.64 permutations/s]
Permutation test:   7%|▋         | 737/10000 [00:08<01:46, 86.95 permutations/s]
Permutation test:   7%|▋         | 747/10000 [00:08<01:45, 87.59 permutations/s]
Permutation test:   8%|▊         | 757/10000 [00:09<01:59, 77.26 permutations/s]
Permutation test:   8%|▊         | 771/10000 [00:09<01:41, 90.58 permutations/s]
Permutation test:   8%|▊         | 781/10000 [00:09<01:45, 87.57 permutations/s]
Permutation test:   8%|▊         | 791/10000 [00:09<01:51, 82.24 permutations/s]
Permutation test:   8%|▊         | 800/10000 [00:09<01:57, 78.63 permutations/s]
Permutation test:   8%|▊         | 809/10000 [00:09<02:00, 76.24 permutations/s]
Permutation test:   8%|▊         | 817/10000 [00:09<02:09, 70.70 permutations/s]
Permutation test:   8%|▊         | 825/10000 [00:10<02:15, 67.96 permutations/s]
Permutation test:   8%|▊         | 832/10000 [00:10<02:15, 67.75 permutations/s]
Permutation test:   8%|▊         | 840/10000 [00:10<02:18, 66.15 permutations/s]
Permutation test:   9%|▊         | 851/10000 [00:10<01:59, 76.41 permutations/s]
Permutation test:   9%|▊         | 861/10000 [00:10<01:50, 82.56 permutations/s]
Permutation test:   9%|▊         | 870/10000 [00:10<01:48, 83.81 permutations/s]
Permutation test:   9%|▉         | 879/10000 [00:10<01:49, 82.97 permutations/s]
Permutation test:   9%|▉         | 888/10000 [00:10<01:51, 81.98 permutations/s]
Permutation test:   9%|▉         | 897/10000 [00:10<02:02, 74.04 permutations/s]
Permutation test:   9%|▉         | 908/10000 [00:11<01:57, 77.38 permutations/s]
Permutation test:   9%|▉         | 919/10000 [00:11<01:45, 85.71 permutations/s]
Permutation test:   9%|▉         | 930/10000 [00:11<01:43, 87.58 permutations/s]
Permutation test:   9%|▉         | 942/10000 [00:11<01:35, 94.89 permutations/s]
Permutation test:  10%|▉         | 952/10000 [00:11<01:39, 91.35 permutations/s]
Permutation test:  10%|▉         | 962/10000 [00:11<01:49, 82.36 permutations/s]
Permutation test:  10%|▉         | 971/10000 [00:11<02:03, 73.18 permutations/s]
Permutation test:  10%|▉         | 979/10000 [00:11<02:02, 73.91 permutations/s]
Permutation test:  10%|▉         | 987/10000 [00:12<02:11, 68.70 permutations/s]
Permutation test:  10%|▉         | 995/10000 [00:12<02:06, 71.31 permutations/s]
Permutation test:  10%|█         | 1003/10000 [00:12<02:11, 68.57 permutations/s]
Permutation test:  10%|█         | 1014/10000 [00:12<01:55, 77.82 permutations/s]
Permutation test:  10%|█         | 1025/10000 [00:12<01:45, 85.09 permutations/s]
Permutation test:  10%|█         | 1034/10000 [00:12<01:50, 81.49 permutations/s]
Permutation test:  10%|█         | 1043/10000 [00:12<01:47, 83.46 permutations/s]
Permutation test:  11%|█         | 1052/10000 [00:12<01:48, 82.74 permutations/s]
Permutation test:  11%|█         | 1061/10000 [00:12<01:48, 82.73 permutations/s]
Permutation test:  11%|█         | 1070/10000 [00:13<02:02, 72.69 permutations/s]
Permutation test:  11%|█         | 1080/10000 [00:13<01:52, 79.59 permutations/s]
Permutation test:  11%|█         | 1091/10000 [00:13<01:45, 84.72 permutations/s]
Permutation test:  11%|█         | 1103/10000 [00:13<01:34, 93.73 permutations/s]
Permutation test:  11%|█         | 1113/10000 [00:13<01:52, 78.90 permutations/s]
Permutation test:  11%|█         | 1122/10000 [00:13<02:02, 72.36 permutations/s]
Permutation test:  11%|█▏        | 1132/10000 [00:13<02:00, 73.37 permutations/s]
Permutation test:  11%|█▏        | 1143/10000 [00:14<01:54, 77.63 permutations/s]
Permutation test:  12%|█▏        | 1156/10000 [00:14<01:41, 87.01 permutations/s]
Permutation test:  12%|█▏        | 1165/10000 [00:14<01:41, 86.94 permutations/s]
Permutation test:  12%|█▏        | 1175/10000 [00:14<01:37, 90.17 permutations/s]
Permutation test:  12%|█▏        | 1185/10000 [00:14<01:35, 92.15 permutations/s]
Permutation test:  12%|█▏        | 1195/10000 [00:14<01:36, 91.71 permutations/s]
Permutation test:  12%|█▏        | 1205/10000 [00:14<01:36, 90.98 permutations/s]
Permutation test:  12%|█▏        | 1215/10000 [00:14<01:34, 92.67 permutations/s]
Permutation test:  12%|█▏        | 1225/10000 [00:14<01:53, 77.50 permutations/s]
Permutation test:  12%|█▏        | 1234/10000 [00:15<01:49, 80.02 permutations/s]
Permutation test:  12%|█▏        | 1248/10000 [00:15<01:34, 93.11 permutations/s]
Permutation test:  13%|█▎        | 1258/10000 [00:15<01:37, 89.30 permutations/s]
Permutation test:  13%|█▎        | 1268/10000 [00:15<01:47, 81.14 permutations/s]
Permutation test:  13%|█▎        | 1278/10000 [00:15<01:43, 84.11 permutations/s]
Permutation test:  13%|█▎        | 1291/10000 [00:15<01:33, 93.21 permutations/s]
Permutation test:  13%|█▎        | 1301/10000 [00:15<01:33, 93.00 permutations/s]
Permutation test:  13%|█▎        | 1311/10000 [00:15<01:47, 80.99 permutations/s]
Permutation test:  13%|█▎        | 1320/10000 [00:16<01:57, 73.66 permutations/s]
Permutation test:  13%|█▎        | 1328/10000 [00:16<01:57, 73.83 permutations/s]
Permutation test:  13%|█▎        | 1337/10000 [00:16<01:52, 76.91 permutations/s]
Permutation test:  13%|█▎        | 1346/10000 [00:16<01:49, 78.89 permutations/s]
Permutation test:  14%|█▎        | 1355/10000 [00:16<01:46, 80.82 permutations/s]
Permutation test:  14%|█▎        | 1367/10000 [00:16<01:37, 88.88 permutations/s]
Permutation test:  14%|█▍        | 1379/10000 [00:16<01:30, 95.51 permutations/s]
Permutation test:  14%|█▍        | 1391/10000 [00:16<01:31, 93.81 permutations/s]
Permutation test:  14%|█▍        | 1404/10000 [00:16<01:25, 100.08 permutations/s]
Permutation test:  14%|█▍        | 1415/10000 [00:17<01:27, 97.68 permutations/s]
Permutation test:  14%|█▍        | 1430/10000 [00:17<01:19, 107.18 permutations/s]
Permutation test:  14%|█▍        | 1441/10000 [00:17<01:23, 102.37 permutations/s]
Permutation test:  15%|█▍        | 1452/10000 [00:17<01:29, 95.92 permutations/s]
Permutation test:  15%|█▍        | 1464/10000 [00:17<01:23, 102.12 permutations/s]
Permutation test:  15%|█▍        | 1475/10000 [00:17<01:24, 101.02 permutations/s]
Permutation test:  15%|█▍        | 1486/10000 [00:17<01:32, 91.74 permutations/s]
Permutation test:  15%|█▍        | 1496/10000 [00:17<01:41, 83.46 permutations/s]
Permutation test:  15%|█▌        | 1509/10000 [00:18<01:29, 94.79 permutations/s]
Permutation test:  15%|█▌        | 1519/10000 [00:18<01:30, 94.14 permutations/s]
Permutation test:  15%|█▌        | 1529/10000 [00:18<01:31, 92.09 permutations/s]
Permutation test:  15%|█▌        | 1540/10000 [00:18<01:27, 96.60 permutations/s]
Permutation test:  16%|█▌        | 1552/10000 [00:18<01:22, 102.20 permutations/s]
Permutation test:  16%|█▌        | 1563/10000 [00:18<01:25, 98.74 permutations/s]
Permutation test:  16%|█▌        | 1574/10000 [00:18<01:26, 97.20 permutations/s]
Permutation test:  16%|█▌        | 1584/10000 [00:18<01:31, 92.14 permutations/s]
Permutation test:  16%|█▌        | 1594/10000 [00:18<01:29, 93.64 permutations/s]
Permutation test:  16%|█▌        | 1604/10000 [00:19<01:35, 87.51 permutations/s]
Permutation test:  16%|█▌        | 1616/10000 [00:19<01:28, 94.94 permutations/s]
Permutation test:  16%|█▋        | 1626/10000 [00:19<01:33, 89.70 permutations/s]
Permutation test:  16%|█▋        | 1636/10000 [00:19<01:30, 92.30 permutations/s]
Permutation test:  16%|█▋        | 1646/10000 [00:19<01:49, 76.02 permutations/s]
Permutation test:  17%|█▋        | 1655/10000 [00:19<01:45, 79.27 permutations/s]
Permutation test:  17%|█▋        | 1667/10000 [00:19<01:38, 84.61 permutations/s]
Permutation test:  17%|█▋        | 1676/10000 [00:19<01:43, 80.46 permutations/s]
Permutation test:  17%|█▋        | 1686/10000 [00:20<01:39, 83.44 permutations/s]
Permutation test:  17%|█▋        | 1695/10000 [00:20<01:41, 81.88 permutations/s]
Permutation test:  17%|█▋        | 1705/10000 [00:20<01:43, 79.90 permutations/s]
Permutation test:  17%|█▋        | 1722/10000 [00:20<01:26, 95.16 permutations/s]
Permutation test:  17%|█▋        | 1734/10000 [00:20<01:23, 99.33 permutations/s]
Permutation test:  17%|█▋        | 1745/10000 [00:20<01:24, 97.18 permutations/s]
Permutation test:  18%|█▊        | 1757/10000 [00:20<01:20, 101.82 permutations/s]
Permutation test:  18%|█▊        | 1768/10000 [00:20<01:35, 86.60 permutations/s]
Permutation test:  18%|█▊        | 1779/10000 [00:21<01:29, 92.29 permutations/s]
Permutation test:  18%|█▊        | 1789/10000 [00:21<01:34, 86.90 permutations/s]
Permutation test:  18%|█▊        | 1799/10000 [00:21<01:40, 81.49 permutations/s]
Permutation test:  18%|█▊        | 1808/10000 [00:21<01:42, 80.09 permutations/s]
Permutation test:  18%|█▊        | 1817/10000 [00:21<01:45, 77.88 permutations/s]
Permutation test:  18%|█▊        | 1827/10000 [00:21<01:42, 79.64 permutations/s]
Permutation test:  18%|█▊        | 1838/10000 [00:21<01:40, 80.82 permutations/s]
Permutation test:  18%|█▊        | 1847/10000 [00:21<01:43, 78.96 permutations/s]
Permutation test:  19%|█▊        | 1855/10000 [00:22<01:44, 77.82 permutations/s]
Permutation test:  19%|█▊        | 1863/10000 [00:22<01:49, 74.24 permutations/s]
Permutation test:  19%|█▊        | 1874/10000 [00:22<01:39, 81.95 permutations/s]
Permutation test:  19%|█▉        | 1886/10000 [00:22<01:31, 88.49 permutations/s]
Permutation test:  19%|█▉        | 1900/10000 [00:22<01:20, 100.21 permutations/s]
Permutation test:  19%|█▉        | 1911/10000 [00:22<01:21, 98.74 permutations/s]
Permutation test:  19%|█▉        | 1922/10000 [00:22<01:19, 101.81 permutations/s]
Permutation test:  19%|█▉        | 1933/10000 [00:22<01:26, 93.61 permutations/s]
Permutation test:  19%|█▉        | 1943/10000 [00:22<01:27, 92.33 permutations/s]
Permutation test:  20%|█▉        | 1955/10000 [00:23<01:25, 93.76 permutations/s]
Permutation test:  20%|█▉        | 1967/10000 [00:23<01:23, 96.41 permutations/s]
Permutation test:  20%|█▉        | 1977/10000 [00:23<01:27, 92.02 permutations/s]
Permutation test:  20%|█▉        | 1987/10000 [00:23<01:33, 85.67 permutations/s]
Permutation test:  20%|█▉        | 1996/10000 [00:23<01:39, 80.78 permutations/s]
Permutation test:  20%|██        | 2005/10000 [00:23<01:36, 83.06 permutations/s]
Permutation test:  20%|██        | 2019/10000 [00:23<01:27, 90.81 permutations/s]
Permutation test:  20%|██        | 2029/10000 [00:23<01:36, 82.84 permutations/s]
Permutation test:  20%|██        | 2038/10000 [00:24<01:38, 80.53 permutations/s]
Permutation test:  21%|██        | 2053/10000 [00:24<01:21, 97.90 permutations/s]
Permutation test:  21%|██        | 2064/10000 [00:24<01:18, 101.08 permutations/s]
Permutation test:  21%|██        | 2075/10000 [00:24<01:19, 99.46 permutations/s]
Permutation test:  21%|██        | 2086/10000 [00:24<01:27, 90.48 permutations/s]
Permutation test:  21%|██        | 2096/10000 [00:24<01:26, 91.84 permutations/s]
Permutation test:  21%|██        | 2109/10000 [00:24<01:17, 101.94 permutations/s]
Permutation test:  21%|██        | 2120/10000 [00:24<01:24, 93.02 permutations/s]
Permutation test:  21%|██▏       | 2132/10000 [00:25<01:18, 99.85 permutations/s]
Permutation test:  21%|██▏       | 2143/10000 [00:25<01:18, 100.55 permutations/s]
Permutation test:  22%|██▏       | 2154/10000 [00:25<01:17, 100.80 permutations/s]
Permutation test:  22%|██▏       | 2165/10000 [00:25<01:24, 92.43 permutations/s]
Permutation test:  22%|██▏       | 2175/10000 [00:25<01:37, 80.11 permutations/s]
Permutation test:  22%|██▏       | 2186/10000 [00:25<01:36, 81.06 permutations/s]
Permutation test:  22%|██▏       | 2195/10000 [00:25<01:40, 77.94 permutations/s]
Permutation test:  22%|██▏       | 2203/10000 [00:25<01:43, 75.49 permutations/s]
Permutation test:  22%|██▏       | 2212/10000 [00:26<01:44, 74.63 permutations/s]
Permutation test:  22%|██▏       | 2221/10000 [00:26<01:39, 78.34 permutations/s]
Permutation test:  22%|██▏       | 2232/10000 [00:26<01:30, 85.87 permutations/s]
Permutation test:  22%|██▏       | 2242/10000 [00:26<01:29, 86.96 permutations/s]
Permutation test:  23%|██▎       | 2252/10000 [00:26<01:25, 90.40 permutations/s]
Permutation test:  23%|██▎       | 2262/10000 [00:26<01:25, 90.28 permutations/s]
Permutation test:  23%|██▎       | 2274/10000 [00:26<01:18, 98.36 permutations/s]
Permutation test:  23%|██▎       | 2285/10000 [00:26<01:15, 101.64 permutations/s]
Permutation test:  23%|██▎       | 2296/10000 [00:26<01:14, 103.16 permutations/s]
Permutation test:  23%|██▎       | 2307/10000 [00:27<01:22, 93.23 permutations/s]
Permutation test:  23%|██▎       | 2317/10000 [00:27<01:26, 88.39 permutations/s]
Permutation test:  23%|██▎       | 2330/10000 [00:27<01:18, 98.10 permutations/s]
Permutation test:  23%|██▎       | 2341/10000 [00:27<01:18, 97.07 permutations/s]
Permutation test:  24%|██▎       | 2352/10000 [00:27<01:17, 98.44 permutations/s]
Permutation test:  24%|██▎       | 2362/10000 [00:27<01:33, 82.02 permutations/s]
Permutation test:  24%|██▎       | 2371/10000 [00:27<01:34, 80.80 permutations/s]
Permutation test:  24%|██▍       | 2383/10000 [00:27<01:25, 89.56 permutations/s]
Permutation test:  24%|██▍       | 2393/10000 [00:28<01:32, 82.12 permutations/s]
Permutation test:  24%|██▍       | 2408/10000 [00:28<01:18, 96.98 permutations/s]
Permutation test:  24%|██▍       | 2419/10000 [00:28<01:26, 87.64 permutations/s]
Permutation test:  24%|██▍       | 2429/10000 [00:28<01:25, 88.04 permutations/s]
Permutation test:  24%|██▍       | 2439/10000 [00:28<01:31, 82.88 permutations/s]
Permutation test:  24%|██▍       | 2448/10000 [00:28<01:32, 82.03 permutations/s]
Permutation test:  25%|██▍       | 2459/10000 [00:28<01:25, 88.25 permutations/s]
Permutation test:  25%|██▍       | 2469/10000 [00:28<01:24, 89.43 permutations/s]
Permutation test:  25%|██▍       | 2479/10000 [00:29<01:29, 84.16 permutations/s]
Permutation test:  25%|██▍       | 2493/10000 [00:29<01:17, 96.67 permutations/s]
Permutation test:  25%|██▌       | 2503/10000 [00:29<01:21, 91.86 permutations/s]
Permutation test:  25%|██▌       | 2515/10000 [00:29<01:15, 98.85 permutations/s]
Permutation test:  25%|██▌       | 2526/10000 [00:29<01:17, 96.12 permutations/s]
Permutation test:  25%|██▌       | 2536/10000 [00:29<01:21, 91.95 permutations/s]
Permutation test:  25%|██▌       | 2546/10000 [00:29<01:24, 88.43 permutations/s]
Permutation test:  26%|██▌       | 2555/10000 [00:29<01:36, 76.88 permutations/s]
Permutation test:  26%|██▌       | 2563/10000 [00:29<01:38, 75.25 permutations/s]
Permutation test:  26%|██▌       | 2571/10000 [00:30<01:38, 75.66 permutations/s]
Permutation test:  26%|██▌       | 2580/10000 [00:30<01:39, 74.95 permutations/s]
Permutation test:  26%|██▌       | 2589/10000 [00:30<01:38, 74.91 permutations/s]
Permutation test:  26%|██▌       | 2602/10000 [00:30<01:23, 88.30 permutations/s]
Permutation test:  26%|██▌       | 2612/10000 [00:30<01:23, 88.78 permutations/s]
Permutation test:  26%|██▌       | 2622/10000 [00:30<01:31, 80.45 permutations/s]
Permutation test:  26%|██▋       | 2632/10000 [00:30<01:29, 81.94 permutations/s]
Permutation test:  26%|██▋       | 2646/10000 [00:30<01:20, 91.45 permutations/s]
Permutation test:  27%|██▋       | 2657/10000 [00:31<01:17, 94.99 permutations/s]
Permutation test:  27%|██▋       | 2667/10000 [00:31<01:16, 95.31 permutations/s]
Permutation test:  27%|██▋       | 2678/10000 [00:31<01:18, 93.43 permutations/s]
Permutation test:  27%|██▋       | 2688/10000 [00:31<01:18, 93.00 permutations/s]
Permutation test:  27%|██▋       | 2698/10000 [00:31<01:22, 88.52 permutations/s]
Permutation test:  27%|██▋       | 2708/10000 [00:31<01:24, 85.93 permutations/s]
Permutation test:  27%|██▋       | 2717/10000 [00:31<01:29, 81.35 permutations/s]
Permutation test:  27%|██▋       | 2726/10000 [00:31<01:30, 80.57 permutations/s]
Permutation test:  27%|██▋       | 2735/10000 [00:31<01:35, 75.99 permutations/s]
Permutation test:  27%|██▋       | 2743/10000 [00:32<01:34, 76.84 permutations/s]
Permutation test:  28%|██▊       | 2751/10000 [00:32<01:39, 73.19 permutations/s]
Permutation test:  28%|██▊       | 2761/10000 [00:32<01:32, 78.43 permutations/s]
Permutation test:  28%|██▊       | 2772/10000 [00:32<01:31, 78.89 permutations/s]
Permutation test:  28%|██▊       | 2781/10000 [00:32<01:28, 81.28 permutations/s]
Permutation test:  28%|██▊       | 2790/10000 [00:32<01:28, 81.15 permutations/s]
Permutation test:  28%|██▊       | 2801/10000 [00:32<01:22, 86.95 permutations/s]
Permutation test:  28%|██▊       | 2810/10000 [00:32<01:26, 83.24 permutations/s]
Permutation test:  28%|██▊       | 2819/10000 [00:33<01:27, 81.72 permutations/s]
Permutation test:  28%|██▊       | 2829/10000 [00:33<01:26, 83.08 permutations/s]
Permutation test:  28%|██▊       | 2839/10000 [00:33<01:26, 83.02 permutations/s]
Permutation test:  28%|██▊       | 2848/10000 [00:33<01:34, 75.86 permutations/s]
Permutation test:  29%|██▊       | 2856/10000 [00:33<01:39, 71.96 permutations/s]
Permutation test:  29%|██▊       | 2865/10000 [00:33<01:38, 72.16 permutations/s]
Permutation test:  29%|██▊       | 2873/10000 [00:33<01:39, 71.77 permutations/s]
Permutation test:  29%|██▉       | 2883/10000 [00:33<01:34, 75.38 permutations/s]
Permutation test:  29%|██▉       | 2891/10000 [00:33<01:35, 74.25 permutations/s]
Permutation test:  29%|██▉       | 2899/10000 [00:34<01:39, 71.12 permutations/s]
Permutation test:  29%|██▉       | 2907/10000 [00:34<01:38, 71.83 permutations/s]
Permutation test:  29%|██▉       | 2916/10000 [00:34<01:34, 74.76 permutations/s]
Permutation test:  29%|██▉       | 2924/10000 [00:34<01:41, 69.93 permutations/s]
Permutation test:  29%|██▉       | 2932/10000 [00:34<01:45, 66.94 permutations/s]
Permutation test:  29%|██▉       | 2939/10000 [00:34<01:44, 67.71 permutations/s]
Permutation test:  29%|██▉       | 2948/10000 [00:34<01:36, 72.82 permutations/s]
Permutation test:  30%|██▉       | 2956/10000 [00:34<01:37, 72.23 permutations/s]
Permutation test:  30%|██▉       | 2964/10000 [00:35<01:41, 69.13 permutations/s]
Permutation test:  30%|██▉       | 2973/10000 [00:35<01:41, 68.96 permutations/s]
Permutation test:  30%|██▉       | 2981/10000 [00:35<01:37, 71.72 permutations/s]
Permutation test:  30%|██▉       | 2990/10000 [00:35<01:37, 72.16 permutations/s]
Permutation test:  30%|██▉       | 2999/10000 [00:35<01:33, 74.58 permutations/s]
Permutation test:  30%|███       | 3007/10000 [00:35<01:36, 72.67 permutations/s]
Permutation test:  30%|███       | 3015/10000 [00:35<01:36, 72.28 permutations/s]
Permutation test:  30%|███       | 3023/10000 [00:35<01:49, 63.96 permutations/s]
Permutation test:  30%|███       | 3030/10000 [00:36<01:56, 59.62 permutations/s]
Permutation test:  30%|███       | 3037/10000 [00:36<01:52, 62.06 permutations/s]
Permutation test:  30%|███       | 3044/10000 [00:36<01:59, 58.22 permutations/s]
Permutation test:  31%|███       | 3051/10000 [00:36<01:53, 61.04 permutations/s]
Permutation test:  31%|███       | 3058/10000 [00:36<01:53, 60.99 permutations/s]
Permutation test:  31%|███       | 3065/10000 [00:36<01:54, 60.58 permutations/s]
Permutation test:  31%|███       | 3077/10000 [00:36<01:32, 74.90 permutations/s]
Permutation test:  31%|███       | 3087/10000 [00:36<01:31, 75.40 permutations/s]
Permutation test:  31%|███       | 3095/10000 [00:37<01:45, 65.54 permutations/s]
Permutation test:  31%|███       | 3102/10000 [00:37<01:48, 63.78 permutations/s]
Permutation test:  31%|███       | 3111/10000 [00:37<01:39, 69.38 permutations/s]
Permutation test:  31%|███       | 3119/10000 [00:37<01:37, 70.47 permutations/s]
Permutation test:  31%|███▏      | 3127/10000 [00:37<01:35, 72.34 permutations/s]
Permutation test:  31%|███▏      | 3135/10000 [00:37<01:48, 63.39 permutations/s]
Permutation test:  31%|███▏      | 3144/10000 [00:37<01:42, 66.72 permutations/s]
Permutation test:  32%|███▏      | 3151/10000 [00:37<01:44, 65.56 permutations/s]
Permutation test:  32%|███▏      | 3161/10000 [00:37<01:38, 69.50 permutations/s]
Permutation test:  32%|███▏      | 3169/10000 [00:38<01:37, 70.32 permutations/s]
Permutation test:  32%|███▏      | 3177/10000 [00:38<01:36, 70.83 permutations/s]
Permutation test:  32%|███▏      | 3185/10000 [00:38<01:38, 69.05 permutations/s]
Permutation test:  32%|███▏      | 3195/10000 [00:38<01:28, 77.03 permutations/s]
Permutation test:  32%|███▏      | 3205/10000 [00:38<01:27, 77.29 permutations/s]
Permutation test:  32%|███▏      | 3214/10000 [00:38<01:29, 76.12 permutations/s]
Permutation test:  32%|███▏      | 3222/10000 [00:38<01:32, 73.64 permutations/s]
Permutation test:  32%|███▏      | 3230/10000 [00:38<01:32, 73.38 permutations/s]
Permutation test:  32%|███▏      | 3239/10000 [00:39<01:34, 71.74 permutations/s]
Permutation test:  32%|███▏      | 3247/10000 [00:39<01:33, 72.30 permutations/s]
Permutation test:  33%|███▎      | 3257/10000 [00:39<01:26, 77.84 permutations/s]
Permutation test:  33%|███▎      | 3266/10000 [00:39<01:24, 79.44 permutations/s]
Permutation test:  33%|███▎      | 3274/10000 [00:39<01:33, 71.79 permutations/s]
Permutation test:  33%|███▎      | 3282/10000 [00:39<01:33, 71.76 permutations/s]
Permutation test:  33%|███▎      | 3290/10000 [00:39<01:33, 71.49 permutations/s]
Permutation test:  33%|███▎      | 3298/10000 [00:39<01:35, 70.04 permutations/s]
Permutation test:  33%|███▎      | 3306/10000 [00:39<01:32, 72.68 permutations/s]
Permutation test:  33%|███▎      | 3314/10000 [00:40<01:39, 67.48 permutations/s]
Permutation test:  33%|███▎      | 3322/10000 [00:40<01:36, 69.18 permutations/s]
Permutation test:  33%|███▎      | 3330/10000 [00:40<01:39, 66.92 permutations/s]
Permutation test:  33%|███▎      | 3338/10000 [00:40<01:35, 69.70 permutations/s]
Permutation test:  33%|███▎      | 3346/10000 [00:40<01:37, 68.03 permutations/s]
Permutation test:  34%|███▎      | 3353/10000 [00:40<01:41, 65.78 permutations/s]
Permutation test:  34%|███▎      | 3360/10000 [00:40<01:40, 65.93 permutations/s]
Permutation test:  34%|███▎      | 3368/10000 [00:40<01:42, 64.57 permutations/s]
Permutation test:  34%|███▍      | 3375/10000 [00:41<01:40, 65.61 permutations/s]
Permutation test:  34%|███▍      | 3382/10000 [00:41<01:40, 65.77 permutations/s]
Permutation test:  34%|███▍      | 3389/10000 [00:41<01:43, 64.00 permutations/s]
Permutation test:  34%|███▍      | 3397/10000 [00:41<01:37, 67.61 permutations/s]
Permutation test:  34%|███▍      | 3406/10000 [00:41<01:30, 73.06 permutations/s]
Permutation test:  34%|███▍      | 3414/10000 [00:41<01:30, 72.56 permutations/s]
Permutation test:  34%|███▍      | 3422/10000 [00:41<01:30, 72.37 permutations/s]
Permutation test:  34%|███▍      | 3430/10000 [00:41<01:39, 66.14 permutations/s]
Permutation test:  34%|███▍      | 3438/10000 [00:41<01:37, 67.18 permutations/s]
Permutation test:  34%|███▍      | 3445/10000 [00:42<01:39, 65.83 permutations/s]
Permutation test:  35%|███▍      | 3455/10000 [00:42<01:29, 72.97 permutations/s]
Permutation test:  35%|███▍      | 3463/10000 [00:42<01:28, 73.54 permutations/s]
Permutation test:  35%|███▍      | 3474/10000 [00:42<01:19, 81.88 permutations/s]
Permutation test:  35%|███▍      | 3484/10000 [00:42<01:16, 85.20 permutations/s]
Permutation test:  35%|███▍      | 3494/10000 [00:42<01:13, 88.10 permutations/s]
Permutation test:  35%|███▌      | 3503/10000 [00:42<01:20, 81.09 permutations/s]
Permutation test:  35%|███▌      | 3513/10000 [00:42<01:20, 80.49 permutations/s]
Permutation test:  35%|███▌      | 3522/10000 [00:42<01:27, 74.18 permutations/s]
Permutation test:  35%|███▌      | 3531/10000 [00:43<01:29, 72.52 permutations/s]
Permutation test:  35%|███▌      | 3540/10000 [00:43<01:29, 71.91 permutations/s]
Permutation test:  35%|███▌      | 3548/10000 [00:43<01:29, 72.40 permutations/s]
Permutation test:  36%|███▌      | 3557/10000 [00:43<01:30, 71.10 permutations/s]
Permutation test:  36%|███▌      | 3565/10000 [00:43<01:31, 70.26 permutations/s]
Permutation test:  36%|███▌      | 3573/10000 [00:43<01:36, 66.78 permutations/s]
Permutation test:  36%|███▌      | 3580/10000 [00:43<01:39, 64.33 permutations/s]
Permutation test:  36%|███▌      | 3587/10000 [00:43<01:40, 63.66 permutations/s]
Permutation test:  36%|███▌      | 3596/10000 [00:44<01:30, 70.55 permutations/s]
Permutation test:  36%|███▌      | 3605/10000 [00:44<01:27, 72.76 permutations/s]
Permutation test:  36%|███▌      | 3613/10000 [00:44<01:32, 69.37 permutations/s]
Permutation test:  36%|███▌      | 3621/10000 [00:44<01:29, 71.03 permutations/s]
Permutation test:  36%|███▋      | 3629/10000 [00:44<01:29, 71.58 permutations/s]
Permutation test:  36%|███▋      | 3638/10000 [00:44<01:29, 71.34 permutations/s]
Permutation test:  36%|███▋      | 3646/10000 [00:44<01:28, 71.91 permutations/s]
Permutation test:  37%|███▋      | 3654/10000 [00:44<01:32, 68.36 permutations/s]
Permutation test:  37%|███▋      | 3661/10000 [00:44<01:32, 68.79 permutations/s]
Permutation test:  37%|███▋      | 3668/10000 [00:45<01:34, 66.68 permutations/s]
Permutation test:  37%|███▋      | 3675/10000 [00:45<01:34, 67.10 permutations/s]
Permutation test:  37%|███▋      | 3684/10000 [00:45<01:27, 72.50 permutations/s]
Permutation test:  37%|███▋      | 3692/10000 [00:45<01:29, 70.83 permutations/s]
Permutation test:  37%|███▋      | 3700/10000 [00:45<01:31, 68.79 permutations/s]
Permutation test:  37%|███▋      | 3707/10000 [00:45<01:37, 64.25 permutations/s]
Permutation test:  37%|███▋      | 3715/10000 [00:45<01:36, 64.98 permutations/s]
Permutation test:  37%|███▋      | 3723/10000 [00:45<01:37, 64.20 permutations/s]
Permutation test:  37%|███▋      | 3731/10000 [00:46<01:35, 65.58 permutations/s]
Permutation test:  37%|███▋      | 3739/10000 [00:46<01:30, 69.17 permutations/s]
Permutation test:  37%|███▋      | 3746/10000 [00:46<01:35, 65.79 permutations/s]
Permutation test:  38%|███▊      | 3755/10000 [00:46<01:32, 67.44 permutations/s]
Permutation test:  38%|███▊      | 3764/10000 [00:46<01:25, 73.22 permutations/s]
Permutation test:  38%|███▊      | 3773/10000 [00:46<01:25, 72.43 permutations/s]
Permutation test:  38%|███▊      | 3783/10000 [00:46<01:18, 78.78 permutations/s]
Permutation test:  38%|███▊      | 3795/10000 [00:46<01:14, 83.00 permutations/s]
Permutation test:  38%|███▊      | 3804/10000 [00:46<01:22, 75.28 permutations/s]
Permutation test:  38%|███▊      | 3812/10000 [00:47<01:23, 74.20 permutations/s]
Permutation test:  38%|███▊      | 3821/10000 [00:47<01:20, 76.55 permutations/s]
Permutation test:  38%|███▊      | 3830/10000 [00:47<01:17, 80.09 permutations/s]
Permutation test:  38%|███▊      | 3839/10000 [00:47<01:16, 80.24 permutations/s]
Permutation test:  38%|███▊      | 3848/10000 [00:47<01:28, 69.27 permutations/s]
Permutation test:  39%|███▊      | 3856/10000 [00:47<01:28, 69.05 permutations/s]
Permutation test:  39%|███▊      | 3864/10000 [00:47<01:36, 63.62 permutations/s]
Permutation test:  39%|███▊      | 3872/10000 [00:47<01:31, 66.79 permutations/s]
Permutation test:  39%|███▉      | 3879/10000 [00:48<01:33, 65.58 permutations/s]
Permutation test:  39%|███▉      | 3886/10000 [00:48<01:36, 63.42 permutations/s]
Permutation test:  39%|███▉      | 3894/10000 [00:48<01:35, 63.93 permutations/s]
Permutation test:  39%|███▉      | 3904/10000 [00:48<01:25, 71.61 permutations/s]
Permutation test:  39%|███▉      | 3913/10000 [00:48<01:21, 74.94 permutations/s]
Permutation test:  39%|███▉      | 3921/10000 [00:48<01:27, 69.68 permutations/s]
Permutation test:  39%|███▉      | 3930/10000 [00:48<01:21, 74.71 permutations/s]
Permutation test:  39%|███▉      | 3938/10000 [00:48<01:23, 72.33 permutations/s]
Permutation test:  39%|███▉      | 3947/10000 [00:49<01:20, 75.50 permutations/s]
Permutation test:  40%|███▉      | 3955/10000 [00:49<01:29, 67.76 permutations/s]
Permutation test:  40%|███▉      | 3963/10000 [00:49<01:30, 66.99 permutations/s]
Permutation test:  40%|███▉      | 3971/10000 [00:49<01:30, 66.26 permutations/s]
Permutation test:  40%|███▉      | 3978/10000 [00:49<01:31, 65.68 permutations/s]
Permutation test:  40%|███▉      | 3985/10000 [00:49<01:34, 63.63 permutations/s]
Permutation test:  40%|███▉      | 3994/10000 [00:49<01:30, 66.40 permutations/s]
Permutation test:  40%|████      | 4001/10000 [00:49<01:31, 65.30 permutations/s]
Permutation test:  40%|████      | 4009/10000 [00:49<01:26, 69.03 permutations/s]
Permutation test:  40%|████      | 4017/10000 [00:50<01:23, 72.02 permutations/s]
Permutation test:  40%|████      | 4025/10000 [00:50<01:26, 68.79 permutations/s]
Permutation test:  40%|████      | 4032/10000 [00:50<01:32, 64.44 permutations/s]
Permutation test:  40%|████      | 4040/10000 [00:50<01:28, 67.20 permutations/s]
Permutation test:  40%|████      | 4048/10000 [00:50<01:25, 69.60 permutations/s]
Permutation test:  41%|████      | 4061/10000 [00:50<01:10, 84.50 permutations/s]
Permutation test:  41%|████      | 4070/10000 [00:50<01:11, 83.19 permutations/s]
Permutation test:  41%|████      | 4079/10000 [00:50<01:13, 80.88 permutations/s]
Permutation test:  41%|████      | 4088/10000 [00:51<01:21, 72.14 permutations/s]
Permutation test:  41%|████      | 4096/10000 [00:51<01:28, 66.65 permutations/s]
Permutation test:  41%|████      | 4107/10000 [00:51<01:16, 76.59 permutations/s]
Permutation test:  41%|████      | 4117/10000 [00:51<01:12, 80.95 permutations/s]
Permutation test:  41%|████▏     | 4126/10000 [00:51<01:15, 77.74 permutations/s]
Permutation test:  41%|████▏     | 4134/10000 [00:51<01:18, 75.03 permutations/s]
Permutation test:  41%|████▏     | 4142/10000 [00:51<01:20, 72.51 permutations/s]
Permutation test:  42%|████▏     | 4150/10000 [00:51<01:23, 70.01 permutations/s]
Permutation test:  42%|████▏     | 4158/10000 [00:52<01:32, 62.82 permutations/s]
Permutation test:  42%|████▏     | 4165/10000 [00:52<01:32, 62.97 permutations/s]
Permutation test:  42%|████▏     | 4174/10000 [00:52<01:29, 65.12 permutations/s]
Permutation test:  42%|████▏     | 4184/10000 [00:52<01:19, 73.13 permutations/s]
Permutation test:  42%|████▏     | 4196/10000 [00:52<01:09, 83.53 permutations/s]
Permutation test:  42%|████▏     | 4205/10000 [00:52<01:08, 85.18 permutations/s]
Permutation test:  42%|████▏     | 4214/10000 [00:52<01:10, 82.41 permutations/s]
Permutation test:  42%|████▏     | 4223/10000 [00:52<01:13, 78.36 permutations/s]
Permutation test:  42%|████▏     | 4231/10000 [00:52<01:16, 75.55 permutations/s]
Permutation test:  42%|████▏     | 4239/10000 [00:53<01:15, 76.55 permutations/s]
Permutation test:  43%|████▎     | 4251/10000 [00:53<01:05, 87.57 permutations/s]
Permutation test:  43%|████▎     | 4260/10000 [00:53<01:05, 88.19 permutations/s]
Permutation test:  43%|████▎     | 4269/10000 [00:53<01:11, 79.88 permutations/s]
Permutation test:  43%|████▎     | 4278/10000 [00:53<01:18, 73.16 permutations/s]
Permutation test:  43%|████▎     | 4286/10000 [00:53<01:16, 74.69 permutations/s]
Permutation test:  43%|████▎     | 4294/10000 [00:53<01:22, 68.93 permutations/s]
Permutation test:  43%|████▎     | 4302/10000 [00:53<01:28, 64.57 permutations/s]
Permutation test:  43%|████▎     | 4309/10000 [00:54<01:26, 65.87 permutations/s]
Permutation test:  43%|████▎     | 4318/10000 [00:54<01:19, 71.25 permutations/s]
Permutation test:  43%|████▎     | 4326/10000 [00:54<01:17, 73.59 permutations/s]
Permutation test:  43%|████▎     | 4334/10000 [00:54<01:19, 71.37 permutations/s]
Permutation test:  43%|████▎     | 4344/10000 [00:54<01:14, 76.00 permutations/s]
Permutation test:  44%|████▎     | 4352/10000 [00:54<01:13, 76.72 permutations/s]
Permutation test:  44%|████▎     | 4360/10000 [00:54<01:19, 71.16 permutations/s]
Permutation test:  44%|████▎     | 4368/10000 [00:54<01:16, 73.19 permutations/s]
Permutation test:  44%|████▍     | 4377/10000 [00:54<01:12, 77.74 permutations/s]
Permutation test:  44%|████▍     | 4386/10000 [00:55<01:12, 77.80 permutations/s]
Permutation test:  44%|████▍     | 4394/10000 [00:55<01:16, 72.83 permutations/s]
Permutation test:  44%|████▍     | 4402/10000 [00:55<01:16, 72.98 permutations/s]
Permutation test:  44%|████▍     | 4410/10000 [00:55<01:18, 71.26 permutations/s]
Permutation test:  44%|████▍     | 4418/10000 [00:55<01:20, 69.62 permutations/s]
Permutation test:  44%|████▍     | 4426/10000 [00:55<01:20, 69.43 permutations/s]
Permutation test:  44%|████▍     | 4433/10000 [00:55<01:21, 68.15 permutations/s]
Permutation test:  44%|████▍     | 4440/10000 [00:55<01:22, 67.34 permutations/s]
Permutation test:  44%|████▍     | 4447/10000 [00:55<01:24, 65.71 permutations/s]
Permutation test:  45%|████▍     | 4454/10000 [00:56<01:23, 66.16 permutations/s]
Permutation test:  45%|████▍     | 4461/10000 [00:56<01:23, 66.68 permutations/s]
Permutation test:  45%|████▍     | 4468/10000 [00:56<01:22, 66.83 permutations/s]
Permutation test:  45%|████▍     | 4477/10000 [00:56<01:19, 69.33 permutations/s]
Permutation test:  45%|████▍     | 4489/10000 [00:56<01:07, 81.65 permutations/s]
Permutation test:  45%|████▍     | 4498/10000 [00:56<01:08, 80.66 permutations/s]
Permutation test:  45%|████▌     | 4507/10000 [00:56<01:12, 75.40 permutations/s]
Permutation test:  45%|████▌     | 4515/10000 [00:56<01:16, 72.10 permutations/s]
Permutation test:  45%|████▌     | 4523/10000 [00:56<01:20, 67.89 permutations/s]
Permutation test:  45%|████▌     | 4531/10000 [00:57<01:17, 70.27 permutations/s]
Permutation test:  45%|████▌     | 4539/10000 [00:57<01:19, 68.45 permutations/s]
Permutation test:  45%|████▌     | 4549/10000 [00:57<01:12, 75.04 permutations/s]
Permutation test:  46%|████▌     | 4557/10000 [00:57<01:13, 74.13 permutations/s]
Permutation test:  46%|████▌     | 4565/10000 [00:57<01:14, 73.14 permutations/s]
Permutation test:  46%|████▌     | 4573/10000 [00:57<01:24, 64.51 permutations/s]
Permutation test:  46%|████▌     | 4580/10000 [00:57<01:22, 65.35 permutations/s]
Permutation test:  46%|████▌     | 4587/10000 [00:57<01:24, 64.42 permutations/s]
Permutation test:  46%|████▌     | 4594/10000 [00:58<01:29, 60.30 permutations/s]
Permutation test:  46%|████▌     | 4602/10000 [00:58<01:24, 63.91 permutations/s]
Permutation test:  46%|████▌     | 4609/10000 [00:58<01:22, 65.48 permutations/s]
Permutation test:  46%|████▌     | 4616/10000 [00:58<01:23, 64.81 permutations/s]
Permutation test:  46%|████▌     | 4624/10000 [00:58<01:18, 68.70 permutations/s]
Permutation test:  46%|████▋     | 4634/10000 [00:58<01:09, 77.46 permutations/s]
Permutation test:  46%|████▋     | 4642/10000 [00:58<01:17, 69.18 permutations/s]
Permutation test:  46%|████▋     | 4650/10000 [00:58<01:21, 65.42 permutations/s]
Permutation test:  47%|████▋     | 4658/10000 [00:58<01:19, 67.16 permutations/s]
Permutation test:  47%|████▋     | 4665/10000 [00:59<01:22, 64.91 permutations/s]
Permutation test:  47%|████▋     | 4673/10000 [00:59<01:20, 65.97 permutations/s]
Permutation test:  47%|████▋     | 4682/10000 [00:59<01:13, 72.03 permutations/s]
Permutation test:  47%|████▋     | 4690/10000 [00:59<01:14, 71.14 permutations/s]
Permutation test:  47%|████▋     | 4698/10000 [00:59<01:23, 63.22 permutations/s]
Permutation test:  47%|████▋     | 4705/10000 [00:59<01:23, 63.62 permutations/s]
Permutation test:  47%|████▋     | 4712/10000 [00:59<01:24, 62.71 permutations/s]
Permutation test:  47%|████▋     | 4719/10000 [00:59<01:27, 60.66 permutations/s]
Permutation test:  47%|████▋     | 4726/10000 [01:00<01:28, 59.56 permutations/s]
Permutation test:  47%|████▋     | 4735/10000 [01:00<01:21, 64.81 permutations/s]
Permutation test:  47%|████▋     | 4743/10000 [01:00<01:17, 68.09 permutations/s]
Permutation test:  48%|████▊     | 4750/10000 [01:00<01:16, 68.38 permutations/s]
Permutation test:  48%|████▊     | 4757/10000 [01:00<01:17, 67.36 permutations/s]
Permutation test:  48%|████▊     | 4765/10000 [01:00<01:16, 68.04 permutations/s]
Permutation test:  48%|████▊     | 4773/10000 [01:00<01:15, 69.21 permutations/s]
Permutation test:  48%|████▊     | 4780/10000 [01:00<01:19, 65.46 permutations/s]
Permutation test:  48%|████▊     | 4787/10000 [01:00<01:19, 65.98 permutations/s]
Permutation test:  48%|████▊     | 4796/10000 [01:01<01:17, 66.90 permutations/s]
Permutation test:  48%|████▊     | 4803/10000 [01:01<01:20, 64.77 permutations/s]
Permutation test:  48%|████▊     | 4810/10000 [01:01<01:22, 62.96 permutations/s]
Permutation test:  48%|████▊     | 4820/10000 [01:01<01:12, 71.90 permutations/s]
Permutation test:  48%|████▊     | 4828/10000 [01:01<01:15, 68.15 permutations/s]
Permutation test:  48%|████▊     | 4835/10000 [01:01<01:15, 68.06 permutations/s]
Permutation test:  48%|████▊     | 4842/10000 [01:01<01:20, 64.28 permutations/s]
Permutation test:  48%|████▊     | 4849/10000 [01:01<01:19, 65.09 permutations/s]
Permutation test:  49%|████▊     | 4856/10000 [01:01<01:19, 65.03 permutations/s]
Permutation test:  49%|████▊     | 4863/10000 [01:02<01:20, 63.75 permutations/s]
Permutation test:  49%|████▊     | 4871/10000 [01:02<01:20, 64.00 permutations/s]
Permutation test:  49%|████▉     | 4880/10000 [01:02<01:13, 70.04 permutations/s]
Permutation test:  49%|████▉     | 4889/10000 [01:02<01:11, 71.66 permutations/s]
Permutation test:  49%|████▉     | 4897/10000 [01:02<01:14, 68.64 permutations/s]
Permutation test:  49%|████▉     | 4907/10000 [01:02<01:11, 71.12 permutations/s]
Permutation test:  49%|████▉     | 4915/10000 [01:02<01:11, 71.10 permutations/s]
Permutation test:  49%|████▉     | 4923/10000 [01:02<01:14, 68.50 permutations/s]
Permutation test:  49%|████▉     | 4933/10000 [01:03<01:06, 75.72 permutations/s]
Permutation test:  49%|████▉     | 4942/10000 [01:03<01:04, 78.67 permutations/s]
Permutation test:  50%|████▉     | 4950/10000 [01:03<01:06, 76.25 permutations/s]
Permutation test:  50%|████▉     | 4958/10000 [01:03<01:07, 75.16 permutations/s]
Permutation test:  50%|████▉     | 4966/10000 [01:03<01:11, 70.41 permutations/s]
Permutation test:  50%|████▉     | 4974/10000 [01:03<01:11, 70.50 permutations/s]
Permutation test:  50%|████▉     | 4983/10000 [01:03<01:08, 73.57 permutations/s]
Permutation test:  50%|████▉     | 4991/10000 [01:03<01:10, 71.25 permutations/s]
Permutation test:  50%|████▉     | 4999/10000 [01:03<01:13, 68.45 permutations/s]
Permutation test:  50%|█████     | 5006/10000 [01:04<01:19, 62.91 permutations/s]
Permutation test:  50%|█████     | 5013/10000 [01:04<01:17, 64.09 permutations/s]
Permutation test:  50%|█████     | 5023/10000 [01:04<01:12, 68.68 permutations/s]
Permutation test:  50%|█████     | 5033/10000 [01:04<01:07, 73.84 permutations/s]
Permutation test:  50%|█████     | 5041/10000 [01:04<01:08, 72.34 permutations/s]
Permutation test:  50%|█████     | 5049/10000 [01:04<01:11, 69.25 permutations/s]
Permutation test:  51%|█████     | 5059/10000 [01:04<01:04, 76.46 permutations/s]
Permutation test:  51%|█████     | 5068/10000 [01:04<01:02, 79.26 permutations/s]
Permutation test:  51%|█████     | 5077/10000 [01:05<01:07, 72.62 permutations/s]
Permutation test:  51%|█████     | 5085/10000 [01:05<01:10, 69.28 permutations/s]
Permutation test:  51%|█████     | 5095/10000 [01:05<01:05, 74.87 permutations/s]
Permutation test:  51%|█████     | 5104/10000 [01:05<01:05, 75.12 permutations/s]
Permutation test:  51%|█████     | 5112/10000 [01:05<01:06, 73.86 permutations/s]
Permutation test:  51%|█████     | 5120/10000 [01:05<01:07, 72.44 permutations/s]
Permutation test:  51%|█████▏    | 5128/10000 [01:05<01:08, 70.66 permutations/s]
Permutation test:  51%|█████▏    | 5136/10000 [01:05<01:08, 70.85 permutations/s]
Permutation test:  51%|█████▏    | 5144/10000 [01:06<01:08, 71.04 permutations/s]
Permutation test:  52%|█████▏    | 5152/10000 [01:06<01:07, 71.92 permutations/s]
Permutation test:  52%|█████▏    | 5160/10000 [01:06<01:05, 73.52 permutations/s]
Permutation test:  52%|█████▏    | 5168/10000 [01:06<01:09, 69.62 permutations/s]
Permutation test:  52%|█████▏    | 5176/10000 [01:06<01:07, 71.73 permutations/s]
Permutation test:  52%|█████▏    | 5185/10000 [01:06<01:06, 72.18 permutations/s]
Permutation test:  52%|█████▏    | 5193/10000 [01:06<01:07, 71.20 permutations/s]
Permutation test:  52%|█████▏    | 5202/10000 [01:06<01:08, 70.42 permutations/s]
Permutation test:  52%|█████▏    | 5210/10000 [01:06<01:12, 66.47 permutations/s]
Permutation test:  52%|█████▏    | 5217/10000 [01:07<01:12, 65.84 permutations/s]
Permutation test:  52%|█████▏    | 5225/10000 [01:07<01:10, 68.13 permutations/s]
Permutation test:  52%|█████▏    | 5238/10000 [01:07<01:00, 78.25 permutations/s]
Permutation test:  52%|█████▏    | 5249/10000 [01:07<00:56, 84.55 permutations/s]
Permutation test:  53%|█████▎    | 5258/10000 [01:07<01:00, 78.67 permutations/s]
Permutation test:  53%|█████▎    | 5266/10000 [01:07<01:03, 74.92 permutations/s]
Permutation test:  53%|█████▎    | 5274/10000 [01:07<01:08, 69.26 permutations/s]
Permutation test:  53%|█████▎    | 5282/10000 [01:07<01:07, 69.83 permutations/s]
Permutation test:  53%|█████▎    | 5290/10000 [01:08<01:12, 65.07 permutations/s]
Permutation test:  53%|█████▎    | 5298/10000 [01:08<01:08, 68.59 permutations/s]
Permutation test:  53%|█████▎    | 5305/10000 [01:08<01:08, 68.37 permutations/s]
Permutation test:  53%|█████▎    | 5316/10000 [01:08<00:59, 78.64 permutations/s]
Permutation test:  53%|█████▎    | 5327/10000 [01:08<00:54, 86.35 permutations/s]
Permutation test:  53%|█████▎    | 5336/10000 [01:08<00:59, 77.85 permutations/s]
Permutation test:  53%|█████▎    | 5345/10000 [01:08<01:00, 76.93 permutations/s]
Permutation test:  54%|█████▎    | 5353/10000 [01:08<01:07, 69.18 permutations/s]
Permutation test:  54%|█████▎    | 5362/10000 [01:08<01:02, 74.20 permutations/s]
Permutation test:  54%|█████▎    | 5370/10000 [01:09<01:03, 72.70 permutations/s]
Permutation test:  54%|█████▍    | 5378/10000 [01:09<01:04, 71.47 permutations/s]
Permutation test:  54%|█████▍    | 5386/10000 [01:09<01:08, 67.38 permutations/s]
Permutation test:  54%|█████▍    | 5394/10000 [01:09<01:07, 68.48 permutations/s]
Permutation test:  54%|█████▍    | 5402/10000 [01:09<01:05, 70.07 permutations/s]
Permutation test:  54%|█████▍    | 5410/10000 [01:09<01:09, 65.80 permutations/s]
Permutation test:  54%|█████▍    | 5418/10000 [01:09<01:11, 64.21 permutations/s]
Permutation test:  54%|█████▍    | 5427/10000 [01:09<01:05, 69.84 permutations/s]
Permutation test:  54%|█████▍    | 5435/10000 [01:10<01:06, 68.18 permutations/s]
Permutation test:  54%|█████▍    | 5442/10000 [01:10<01:08, 66.61 permutations/s]
Permutation test:  55%|█████▍    | 5450/10000 [01:10<01:08, 66.13 permutations/s]
Permutation test:  55%|█████▍    | 5459/10000 [01:10<01:05, 69.61 permutations/s]
Permutation test:  55%|█████▍    | 5467/10000 [01:10<01:06, 67.91 permutations/s]
Permutation test:  55%|█████▍    | 5475/10000 [01:10<01:05, 68.80 permutations/s]
Permutation test:  55%|█████▍    | 5484/10000 [01:10<01:00, 74.38 permutations/s]
Permutation test:  55%|█████▍    | 5492/10000 [01:10<01:01, 73.50 permutations/s]
Permutation test:  55%|█████▌    | 5500/10000 [01:11<01:03, 70.95 permutations/s]
Permutation test:  55%|█████▌    | 5509/10000 [01:11<01:02, 72.06 permutations/s]
Permutation test:  55%|█████▌    | 5517/10000 [01:11<01:01, 72.43 permutations/s]
Permutation test:  55%|█████▌    | 5526/10000 [01:11<00:58, 76.38 permutations/s]
Permutation test:  55%|█████▌    | 5534/10000 [01:11<00:57, 77.38 permutations/s]
Permutation test:  55%|█████▌    | 5542/10000 [01:11<01:04, 69.65 permutations/s]
Permutation test:  56%|█████▌    | 5550/10000 [01:11<01:03, 70.14 permutations/s]
Permutation test:  56%|█████▌    | 5561/10000 [01:11<00:58, 75.97 permutations/s]
Permutation test:  56%|█████▌    | 5569/10000 [01:11<00:59, 74.45 permutations/s]
Permutation test:  56%|█████▌    | 5577/10000 [01:12<01:03, 69.43 permutations/s]
Permutation test:  56%|█████▌    | 5585/10000 [01:12<01:07, 65.79 permutations/s]
Permutation test:  56%|█████▌    | 5592/10000 [01:12<01:10, 62.66 permutations/s]
Permutation test:  56%|█████▌    | 5602/10000 [01:12<01:02, 70.47 permutations/s]
Permutation test:  56%|█████▌    | 5614/10000 [01:12<00:52, 83.39 permutations/s]
Permutation test:  56%|█████▌    | 5623/10000 [01:12<00:55, 78.40 permutations/s]
Permutation test:  56%|█████▋    | 5632/10000 [01:12<00:55, 78.17 permutations/s]
Permutation test:  56%|█████▋    | 5644/10000 [01:12<00:49, 88.28 permutations/s]
Permutation test:  57%|█████▋    | 5654/10000 [01:13<00:55, 78.24 permutations/s]
Permutation test:  57%|█████▋    | 5663/10000 [01:13<00:57, 75.73 permutations/s]
Permutation test:  57%|█████▋    | 5672/10000 [01:13<00:55, 77.70 permutations/s]
Permutation test:  57%|█████▋    | 5680/10000 [01:13<00:55, 77.47 permutations/s]
Permutation test:  57%|█████▋    | 5688/10000 [01:13<00:55, 77.34 permutations/s]
Permutation test:  57%|█████▋    | 5696/10000 [01:13<00:59, 71.77 permutations/s]
Permutation test:  57%|█████▋    | 5704/10000 [01:13<00:58, 73.77 permutations/s]
Permutation test:  57%|█████▋    | 5712/10000 [01:13<01:01, 70.24 permutations/s]
Permutation test:  57%|█████▋    | 5721/10000 [01:13<01:01, 69.59 permutations/s]
Permutation test:  57%|█████▋    | 5729/10000 [01:14<01:05, 64.75 permutations/s]
Permutation test:  57%|█████▋    | 5736/10000 [01:14<01:04, 65.99 permutations/s]
Permutation test:  57%|█████▋    | 5743/10000 [01:14<01:06, 64.39 permutations/s]
Permutation test:  58%|█████▊    | 5753/10000 [01:14<00:59, 70.87 permutations/s]
Permutation test:  58%|█████▊    | 5761/10000 [01:14<00:57, 73.25 permutations/s]
Permutation test:  58%|█████▊    | 5769/10000 [01:14<00:59, 71.20 permutations/s]
Permutation test:  58%|█████▊    | 5777/10000 [01:14<00:57, 72.85 permutations/s]
Permutation test:  58%|█████▊    | 5785/10000 [01:14<00:57, 73.26 permutations/s]
Permutation test:  58%|█████▊    | 5793/10000 [01:15<01:01, 68.28 permutations/s]
Permutation test:  58%|█████▊    | 5801/10000 [01:15<01:00, 69.21 permutations/s]
Permutation test:  58%|█████▊    | 5809/10000 [01:15<01:00, 69.07 permutations/s]
Permutation test:  58%|█████▊    | 5817/10000 [01:15<00:59, 70.42 permutations/s]
Permutation test:  58%|█████▊    | 5825/10000 [01:15<00:58, 71.43 permutations/s]
Permutation test:  58%|█████▊    | 5833/10000 [01:15<01:03, 65.84 permutations/s]
Permutation test:  58%|█████▊    | 5840/10000 [01:15<01:02, 66.89 permutations/s]
Permutation test:  58%|█████▊    | 5847/10000 [01:15<01:04, 64.45 permutations/s]
Permutation test:  59%|█████▊    | 5854/10000 [01:15<01:05, 63.71 permutations/s]
Permutation test:  59%|█████▊    | 5861/10000 [01:16<01:05, 63.36 permutations/s]
Permutation test:  59%|█████▊    | 5869/10000 [01:16<01:01, 67.19 permutations/s]
Permutation test:  59%|█████▉    | 5877/10000 [01:16<01:01, 67.19 permutations/s]
Permutation test:  59%|█████▉    | 5884/10000 [01:16<01:02, 65.78 permutations/s]
Permutation test:  59%|█████▉    | 5894/10000 [01:16<00:54, 75.01 permutations/s]
Permutation test:  59%|█████▉    | 5902/10000 [01:16<00:54, 74.69 permutations/s]
Permutation test:  59%|█████▉    | 5910/10000 [01:16<00:55, 73.79 permutations/s]
Permutation test:  59%|█████▉    | 5919/10000 [01:16<00:52, 78.30 permutations/s]
Permutation test:  59%|█████▉    | 5932/10000 [01:16<00:47, 85.47 permutations/s]
Permutation test:  59%|█████▉    | 5941/10000 [01:17<00:47, 85.28 permutations/s]
Permutation test:  60%|█████▉    | 5951/10000 [01:17<00:48, 84.22 permutations/s]
Permutation test:  60%|█████▉    | 5960/10000 [01:17<00:48, 82.54 permutations/s]
Permutation test:  60%|█████▉    | 5969/10000 [01:17<00:49, 81.81 permutations/s]
Permutation test:  60%|█████▉    | 5978/10000 [01:17<00:53, 74.78 permutations/s]
Permutation test:  60%|█████▉    | 5986/10000 [01:17<00:58, 68.90 permutations/s]
Permutation test:  60%|█████▉    | 5994/10000 [01:17<01:02, 64.58 permutations/s]
Permutation test:  60%|██████    | 6001/10000 [01:17<01:01, 64.81 permutations/s]
Permutation test:  60%|██████    | 6008/10000 [01:18<01:00, 66.13 permutations/s]
Permutation test:  60%|██████    | 6015/10000 [01:18<00:59, 66.43 permutations/s]
Permutation test:  60%|██████    | 6022/10000 [01:18<01:01, 65.13 permutations/s]
Permutation test:  60%|██████    | 6029/10000 [01:18<01:01, 64.42 permutations/s]
Permutation test:  60%|██████    | 6041/10000 [01:18<00:50, 78.75 permutations/s]
Permutation test:  60%|██████    | 6049/10000 [01:18<00:50, 78.19 permutations/s]
Permutation test:  61%|██████    | 6057/10000 [01:18<00:57, 68.35 permutations/s]
Permutation test:  61%|██████    | 6066/10000 [01:18<00:55, 70.43 permutations/s]
Permutation test:  61%|██████    | 6075/10000 [01:18<00:52, 74.93 permutations/s]
Permutation test:  61%|██████    | 6083/10000 [01:19<00:53, 73.14 permutations/s]
Permutation test:  61%|██████    | 6091/10000 [01:19<00:52, 73.95 permutations/s]
Permutation test:  61%|██████    | 6101/10000 [01:19<00:52, 74.24 permutations/s]
Permutation test:  61%|██████    | 6109/10000 [01:19<00:51, 75.54 permutations/s]
Permutation test:  61%|██████    | 6117/10000 [01:19<00:53, 72.78 permutations/s]
Permutation test:  61%|██████▏   | 6125/10000 [01:19<00:54, 71.59 permutations/s]
Permutation test:  61%|██████▏   | 6133/10000 [01:19<00:56, 68.02 permutations/s]
Permutation test:  61%|██████▏   | 6141/10000 [01:19<00:55, 69.73 permutations/s]
Permutation test:  61%|██████▏   | 6149/10000 [01:19<00:53, 71.73 permutations/s]
Permutation test:  62%|██████▏   | 6157/10000 [01:20<00:56, 67.98 permutations/s]
Permutation test:  62%|██████▏   | 6164/10000 [01:20<01:00, 63.36 permutations/s]
Permutation test:  62%|██████▏   | 6173/10000 [01:20<00:55, 69.34 permutations/s]
Permutation test:  62%|██████▏   | 6181/10000 [01:20<00:54, 70.64 permutations/s]
Permutation test:  62%|██████▏   | 6190/10000 [01:20<00:51, 73.72 permutations/s]
Permutation test:  62%|██████▏   | 6199/10000 [01:20<00:48, 78.06 permutations/s]
Permutation test:  62%|██████▏   | 6207/10000 [01:20<00:53, 71.23 permutations/s]
Permutation test:  62%|██████▏   | 6216/10000 [01:20<00:53, 71.21 permutations/s]
Permutation test:  62%|██████▏   | 6224/10000 [01:21<00:53, 70.12 permutations/s]
Permutation test:  62%|██████▏   | 6232/10000 [01:21<00:55, 67.29 permutations/s]
Permutation test:  62%|██████▏   | 6241/10000 [01:21<00:51, 72.66 permutations/s]
Permutation test:  62%|██████▏   | 6249/10000 [01:21<00:54, 69.34 permutations/s]
Permutation test:  63%|██████▎   | 6257/10000 [01:21<01:01, 61.20 permutations/s]
Permutation test:  63%|██████▎   | 6264/10000 [01:21<01:00, 62.00 permutations/s]
Permutation test:  63%|██████▎   | 6271/10000 [01:21<01:00, 62.14 permutations/s]
Permutation test:  63%|██████▎   | 6278/10000 [01:21<01:03, 58.85 permutations/s]
Permutation test:  63%|██████▎   | 6285/10000 [01:22<01:00, 61.53 permutations/s]
Permutation test:  63%|██████▎   | 6295/10000 [01:22<00:55, 66.94 permutations/s]
Permutation test:  63%|██████▎   | 6305/10000 [01:22<00:50, 73.03 permutations/s]
Permutation test:  63%|██████▎   | 6313/10000 [01:22<00:53, 69.27 permutations/s]
Permutation test:  63%|██████▎   | 6323/10000 [01:22<00:49, 74.22 permutations/s]
Permutation test:  63%|██████▎   | 6334/10000 [01:22<00:45, 80.75 permutations/s]
Permutation test:  63%|██████▎   | 6343/10000 [01:22<00:44, 81.69 permutations/s]
Permutation test:  64%|██████▎   | 6354/10000 [01:22<00:41, 88.67 permutations/s]
Permutation test:  64%|██████▎   | 6363/10000 [01:22<00:42, 85.03 permutations/s]
Permutation test:  64%|██████▎   | 6372/10000 [01:23<00:42, 86.14 permutations/s]
Permutation test:  64%|██████▍   | 6381/10000 [01:23<00:47, 75.55 permutations/s]
Permutation test:  64%|██████▍   | 6389/10000 [01:23<00:49, 72.74 permutations/s]
Permutation test:  64%|██████▍   | 6397/10000 [01:23<00:51, 69.57 permutations/s]
Permutation test:  64%|██████▍   | 6405/10000 [01:23<00:50, 70.79 permutations/s]
Permutation test:  64%|██████▍   | 6413/10000 [01:23<00:56, 63.94 permutations/s]
Permutation test:  64%|██████▍   | 6421/10000 [01:23<00:52, 67.92 permutations/s]
Permutation test:  64%|██████▍   | 6429/10000 [01:23<00:52, 67.39 permutations/s]
Permutation test:  64%|██████▍   | 6438/10000 [01:24<00:52, 67.25 permutations/s]
Permutation test:  64%|██████▍   | 6445/10000 [01:24<00:56, 63.16 permutations/s]
Permutation test:  65%|██████▍   | 6452/10000 [01:24<00:58, 60.17 permutations/s]
Permutation test:  65%|██████▍   | 6461/10000 [01:24<00:54, 65.08 permutations/s]
Permutation test:  65%|██████▍   | 6470/10000 [01:24<00:49, 71.18 permutations/s]
Permutation test:  65%|██████▍   | 6478/10000 [01:24<00:48, 73.03 permutations/s]
Permutation test:  65%|██████▍   | 6486/10000 [01:24<00:51, 68.71 permutations/s]
Permutation test:  65%|██████▍   | 6494/10000 [01:24<00:49, 70.36 permutations/s]
Permutation test:  65%|██████▌   | 6503/10000 [01:25<00:49, 71.09 permutations/s]
Permutation test:  65%|██████▌   | 6511/10000 [01:25<00:50, 69.01 permutations/s]
Permutation test:  65%|██████▌   | 6518/10000 [01:25<00:50, 68.41 permutations/s]
Permutation test:  65%|██████▌   | 6525/10000 [01:25<00:53, 65.49 permutations/s]
Permutation test:  65%|██████▌   | 6533/10000 [01:25<00:50, 68.43 permutations/s]
Permutation test:  65%|██████▌   | 6540/10000 [01:25<00:53, 64.78 permutations/s]
Permutation test:  65%|██████▌   | 6547/10000 [01:25<00:53, 64.13 permutations/s]
Permutation test:  66%|██████▌   | 6554/10000 [01:25<00:53, 65.00 permutations/s]
Permutation test:  66%|██████▌   | 6561/10000 [01:25<00:56, 60.45 permutations/s]
Permutation test:  66%|██████▌   | 6568/10000 [01:26<00:55, 62.07 permutations/s]
Permutation test:  66%|██████▌   | 6575/10000 [01:26<00:54, 62.35 permutations/s]
Permutation test:  66%|██████▌   | 6582/10000 [01:26<00:53, 63.78 permutations/s]
Permutation test:  66%|██████▌   | 6590/10000 [01:26<00:52, 64.66 permutations/s]
Permutation test:  66%|██████▌   | 6598/10000 [01:26<00:50, 66.83 permutations/s]
Permutation test:  66%|██████▌   | 6605/10000 [01:26<00:51, 65.30 permutations/s]
Permutation test:  66%|██████▌   | 6614/10000 [01:26<00:47, 72.00 permutations/s]
Permutation test:  66%|██████▌   | 6624/10000 [01:26<00:43, 78.14 permutations/s]
Permutation test:  66%|██████▋   | 6634/10000 [01:26<00:39, 84.31 permutations/s]
Permutation test:  66%|██████▋   | 6643/10000 [01:27<00:44, 75.56 permutations/s]
Permutation test:  67%|██████▋   | 6651/10000 [01:27<00:44, 75.89 permutations/s]
Permutation test:  67%|██████▋   | 6660/10000 [01:27<00:43, 77.50 permutations/s]
Permutation test:  67%|██████▋   | 6668/10000 [01:27<00:44, 75.52 permutations/s]
Permutation test:  67%|██████▋   | 6677/10000 [01:27<00:45, 73.17 permutations/s]
Permutation test:  67%|██████▋   | 6685/10000 [01:27<00:45, 72.63 permutations/s]
Permutation test:  67%|██████▋   | 6693/10000 [01:27<00:49, 66.75 permutations/s]
Permutation test:  67%|██████▋   | 6703/10000 [01:27<00:47, 69.57 permutations/s]
Permutation test:  67%|██████▋   | 6711/10000 [01:28<00:48, 67.26 permutations/s]
Permutation test:  67%|██████▋   | 6718/10000 [01:28<00:50, 64.99 permutations/s]
Permutation test:  67%|██████▋   | 6727/10000 [01:28<00:46, 71.07 permutations/s]
Permutation test:  67%|██████▋   | 6735/10000 [01:28<00:47, 69.12 permutations/s]
Permutation test:  67%|██████▋   | 6746/10000 [01:28<00:40, 79.81 permutations/s]
Permutation test:  68%|██████▊   | 6755/10000 [01:28<00:40, 79.96 permutations/s]
Permutation test:  68%|██████▊   | 6764/10000 [01:28<00:41, 78.42 permutations/s]
Permutation test:  68%|██████▊   | 6772/10000 [01:28<00:44, 73.30 permutations/s]
Permutation test:  68%|██████▊   | 6781/10000 [01:29<00:44, 71.81 permutations/s]
Permutation test:  68%|██████▊   | 6791/10000 [01:29<00:41, 78.08 permutations/s]
Permutation test:  68%|██████▊   | 6801/10000 [01:29<00:38, 82.16 permutations/s]
Permutation test:  68%|██████▊   | 6811/10000 [01:29<00:37, 86.15 permutations/s]
Permutation test:  68%|██████▊   | 6820/10000 [01:29<00:38, 83.02 permutations/s]
Permutation test:  68%|██████▊   | 6829/10000 [01:29<00:42, 74.85 permutations/s]
Permutation test:  68%|██████▊   | 6837/10000 [01:29<00:46, 68.52 permutations/s]
Permutation test:  68%|██████▊   | 6846/10000 [01:29<00:46, 68.38 permutations/s]
Permutation test:  69%|██████▊   | 6856/10000 [01:29<00:44, 71.26 permutations/s]
Permutation test:  69%|██████▊   | 6864/10000 [01:30<00:44, 70.62 permutations/s]
Permutation test:  69%|██████▊   | 6872/10000 [01:30<00:44, 70.16 permutations/s]
Permutation test:  69%|██████▉   | 6880/10000 [01:30<00:46, 67.77 permutations/s]
Permutation test:  69%|██████▉   | 6890/10000 [01:30<00:41, 74.64 permutations/s]
Permutation test:  69%|██████▉   | 6898/10000 [01:30<00:41, 74.37 permutations/s]
Permutation test:  69%|██████▉   | 6907/10000 [01:30<00:39, 78.40 permutations/s]
Permutation test:  69%|██████▉   | 6915/10000 [01:30<00:40, 75.44 permutations/s]
Permutation test:  69%|██████▉   | 6926/10000 [01:30<00:39, 77.50 permutations/s]
Permutation test:  69%|██████▉   | 6934/10000 [01:31<00:40, 75.76 permutations/s]
Permutation test:  69%|██████▉   | 6942/10000 [01:31<00:40, 75.17 permutations/s]
Permutation test:  70%|██████▉   | 6952/10000 [01:31<00:37, 81.90 permutations/s]
Permutation test:  70%|██████▉   | 6961/10000 [01:31<00:39, 77.14 permutations/s]
Permutation test:  70%|██████▉   | 6969/10000 [01:31<00:39, 77.16 permutations/s]
Permutation test:  70%|██████▉   | 6977/10000 [01:31<00:42, 70.77 permutations/s]
Permutation test:  70%|██████▉   | 6985/10000 [01:31<00:42, 70.39 permutations/s]
Permutation test:  70%|██████▉   | 6993/10000 [01:31<00:43, 69.23 permutations/s]
Permutation test:  70%|███████   | 7000/10000 [01:31<00:47, 62.95 permutations/s]
Permutation test:  70%|███████   | 7008/10000 [01:32<00:46, 64.66 permutations/s]
Permutation test:  70%|███████   | 7017/10000 [01:32<00:42, 69.58 permutations/s]
Permutation test:  70%|███████   | 7025/10000 [01:32<00:42, 70.81 permutations/s]
Permutation test:  70%|███████   | 7033/10000 [01:32<00:43, 67.57 permutations/s]
Permutation test:  70%|███████   | 7041/10000 [01:32<00:44, 66.73 permutations/s]
Permutation test:  70%|███████   | 7050/10000 [01:32<00:43, 68.53 permutations/s]
Permutation test:  71%|███████   | 7057/10000 [01:32<00:43, 68.19 permutations/s]
Permutation test:  71%|███████   | 7068/10000 [01:32<00:39, 73.88 permutations/s]
Permutation test:  71%|███████   | 7076/10000 [01:33<00:40, 72.95 permutations/s]
Permutation test:  71%|███████   | 7085/10000 [01:33<00:41, 70.93 permutations/s]
Permutation test:  71%|███████   | 7093/10000 [01:33<00:41, 70.84 permutations/s]
Permutation test:  71%|███████   | 7104/10000 [01:33<00:36, 80.31 permutations/s]
Permutation test:  71%|███████   | 7113/10000 [01:33<00:37, 77.91 permutations/s]
Permutation test:  71%|███████   | 7121/10000 [01:33<00:38, 75.21 permutations/s]
Permutation test:  71%|███████▏  | 7129/10000 [01:33<00:41, 68.64 permutations/s]
Permutation test:  71%|███████▏  | 7136/10000 [01:33<00:42, 67.42 permutations/s]
Permutation test:  71%|███████▏  | 7146/10000 [01:34<00:41, 69.59 permutations/s]
Permutation test:  72%|███████▏  | 7156/10000 [01:34<00:36, 77.16 permutations/s]
Permutation test:  72%|███████▏  | 7168/10000 [01:34<00:33, 85.02 permutations/s]
Permutation test:  72%|███████▏  | 7179/10000 [01:34<00:32, 85.51 permutations/s]
Permutation test:  72%|███████▏  | 7194/10000 [01:34<00:27, 102.00 permutations/s]
Permutation test:  72%|███████▏  | 7205/10000 [01:34<00:28, 99.02 permutations/s]
Permutation test:  72%|███████▏  | 7217/10000 [01:34<00:27, 101.39 permutations/s]
Permutation test:  72%|███████▏  | 7228/10000 [01:34<00:29, 95.40 permutations/s]
Permutation test:  72%|███████▏  | 7239/10000 [01:34<00:29, 92.67 permutations/s]
Permutation test:  72%|███████▏  | 7249/10000 [01:35<00:32, 84.69 permutations/s]
Permutation test:  73%|███████▎  | 7258/10000 [01:35<00:32, 84.27 permutations/s]
Permutation test:  73%|███████▎  | 7267/10000 [01:35<00:33, 81.59 permutations/s]
Permutation test:  73%|███████▎  | 7276/10000 [01:35<00:32, 83.10 permutations/s]
Permutation test:  73%|███████▎  | 7285/10000 [01:35<00:38, 69.91 permutations/s]
Permutation test:  73%|███████▎  | 7293/10000 [01:35<00:38, 70.29 permutations/s]
Permutation test:  73%|███████▎  | 7301/10000 [01:35<00:39, 67.96 permutations/s]
Permutation test:  73%|███████▎  | 7308/10000 [01:35<00:40, 66.33 permutations/s]
Permutation test:  73%|███████▎  | 7316/10000 [01:36<00:41, 65.30 permutations/s]
Permutation test:  73%|███████▎  | 7324/10000 [01:36<00:41, 63.84 permutations/s]
Permutation test:  73%|███████▎  | 7331/10000 [01:36<00:41, 64.10 permutations/s]
Permutation test:  73%|███████▎  | 7339/10000 [01:36<00:40, 66.00 permutations/s]
Permutation test:  73%|███████▎  | 7348/10000 [01:36<00:37, 70.89 permutations/s]
Permutation test:  74%|███████▎  | 7357/10000 [01:36<00:35, 75.19 permutations/s]
Permutation test:  74%|███████▎  | 7365/10000 [01:36<00:36, 71.81 permutations/s]
Permutation test:  74%|███████▍  | 7376/10000 [01:36<00:32, 81.22 permutations/s]
Permutation test:  74%|███████▍  | 7385/10000 [01:37<00:32, 80.32 permutations/s]
Permutation test:  74%|███████▍  | 7394/10000 [01:37<00:33, 76.86 permutations/s]
Permutation test:  74%|███████▍  | 7402/10000 [01:37<00:35, 73.94 permutations/s]
Permutation test:  74%|███████▍  | 7410/10000 [01:37<00:35, 73.01 permutations/s]
Permutation test:  74%|███████▍  | 7418/10000 [01:37<00:38, 67.11 permutations/s]
Permutation test:  74%|███████▍  | 7426/10000 [01:37<00:36, 69.57 permutations/s]
Permutation test:  74%|███████▍  | 7434/10000 [01:37<00:38, 66.18 permutations/s]
Permutation test:  74%|███████▍  | 7441/10000 [01:37<00:39, 65.07 permutations/s]
Permutation test:  74%|███████▍  | 7448/10000 [01:37<00:40, 63.16 permutations/s]
Permutation test:  75%|███████▍  | 7458/10000 [01:38<00:38, 66.55 permutations/s]
Permutation test:  75%|███████▍  | 7465/10000 [01:38<00:38, 66.59 permutations/s]
Permutation test:  75%|███████▍  | 7473/10000 [01:38<00:36, 69.38 permutations/s]
Permutation test:  75%|███████▍  | 7481/10000 [01:38<00:35, 69.99 permutations/s]
Permutation test:  75%|███████▍  | 7489/10000 [01:38<00:34, 72.72 permutations/s]
Permutation test:  75%|███████▍  | 7497/10000 [01:38<00:33, 73.85 permutations/s]
Permutation test:  75%|███████▌  | 7505/10000 [01:38<00:35, 70.83 permutations/s]
Permutation test:  75%|███████▌  | 7514/10000 [01:38<00:33, 75.30 permutations/s]
Permutation test:  75%|███████▌  | 7522/10000 [01:38<00:33, 73.33 permutations/s]
Permutation test:  75%|███████▌  | 7530/10000 [01:39<00:34, 70.68 permutations/s]
Permutation test:  75%|███████▌  | 7539/10000 [01:39<00:34, 72.12 permutations/s]
Permutation test:  75%|███████▌  | 7549/10000 [01:39<00:33, 73.21 permutations/s]
Permutation test:  76%|███████▌  | 7557/10000 [01:39<00:34, 70.97 permutations/s]
Permutation test:  76%|███████▌  | 7566/10000 [01:39<00:34, 70.95 permutations/s]
Permutation test:  76%|███████▌  | 7574/10000 [01:39<00:36, 65.82 permutations/s]
Permutation test:  76%|███████▌  | 7581/10000 [01:39<00:36, 66.86 permutations/s]
Permutation test:  76%|███████▌  | 7589/10000 [01:39<00:36, 66.88 permutations/s]
Permutation test:  76%|███████▌  | 7596/10000 [01:40<00:36, 65.49 permutations/s]
Permutation test:  76%|███████▌  | 7607/10000 [01:40<00:32, 73.12 permutations/s]
Permutation test:  76%|███████▌  | 7617/10000 [01:40<00:31, 76.70 permutations/s]
Permutation test:  76%|███████▋  | 7627/10000 [01:40<00:29, 81.80 permutations/s]
Permutation test:  76%|███████▋  | 7638/10000 [01:40<00:26, 89.45 permutations/s]
Permutation test:  76%|███████▋  | 7648/10000 [01:40<00:28, 83.93 permutations/s]
Permutation test:  77%|███████▋  | 7657/10000 [01:40<00:29, 78.83 permutations/s]
Permutation test:  77%|███████▋  | 7666/10000 [01:40<00:28, 80.92 permutations/s]
Permutation test:  77%|███████▋  | 7675/10000 [01:41<00:32, 70.66 permutations/s]
Permutation test:  77%|███████▋  | 7685/10000 [01:41<00:30, 76.93 permutations/s]
Permutation test:  77%|███████▋  | 7694/10000 [01:41<00:29, 77.09 permutations/s]
Permutation test:  77%|███████▋  | 7704/10000 [01:41<00:28, 81.40 permutations/s]
Permutation test:  77%|███████▋  | 7713/10000 [01:41<00:28, 79.42 permutations/s]
Permutation test:  77%|███████▋  | 7722/10000 [01:41<00:31, 72.08 permutations/s]
Permutation test:  77%|███████▋  | 7730/10000 [01:41<00:32, 70.14 permutations/s]
Permutation test:  77%|███████▋  | 7738/10000 [01:41<00:34, 65.39 permutations/s]
Permutation test:  77%|███████▋  | 7745/10000 [01:42<00:35, 62.85 permutations/s]
Permutation test:  78%|███████▊  | 7752/10000 [01:42<00:35, 63.74 permutations/s]
Permutation test:  78%|███████▊  | 7760/10000 [01:42<00:34, 64.23 permutations/s]
Permutation test:  78%|███████▊  | 7767/10000 [01:42<00:36, 60.53 permutations/s]
Permutation test:  78%|███████▊  | 7778/10000 [01:42<00:31, 71.67 permutations/s]
Permutation test:  78%|███████▊  | 7787/10000 [01:42<00:29, 75.68 permutations/s]
Permutation test:  78%|███████▊  | 7795/10000 [01:42<00:30, 71.64 permutations/s]
Permutation test:  78%|███████▊  | 7803/10000 [01:42<00:30, 71.48 permutations/s]
Permutation test:  78%|███████▊  | 7811/10000 [01:42<00:30, 72.86 permutations/s]
Permutation test:  78%|███████▊  | 7819/10000 [01:43<00:30, 72.36 permutations/s]
Permutation test:  78%|███████▊  | 7827/10000 [01:43<00:30, 70.90 permutations/s]
Permutation test:  78%|███████▊  | 7837/10000 [01:43<00:27, 77.73 permutations/s]
Permutation test:  78%|███████▊  | 7846/10000 [01:43<00:28, 76.26 permutations/s]
Permutation test:  79%|███████▊  | 7854/10000 [01:43<00:28, 76.24 permutations/s]
Permutation test:  79%|███████▊  | 7862/10000 [01:43<00:30, 69.75 permutations/s]
Permutation test:  79%|███████▊  | 7871/10000 [01:43<00:30, 69.29 permutations/s]
Permutation test:  79%|███████▉  | 7880/10000 [01:43<00:28, 74.30 permutations/s]
Permutation test:  79%|███████▉  | 7889/10000 [01:44<00:27, 76.09 permutations/s]
Permutation test:  79%|███████▉  | 7897/10000 [01:44<00:28, 74.45 permutations/s]
Permutation test:  79%|███████▉  | 7905/10000 [01:44<00:30, 68.27 permutations/s]
Permutation test:  79%|███████▉  | 7912/10000 [01:44<00:31, 66.49 permutations/s]
Permutation test:  79%|███████▉  | 7924/10000 [01:44<00:25, 80.58 permutations/s]
Permutation test:  79%|███████▉  | 7934/10000 [01:44<00:24, 85.00 permutations/s]
Permutation test:  79%|███████▉  | 7943/10000 [01:44<00:24, 82.66 permutations/s]
Permutation test:  80%|███████▉  | 7952/10000 [01:44<00:25, 78.83 permutations/s]
Permutation test:  80%|███████▉  | 7961/10000 [01:44<00:27, 73.19 permutations/s]
Permutation test:  80%|███████▉  | 7970/10000 [01:45<00:27, 74.34 permutations/s]
Permutation test:  80%|███████▉  | 7979/10000 [01:45<00:27, 74.64 permutations/s]
Permutation test:  80%|███████▉  | 7987/10000 [01:45<00:27, 72.80 permutations/s]
Permutation test:  80%|███████▉  | 7995/10000 [01:45<00:27, 71.63 permutations/s]
Permutation test:  80%|████████  | 8003/10000 [01:45<00:28, 69.56 permutations/s]
Permutation test:  80%|████████  | 8011/10000 [01:45<00:29, 68.12 permutations/s]
Permutation test:  80%|████████  | 8018/10000 [01:45<00:30, 65.20 permutations/s]
Permutation test:  80%|████████  | 8026/10000 [01:45<00:30, 65.00 permutations/s]
Permutation test:  80%|████████  | 8036/10000 [01:46<00:28, 68.40 permutations/s]
Permutation test:  80%|████████  | 8045/10000 [01:46<00:27, 71.02 permutations/s]
Permutation test:  81%|████████  | 8053/10000 [01:46<00:28, 69.05 permutations/s]
Permutation test:  81%|████████  | 8063/10000 [01:46<00:25, 76.06 permutations/s]
Permutation test:  81%|████████  | 8071/10000 [01:46<00:26, 73.11 permutations/s]
Permutation test:  81%|████████  | 8079/10000 [01:46<00:26, 72.04 permutations/s]
Permutation test:  81%|████████  | 8087/10000 [01:46<00:26, 73.09 permutations/s]
Permutation test:  81%|████████  | 8095/10000 [01:46<00:25, 73.78 permutations/s]
Permutation test:  81%|████████  | 8103/10000 [01:46<00:25, 75.50 permutations/s]
Permutation test:  81%|████████  | 8111/10000 [01:47<00:26, 72.52 permutations/s]
Permutation test:  81%|████████  | 8119/10000 [01:47<00:25, 73.16 permutations/s]
Permutation test:  81%|████████▏ | 8127/10000 [01:47<00:24, 74.93 permutations/s]
Permutation test:  81%|████████▏ | 8135/10000 [01:47<00:24, 75.51 permutations/s]
Permutation test:  81%|████████▏ | 8146/10000 [01:47<00:22, 84.25 permutations/s]
Permutation test:  82%|████████▏ | 8155/10000 [01:47<00:22, 80.43 permutations/s]
Permutation test:  82%|████████▏ | 8164/10000 [01:47<00:25, 70.72 permutations/s]
Permutation test:  82%|████████▏ | 8172/10000 [01:47<00:26, 68.24 permutations/s]
Permutation test:  82%|████████▏ | 8180/10000 [01:48<00:27, 66.46 permutations/s]
Permutation test:  82%|████████▏ | 8187/10000 [01:48<00:28, 64.70 permutations/s]
Permutation test:  82%|████████▏ | 8194/10000 [01:48<00:28, 63.56 permutations/s]
Permutation test:  82%|████████▏ | 8205/10000 [01:48<00:25, 69.84 permutations/s]
Permutation test:  82%|████████▏ | 8214/10000 [01:48<00:24, 74.03 permutations/s]
Permutation test:  82%|████████▏ | 8226/10000 [01:48<00:20, 86.07 permutations/s]
Permutation test:  82%|████████▏ | 8235/10000 [01:48<00:22, 78.87 permutations/s]
Permutation test:  82%|████████▏ | 8244/10000 [01:48<00:22, 78.40 permutations/s]
Permutation test:  83%|████████▎ | 8252/10000 [01:49<00:24, 70.04 permutations/s]
Permutation test:  83%|████████▎ | 8260/10000 [01:49<00:24, 70.86 permutations/s]
Permutation test:  83%|████████▎ | 8268/10000 [01:49<00:24, 71.80 permutations/s]
Permutation test:  83%|████████▎ | 8276/10000 [01:49<00:24, 69.51 permutations/s]
Permutation test:  83%|████████▎ | 8284/10000 [01:49<00:24, 68.86 permutations/s]
Permutation test:  83%|████████▎ | 8291/10000 [01:49<00:25, 66.87 permutations/s]
Permutation test:  83%|████████▎ | 8298/10000 [01:49<00:26, 64.44 permutations/s]
Permutation test:  83%|████████▎ | 8307/10000 [01:49<00:23, 71.05 permutations/s]
Permutation test:  83%|████████▎ | 8315/10000 [01:49<00:23, 71.20 permutations/s]
Permutation test:  83%|████████▎ | 8323/10000 [01:50<00:24, 69.74 permutations/s]
Permutation test:  83%|████████▎ | 8331/10000 [01:50<00:26, 62.34 permutations/s]
Permutation test:  83%|████████▎ | 8342/10000 [01:50<00:24, 69.01 permutations/s]
Permutation test:  84%|████████▎ | 8351/10000 [01:50<00:23, 71.19 permutations/s]
Permutation test:  84%|████████▎ | 8362/10000 [01:50<00:21, 75.84 permutations/s]
Permutation test:  84%|████████▎ | 8371/10000 [01:50<00:20, 79.25 permutations/s]
Permutation test:  84%|████████▍ | 8380/10000 [01:50<00:20, 78.72 permutations/s]
Permutation test:  84%|████████▍ | 8388/10000 [01:50<00:21, 75.80 permutations/s]
Permutation test:  84%|████████▍ | 8397/10000 [01:51<00:20, 78.78 permutations/s]
Permutation test:  84%|████████▍ | 8405/10000 [01:51<00:20, 76.69 permutations/s]
Permutation test:  84%|████████▍ | 8413/10000 [01:51<00:21, 73.24 permutations/s]
Permutation test:  84%|████████▍ | 8422/10000 [01:51<00:21, 72.71 permutations/s]
Permutation test:  84%|████████▍ | 8430/10000 [01:51<00:21, 74.46 permutations/s]
Permutation test:  84%|████████▍ | 8438/10000 [01:51<00:21, 72.03 permutations/s]
Permutation test:  84%|████████▍ | 8446/10000 [01:51<00:22, 70.34 permutations/s]
Permutation test:  85%|████████▍ | 8454/10000 [01:51<00:22, 68.76 permutations/s]
Permutation test:  85%|████████▍ | 8461/10000 [01:51<00:23, 66.90 permutations/s]
Permutation test:  85%|████████▍ | 8468/10000 [01:52<00:23, 64.94 permutations/s]
Permutation test:  85%|████████▍ | 8475/10000 [01:52<00:25, 59.93 permutations/s]
Permutation test:  85%|████████▍ | 8483/10000 [01:52<00:23, 64.19 permutations/s]
Permutation test:  85%|████████▍ | 8490/10000 [01:52<00:23, 65.17 permutations/s]
Permutation test:  85%|████████▍ | 8498/10000 [01:52<00:21, 68.31 permutations/s]
Permutation test:  85%|████████▌ | 8508/10000 [01:52<00:19, 76.36 permutations/s]
Permutation test:  85%|████████▌ | 8516/10000 [01:52<00:19, 74.22 permutations/s]
Permutation test:  85%|████████▌ | 8524/10000 [01:52<00:19, 74.01 permutations/s]
Permutation test:  85%|████████▌ | 8533/10000 [01:52<00:18, 78.44 permutations/s]
Permutation test:  85%|████████▌ | 8541/10000 [01:53<00:21, 67.87 permutations/s]
Permutation test:  85%|████████▌ | 8549/10000 [01:53<00:20, 70.61 permutations/s]
Permutation test:  86%|████████▌ | 8558/10000 [01:53<00:19, 75.62 permutations/s]
Permutation test:  86%|████████▌ | 8566/10000 [01:53<00:19, 75.32 permutations/s]
Permutation test:  86%|████████▌ | 8574/10000 [01:53<00:19, 74.83 permutations/s]
Permutation test:  86%|████████▌ | 8583/10000 [01:53<00:18, 77.39 permutations/s]
Permutation test:  86%|████████▌ | 8591/10000 [01:53<00:18, 77.27 permutations/s]
Permutation test:  86%|████████▌ | 8599/10000 [01:53<00:19, 73.19 permutations/s]
Permutation test:  86%|████████▌ | 8610/10000 [01:53<00:17, 80.70 permutations/s]
Permutation test:  86%|████████▌ | 8619/10000 [01:54<00:19, 71.39 permutations/s]
Permutation test:  86%|████████▋ | 8627/10000 [01:54<00:20, 68.11 permutations/s]
Permutation test:  86%|████████▋ | 8634/10000 [01:54<00:21, 64.08 permutations/s]
Permutation test:  86%|████████▋ | 8644/10000 [01:54<00:18, 72.82 permutations/s]
Permutation test:  87%|████████▋ | 8652/10000 [01:54<00:18, 72.49 permutations/s]
Permutation test:  87%|████████▋ | 8660/10000 [01:54<00:18, 71.56 permutations/s]
Permutation test:  87%|████████▋ | 8668/10000 [01:54<00:19, 68.74 permutations/s]
Permutation test:  87%|████████▋ | 8675/10000 [01:54<00:19, 68.95 permutations/s]
Permutation test:  87%|████████▋ | 8685/10000 [01:55<00:17, 76.50 permutations/s]
Permutation test:  87%|████████▋ | 8693/10000 [01:55<00:17, 72.63 permutations/s]
Permutation test:  87%|████████▋ | 8701/10000 [01:55<00:17, 72.47 permutations/s]
Permutation test:  87%|████████▋ | 8709/10000 [01:55<00:17, 72.74 permutations/s]
Permutation test:  87%|████████▋ | 8717/10000 [01:55<00:18, 68.31 permutations/s]
Permutation test:  87%|████████▋ | 8725/10000 [01:55<00:19, 66.53 permutations/s]
Permutation test:  87%|████████▋ | 8734/10000 [01:55<00:18, 70.24 permutations/s]
Permutation test:  87%|████████▋ | 8743/10000 [01:55<00:16, 74.35 permutations/s]
Permutation test:  88%|████████▊ | 8751/10000 [01:56<00:18, 69.24 permutations/s]
Permutation test:  88%|████████▊ | 8759/10000 [01:56<00:17, 70.05 permutations/s]
Permutation test:  88%|████████▊ | 8770/10000 [01:56<00:15, 79.61 permutations/s]
Permutation test:  88%|████████▊ | 8779/10000 [01:56<00:17, 70.36 permutations/s]
Permutation test:  88%|████████▊ | 8787/10000 [01:56<00:16, 71.79 permutations/s]
Permutation test:  88%|████████▊ | 8796/10000 [01:56<00:16, 72.43 permutations/s]
Permutation test:  88%|████████▊ | 8804/10000 [01:56<00:16, 72.54 permutations/s]
Permutation test:  88%|████████▊ | 8814/10000 [01:56<00:15, 76.02 permutations/s]
Permutation test:  88%|████████▊ | 8823/10000 [01:56<00:14, 79.50 permutations/s]
Permutation test:  88%|████████▊ | 8832/10000 [01:57<00:15, 77.32 permutations/s]
Permutation test:  88%|████████▊ | 8840/10000 [01:57<00:14, 77.40 permutations/s]
Permutation test:  88%|████████▊ | 8848/10000 [01:57<00:15, 76.21 permutations/s]
Permutation test:  89%|████████▊ | 8856/10000 [01:57<00:14, 76.77 permutations/s]
Permutation test:  89%|████████▊ | 8864/10000 [01:57<00:15, 74.18 permutations/s]
Permutation test:  89%|████████▊ | 8872/10000 [01:57<00:16, 67.36 permutations/s]
Permutation test:  89%|████████▉ | 8879/10000 [01:57<00:16, 66.63 permutations/s]
Permutation test:  89%|████████▉ | 8886/10000 [01:57<00:17, 64.79 permutations/s]
Permutation test:  89%|████████▉ | 8893/10000 [01:57<00:17, 61.73 permutations/s]
Permutation test:  89%|████████▉ | 8900/10000 [01:58<00:17, 61.73 permutations/s]
Permutation test:  89%|████████▉ | 8907/10000 [01:58<00:18, 59.70 permutations/s]
Permutation test:  89%|████████▉ | 8914/10000 [01:58<00:17, 60.50 permutations/s]
Permutation test:  89%|████████▉ | 8921/10000 [01:58<00:17, 62.88 permutations/s]
Permutation test:  89%|████████▉ | 8931/10000 [01:58<00:15, 70.80 permutations/s]
Permutation test:  89%|████████▉ | 8940/10000 [01:58<00:13, 75.96 permutations/s]
Permutation test:  89%|████████▉ | 8948/10000 [01:58<00:15, 69.49 permutations/s]
Permutation test:  90%|████████▉ | 8956/10000 [01:58<00:14, 72.14 permutations/s]
Permutation test:  90%|████████▉ | 8966/10000 [01:59<00:13, 78.88 permutations/s]
Permutation test:  90%|████████▉ | 8975/10000 [01:59<00:13, 78.54 permutations/s]
Permutation test:  90%|████████▉ | 8983/10000 [01:59<00:13, 74.77 permutations/s]
Permutation test:  90%|████████▉ | 8991/10000 [01:59<00:13, 73.85 permutations/s]
Permutation test:  90%|████████▉ | 8999/10000 [01:59<00:13, 74.76 permutations/s]
Permutation test:  90%|█████████ | 9007/10000 [01:59<00:13, 76.17 permutations/s]
Permutation test:  90%|█████████ | 9016/10000 [01:59<00:13, 73.55 permutations/s]
Permutation test:  90%|█████████ | 9024/10000 [01:59<00:13, 72.73 permutations/s]
Permutation test:  90%|█████████ | 9032/10000 [01:59<00:13, 74.37 permutations/s]
Permutation test:  90%|█████████ | 9040/10000 [02:00<00:12, 73.96 permutations/s]
Permutation test:  90%|█████████ | 9049/10000 [02:00<00:12, 73.58 permutations/s]
Permutation test:  91%|█████████ | 9057/10000 [02:00<00:14, 64.74 permutations/s]
Permutation test:  91%|█████████ | 9064/10000 [02:00<00:14, 63.95 permutations/s]
Permutation test:  91%|█████████ | 9074/10000 [02:00<00:13, 70.86 permutations/s]
Permutation test:  91%|█████████ | 9084/10000 [02:00<00:12, 72.81 permutations/s]
Permutation test:  91%|█████████ | 9092/10000 [02:00<00:12, 73.72 permutations/s]
Permutation test:  91%|█████████ | 9100/10000 [02:00<00:12, 73.34 permutations/s]
Permutation test:  91%|█████████ | 9109/10000 [02:00<00:11, 77.47 permutations/s]
Permutation test:  91%|█████████ | 9117/10000 [02:01<00:11, 74.37 permutations/s]
Permutation test:  91%|█████████▏| 9125/10000 [02:01<00:11, 73.92 permutations/s]
Permutation test:  91%|█████████▏| 9133/10000 [02:01<00:11, 73.25 permutations/s]
Permutation test:  91%|█████████▏| 9141/10000 [02:01<00:12, 71.18 permutations/s]
Permutation test:  92%|█████████▏| 9150/10000 [02:01<00:11, 74.13 permutations/s]
Permutation test:  92%|█████████▏| 9159/10000 [02:01<00:10, 78.45 permutations/s]
Permutation test:  92%|█████████▏| 9167/10000 [02:01<00:10, 76.09 permutations/s]
Permutation test:  92%|█████████▏| 9176/10000 [02:01<00:10, 79.31 permutations/s]
Permutation test:  92%|█████████▏| 9184/10000 [02:01<00:10, 79.31 permutations/s]
Permutation test:  92%|█████████▏| 9192/10000 [02:02<00:10, 79.46 permutations/s]
Permutation test:  92%|█████████▏| 9200/10000 [02:02<00:10, 72.80 permutations/s]
Permutation test:  92%|█████████▏| 9208/10000 [02:02<00:12, 65.61 permutations/s]
Permutation test:  92%|█████████▏| 9215/10000 [02:02<00:13, 59.42 permutations/s]
Permutation test:  92%|█████████▏| 9224/10000 [02:02<00:11, 65.55 permutations/s]
Permutation test:  92%|█████████▏| 9235/10000 [02:02<00:09, 76.86 permutations/s]
Permutation test:  92%|█████████▏| 9244/10000 [02:02<00:10, 74.74 permutations/s]
Permutation test:  93%|█████████▎| 9252/10000 [02:02<00:10, 70.98 permutations/s]
Permutation test:  93%|█████████▎| 9260/10000 [02:03<00:10, 72.52 permutations/s]
Permutation test:  93%|█████████▎| 9268/10000 [02:03<00:10, 67.98 permutations/s]
Permutation test:  93%|█████████▎| 9275/10000 [02:03<00:10, 66.46 permutations/s]
Permutation test:  93%|█████████▎| 9282/10000 [02:03<00:10, 65.37 permutations/s]
Permutation test:  93%|█████████▎| 9292/10000 [02:03<00:09, 73.03 permutations/s]
Permutation test:  93%|█████████▎| 9300/10000 [02:03<00:09, 71.90 permutations/s]
Permutation test:  93%|█████████▎| 9308/10000 [02:03<00:10, 66.72 permutations/s]
Permutation test:  93%|█████████▎| 9315/10000 [02:03<00:10, 65.05 permutations/s]
Permutation test:  93%|█████████▎| 9322/10000 [02:04<00:10, 65.61 permutations/s]
Permutation test:  93%|█████████▎| 9330/10000 [02:04<00:10, 64.65 permutations/s]
Permutation test:  93%|█████████▎| 9339/10000 [02:04<00:09, 71.17 permutations/s]
Permutation test:  93%|█████████▎| 9348/10000 [02:04<00:08, 75.50 permutations/s]
Permutation test:  94%|█████████▎| 9356/10000 [02:04<00:09, 69.05 permutations/s]
Permutation test:  94%|█████████▎| 9365/10000 [02:04<00:08, 73.80 permutations/s]
Permutation test:  94%|█████████▎| 9373/10000 [02:04<00:09, 69.44 permutations/s]
Permutation test:  94%|█████████▍| 9381/10000 [02:04<00:09, 66.79 permutations/s]
Permutation test:  94%|█████████▍| 9388/10000 [02:04<00:09, 64.79 permutations/s]
Permutation test:  94%|█████████▍| 9397/10000 [02:05<00:08, 70.62 permutations/s]
Permutation test:  94%|█████████▍| 9405/10000 [02:05<00:09, 64.92 permutations/s]
Permutation test:  94%|█████████▍| 9413/10000 [02:05<00:08, 68.59 permutations/s]
Permutation test:  94%|█████████▍| 9421/10000 [02:05<00:08, 65.52 permutations/s]
Permutation test:  94%|█████████▍| 9429/10000 [02:05<00:08, 69.23 permutations/s]
Permutation test:  94%|█████████▍| 9437/10000 [02:05<00:08, 65.61 permutations/s]
Permutation test:  94%|█████████▍| 9445/10000 [02:05<00:08, 68.12 permutations/s]
Permutation test:  95%|█████████▍| 9455/10000 [02:05<00:07, 70.60 permutations/s]
Permutation test:  95%|█████████▍| 9464/10000 [02:06<00:07, 74.67 permutations/s]
Permutation test:  95%|█████████▍| 9473/10000 [02:06<00:06, 77.06 permutations/s]
Permutation test:  95%|█████████▍| 9481/10000 [02:06<00:07, 68.93 permutations/s]
Permutation test:  95%|█████████▍| 9489/10000 [02:06<00:07, 70.95 permutations/s]
Permutation test:  95%|█████████▍| 9498/10000 [02:06<00:06, 73.92 permutations/s]
Permutation test:  95%|█████████▌| 9509/10000 [02:06<00:05, 83.40 permutations/s]
Permutation test:  95%|█████████▌| 9519/10000 [02:06<00:05, 85.57 permutations/s]
Permutation test:  95%|█████████▌| 9528/10000 [02:06<00:06, 76.45 permutations/s]
Permutation test:  95%|█████████▌| 9537/10000 [02:06<00:05, 78.97 permutations/s]
Permutation test:  95%|█████████▌| 9546/10000 [02:07<00:06, 74.71 permutations/s]
Permutation test:  96%|█████████▌| 9554/10000 [02:07<00:06, 70.17 permutations/s]
Permutation test:  96%|█████████▌| 9562/10000 [02:07<00:06, 70.49 permutations/s]
Permutation test:  96%|█████████▌| 9570/10000 [02:07<00:06, 66.96 permutations/s]
Permutation test:  96%|█████████▌| 9581/10000 [02:07<00:05, 76.94 permutations/s]
Permutation test:  96%|█████████▌| 9589/10000 [02:07<00:05, 74.80 permutations/s]
Permutation test:  96%|█████████▌| 9597/10000 [02:07<00:05, 67.39 permutations/s]
Permutation test:  96%|█████████▌| 9606/10000 [02:07<00:05, 67.79 permutations/s]
Permutation test:  96%|█████████▌| 9613/10000 [02:08<00:05, 67.51 permutations/s]
Permutation test:  96%|█████████▌| 9620/10000 [02:08<00:05, 66.74 permutations/s]
Permutation test:  96%|█████████▋| 9627/10000 [02:08<00:05, 66.90 permutations/s]
Permutation test:  96%|█████████▋| 9635/10000 [02:08<00:05, 69.01 permutations/s]
Permutation test:  96%|█████████▋| 9644/10000 [02:08<00:04, 72.38 permutations/s]
Permutation test:  97%|█████████▋| 9653/10000 [02:08<00:04, 74.85 permutations/s]
Permutation test:  97%|█████████▋| 9661/10000 [02:08<00:04, 72.98 permutations/s]
Permutation test:  97%|█████████▋| 9669/10000 [02:08<00:04, 67.49 permutations/s]
Permutation test:  97%|█████████▋| 9678/10000 [02:08<00:04, 72.60 permutations/s]
Permutation test:  97%|█████████▋| 9686/10000 [02:09<00:04, 72.16 permutations/s]
Permutation test:  97%|█████████▋| 9694/10000 [02:09<00:04, 69.42 permutations/s]
Permutation test:  97%|█████████▋| 9703/10000 [02:09<00:03, 74.76 permutations/s]
Permutation test:  97%|█████████▋| 9715/10000 [02:09<00:03, 86.03 permutations/s]
Permutation test:  97%|█████████▋| 9724/10000 [02:09<00:03, 79.40 permutations/s]
Permutation test:  97%|█████████▋| 9736/10000 [02:09<00:03, 87.40 permutations/s]
Permutation test:  97%|█████████▋| 9745/10000 [02:09<00:03, 78.53 permutations/s]
Permutation test:  98%|█████████▊| 9756/10000 [02:09<00:02, 84.93 permutations/s]
Permutation test:  98%|█████████▊| 9765/10000 [02:10<00:03, 76.55 permutations/s]
Permutation test:  98%|█████████▊| 9773/10000 [02:10<00:03, 75.12 permutations/s]
Permutation test:  98%|█████████▊| 9783/10000 [02:10<00:02, 78.36 permutations/s]
Permutation test:  98%|█████████▊| 9791/10000 [02:10<00:02, 75.63 permutations/s]
Permutation test:  98%|█████████▊| 9800/10000 [02:10<00:02, 79.25 permutations/s]
Permutation test:  98%|█████████▊| 9809/10000 [02:10<00:02, 75.86 permutations/s]
Permutation test:  98%|█████████▊| 9817/10000 [02:10<00:02, 76.82 permutations/s]
Permutation test:  98%|█████████▊| 9825/10000 [02:10<00:02, 71.80 permutations/s]
Permutation test:  98%|█████████▊| 9834/10000 [02:11<00:02, 70.44 permutations/s]
Permutation test:  98%|█████████▊| 9842/10000 [02:11<00:02, 71.45 permutations/s]
Permutation test:  99%|█████████▊| 9851/10000 [02:11<00:02, 71.76 permutations/s]
Permutation test:  99%|█████████▊| 9860/10000 [02:11<00:01, 75.65 permutations/s]
Permutation test:  99%|█████████▊| 9868/10000 [02:11<00:01, 74.31 permutations/s]
Permutation test:  99%|█████████▉| 9876/10000 [02:11<00:01, 72.92 permutations/s]
Permutation test:  99%|█████████▉| 9886/10000 [02:11<00:01, 75.37 permutations/s]
Permutation test:  99%|█████████▉| 9896/10000 [02:11<00:01, 78.52 permutations/s]
Permutation test:  99%|█████████▉| 9905/10000 [02:11<00:01, 81.35 permutations/s]
Permutation test:  99%|█████████▉| 9914/10000 [02:12<00:01, 74.20 permutations/s]
Permutation test:  99%|█████████▉| 9922/10000 [02:12<00:01, 75.46 permutations/s]
Permutation test:  99%|█████████▉| 9934/10000 [02:12<00:00, 85.90 permutations/s]
Permutation test:  99%|█████████▉| 9946/10000 [02:12<00:00, 88.46 permutations/s]
Permutation test: 100%|█████████▉| 9956/10000 [02:12<00:00, 90.63 permutations/s]
Permutation test: 100%|█████████▉| 9966/10000 [02:12<00:00, 87.24 permutations/s]
Permutation test: 100%|█████████▉| 9976/10000 [02:12<00:00, 88.70 permutations/s]
Permutation test: 100%|█████████▉| 9987/10000 [02:12<00:00, 91.45 permutations/s]
Permutation test: 100%|██████████| 10000/10000 [02:12<00:00, 75.22 permutations/s]

A quick plot suggests an early effect related to n_chars around 130 ms, and a later effect of cloze around 400 ms:

p = plot.TopoButterfly(lm, t=0.130, axh=2, w=6)
sensor lm

Detailed plots of the two effects show that the cluster is quite variable due to noise in the data.

p = plot.TopoArray(lm.masked_parameter_map('n_chars'), t=[0.110, 0.130, 0.150], title='N Chars')
p = plot.TopoArray(lm.masked_parameter_map('cloze'), t=[0.380, 0.400, 0.420], title='Cloze')
  • N Chars
  • Cloze

To access some of the test results we need to know the index of different effects:

('intercept', 'n_chars', 'cloze')

Create a plot that shows the spatial cluster extent across time.

EFFECTS = [
    ('n_chars', (0.110, 0.150)),
    ('cloze', (0.380, 0.420)),
]

t_maps = []
for effect, time in EFFECTS:
    # t-maps are retrieved by effect name
    t = lm.t(effect).mean(time=time)
    # p-maps are stored in a list, so we need to know the index of te effect
    index = lm.effects.index(effect)
    # We are interested in the maximal spatial cluster extent, i.e., any sensor that is part of the cluster at any time
    p = lm.p[index].min(time=time)
    # Create a masked average t map
    t_av = t.mask(p > 0.05)
    t_maps.append(t_av)

p = plot.Topomap(t_maps, columns=2)
n_chars, cloze

Total running time of the script: (2 minutes 17.174 seconds)

Gallery generated by Sphinx-Gallery