Multiple regression

Multiple regression designs apply to at least two scenarios.

  • Analyzing a single subject’s data when trials are associated with one or multiple continuous variables.

  • Analyzing group data when subjects are associated with one or multiple individual difference variables.

Here the analysis is illustrated for a simulated dataset from a single subject. Group analysis works analogously, except that each case in the datatset would represent a different subject rather than a different trial.

For such group analysis, it is necessary to reduce each subject’s data to a single case first because multiple regression assumes a fixed effects model. Such designs are described under Two-stage test.

Simulated data

# sphinx_gallery_thumbnail_number = 2
from eelbrain import *


data = datasets.simulate_erp(snr=0.5)
data.head()
# cloze predictability n_chars
0 0.026139 low 4
1 0.99529 high 5
2 0.93062 high 3
3 0.82404 high 7
4 0.17041 low 4
5 0.18508 low 4
6 0.23345 low 4
7 0.80784 high 3
8 0.24979 low 7
9 0.26753 low 4
NDVars: eeg


The data represents 80 trials from a simulated word reading paradigm, where each word is associated with a word length (n_chars) and predictability (cloze).

p = plot.Scatter('cloze', 'n_chars', data=data, h=3)
sensor lm

Plot the average of each level on n_chars to illustrate the linear increase of the response around 130 ms with n_char.

p = plot.TopoButterfly('eeg', 'n_chars', data=data, t=.130, axh=2, w=6)
sensor lm

Multiple regression

Fit a multiple regression model. Estimate $p$-values using a cluster-based permuatation test, using a cluster-forming threshold of uncorrected $p$=.05 and 10,000 permutations (the default).

lm = testnd.LM('eeg', 'n_chars + cloze', data=data, tstart=0.050, tstop=0.500, pmin=0.05)
Permutation test:   0%|          | 0/10000 [00:00<?, ? permutations/s]
Permutation test:   0%|          | 7/10000 [00:00<02:29, 66.83 permutations/s]
Permutation test:   0%|          | 17/10000 [00:00<01:57, 84.98 permutations/s]
Permutation test:   0%|          | 27/10000 [00:00<01:48, 91.67 permutations/s]
Permutation test:   0%|          | 37/10000 [00:00<02:01, 82.09 permutations/s]
Permutation test:   0%|          | 48/10000 [00:00<01:54, 86.73 permutations/s]
Permutation test:   1%|          | 60/10000 [00:00<01:47, 92.35 permutations/s]
Permutation test:   1%|          | 70/10000 [00:00<01:47, 92.47 permutations/s]
Permutation test:   1%|          | 86/10000 [00:00<01:28, 112.04 permutations/s]
Permutation test:   1%|          | 98/10000 [00:01<01:33, 105.93 permutations/s]
Permutation test:   1%|          | 109/10000 [00:01<01:38, 100.17 permutations/s]
Permutation test:   1%|          | 122/10000 [00:01<01:35, 102.95 permutations/s]
Permutation test:   1%|▏         | 133/10000 [00:01<01:35, 103.42 permutations/s]
Permutation test:   1%|▏         | 144/10000 [00:01<01:37, 101.12 permutations/s]
Permutation test:   2%|▏         | 159/10000 [00:01<01:26, 114.23 permutations/s]
Permutation test:   2%|▏         | 172/10000 [00:01<01:23, 117.28 permutations/s]
Permutation test:   2%|▏         | 184/10000 [00:01<01:27, 112.58 permutations/s]
Permutation test:   2%|▏         | 196/10000 [00:01<01:33, 104.97 permutations/s]
Permutation test:   2%|▏         | 210/10000 [00:02<01:27, 111.44 permutations/s]
Permutation test:   2%|▏         | 230/10000 [00:02<01:20, 121.07 permutations/s]
Permutation test:   2%|▏         | 243/10000 [00:02<01:45, 92.17 permutations/s]
Permutation test:   3%|▎         | 254/10000 [00:02<01:51, 87.10 permutations/s]
Permutation test:   3%|▎         | 264/10000 [00:02<01:58, 81.92 permutations/s]
Permutation test:   3%|▎         | 278/10000 [00:02<01:43, 93.68 permutations/s]
Permutation test:   3%|▎         | 289/10000 [00:02<01:40, 96.50 permutations/s]
Permutation test:   3%|▎         | 300/10000 [00:03<01:44, 92.56 permutations/s]
Permutation test:   3%|▎         | 310/10000 [00:03<01:56, 82.82 permutations/s]
Permutation test:   3%|▎         | 323/10000 [00:03<01:45, 92.15 permutations/s]
Permutation test:   3%|▎         | 333/10000 [00:03<01:46, 90.62 permutations/s]
Permutation test:   3%|▎         | 343/10000 [00:03<02:08, 74.86 permutations/s]
Permutation test:   4%|▎         | 352/10000 [00:03<02:04, 77.69 permutations/s]
Permutation test:   4%|▎         | 361/10000 [00:03<02:22, 67.53 permutations/s]
Permutation test:   4%|▎         | 369/10000 [00:04<02:19, 68.83 permutations/s]
Permutation test:   4%|▍         | 377/10000 [00:04<02:21, 67.81 permutations/s]
Permutation test:   4%|▍         | 385/10000 [00:04<02:18, 69.34 permutations/s]
Permutation test:   4%|▍         | 397/10000 [00:04<01:58, 80.79 permutations/s]
Permutation test:   4%|▍         | 409/10000 [00:04<01:45, 91.05 permutations/s]
Permutation test:   4%|▍         | 420/10000 [00:04<01:40, 94.92 permutations/s]
Permutation test:   4%|▍         | 430/10000 [00:04<01:50, 86.33 permutations/s]
Permutation test:   4%|▍         | 439/10000 [00:04<02:00, 79.52 permutations/s]
Permutation test:   4%|▍         | 448/10000 [00:04<02:06, 75.33 permutations/s]
Permutation test:   5%|▍         | 461/10000 [00:05<01:47, 88.97 permutations/s]
Permutation test:   5%|▍         | 471/10000 [00:05<01:59, 80.02 permutations/s]
Permutation test:   5%|▍         | 480/10000 [00:05<01:56, 81.90 permutations/s]
Permutation test:   5%|▍         | 489/10000 [00:05<01:55, 82.59 permutations/s]
Permutation test:   5%|▍         | 498/10000 [00:05<02:05, 75.96 permutations/s]
Permutation test:   5%|▌         | 506/10000 [00:05<02:21, 67.20 permutations/s]
Permutation test:   5%|▌         | 520/10000 [00:05<01:58, 80.33 permutations/s]
Permutation test:   5%|▌         | 529/10000 [00:05<01:59, 79.41 permutations/s]
Permutation test:   5%|▌         | 538/10000 [00:06<02:10, 72.30 permutations/s]
Permutation test:   5%|▌         | 546/10000 [00:06<02:11, 72.10 permutations/s]
Permutation test:   6%|▌         | 560/10000 [00:06<01:47, 87.55 permutations/s]
Permutation test:   6%|▌         | 571/10000 [00:06<01:41, 92.82 permutations/s]
Permutation test:   6%|▌         | 581/10000 [00:06<01:42, 92.21 permutations/s]
Permutation test:   6%|▌         | 591/10000 [00:06<01:57, 80.38 permutations/s]
Permutation test:   6%|▌         | 602/10000 [00:06<01:48, 86.43 permutations/s]
Permutation test:   6%|▌         | 612/10000 [00:06<01:51, 83.92 permutations/s]
Permutation test:   6%|▌         | 621/10000 [00:07<01:56, 80.25 permutations/s]
Permutation test:   6%|▋         | 630/10000 [00:07<01:59, 78.51 permutations/s]
Permutation test:   6%|▋         | 641/10000 [00:07<01:48, 86.21 permutations/s]
Permutation test:   6%|▋         | 650/10000 [00:07<01:47, 87.16 permutations/s]
Permutation test:   7%|▋         | 661/10000 [00:07<01:42, 91.45 permutations/s]
Permutation test:   7%|▋         | 674/10000 [00:07<01:32, 101.08 permutations/s]
Permutation test:   7%|▋         | 685/10000 [00:07<01:41, 91.42 permutations/s]
Permutation test:   7%|▋         | 695/10000 [00:07<01:45, 88.14 permutations/s]
Permutation test:   7%|▋         | 708/10000 [00:08<01:36, 96.11 permutations/s]
Permutation test:   7%|▋         | 719/10000 [00:08<01:33, 99.75 permutations/s]
Permutation test:   7%|▋         | 731/10000 [00:08<01:29, 103.80 permutations/s]
Permutation test:   7%|▋         | 744/10000 [00:08<01:25, 108.79 permutations/s]
Permutation test:   8%|▊         | 759/10000 [00:08<01:17, 119.08 permutations/s]
Permutation test:   8%|▊         | 772/10000 [00:08<01:18, 118.04 permutations/s]
Permutation test:   8%|▊         | 784/10000 [00:08<01:23, 110.07 permutations/s]
Permutation test:   8%|▊         | 797/10000 [00:08<01:20, 113.85 permutations/s]
Permutation test:   8%|▊         | 811/10000 [00:08<01:17, 118.93 permutations/s]
Permutation test:   8%|▊         | 823/10000 [00:08<01:18, 116.27 permutations/s]
Permutation test:   8%|▊         | 835/10000 [00:09<01:30, 101.79 permutations/s]
Permutation test:   8%|▊         | 849/10000 [00:09<01:22, 110.31 permutations/s]
Permutation test:   9%|▊         | 861/10000 [00:09<01:24, 108.20 permutations/s]
Permutation test:   9%|▊         | 873/10000 [00:09<01:29, 101.70 permutations/s]
Permutation test:   9%|▉         | 886/10000 [00:09<01:24, 107.84 permutations/s]
Permutation test:   9%|▉         | 898/10000 [00:09<01:28, 103.35 permutations/s]
Permutation test:   9%|▉         | 909/10000 [00:09<01:32, 98.49 permutations/s]
Permutation test:   9%|▉         | 923/10000 [00:09<01:25, 106.38 permutations/s]
Permutation test:   9%|▉         | 934/10000 [00:10<01:26, 105.19 permutations/s]
Permutation test:   9%|▉         | 945/10000 [00:10<01:32, 97.87 permutations/s]
Permutation test:  10%|▉         | 958/10000 [00:10<01:26, 105.12 permutations/s]
Permutation test:  10%|▉         | 969/10000 [00:10<01:32, 97.93 permutations/s]
Permutation test:  10%|▉         | 981/10000 [00:10<01:27, 103.00 permutations/s]
Permutation test:  10%|▉         | 998/10000 [00:10<01:14, 120.44 permutations/s]
Permutation test:  10%|█         | 1011/10000 [00:10<01:18, 114.03 permutations/s]
Permutation test:  10%|█         | 1023/10000 [00:10<01:20, 111.98 permutations/s]
Permutation test:  10%|█         | 1035/10000 [00:11<01:28, 100.89 permutations/s]
Permutation test:  10%|█         | 1046/10000 [00:11<01:27, 102.06 permutations/s]
Permutation test:  11%|█         | 1066/10000 [00:11<01:10, 127.56 permutations/s]
Permutation test:  11%|█         | 1080/10000 [00:11<01:31, 97.87 permutations/s]
Permutation test:  11%|█         | 1092/10000 [00:11<01:47, 83.20 permutations/s]
Permutation test:  11%|█         | 1104/10000 [00:11<01:39, 89.34 permutations/s]
Permutation test:  11%|█         | 1115/10000 [00:11<01:54, 77.59 permutations/s]
Permutation test:  11%|█         | 1124/10000 [00:12<02:00, 73.76 permutations/s]
Permutation test:  11%|█▏        | 1133/10000 [00:12<02:09, 68.43 permutations/s]
Permutation test:  11%|█▏        | 1141/10000 [00:12<02:21, 62.57 permutations/s]
Permutation test:  12%|█▏        | 1156/10000 [00:12<01:54, 77.50 permutations/s]
Permutation test:  12%|█▏        | 1166/10000 [00:12<01:53, 77.70 permutations/s]
Permutation test:  12%|█▏        | 1175/10000 [00:12<01:54, 76.95 permutations/s]
Permutation test:  12%|█▏        | 1184/10000 [00:12<01:50, 79.49 permutations/s]
Permutation test:  12%|█▏        | 1196/10000 [00:13<01:40, 87.79 permutations/s]
Permutation test:  12%|█▏        | 1206/10000 [00:13<01:39, 88.18 permutations/s]
Permutation test:  12%|█▏        | 1221/10000 [00:13<01:24, 103.95 permutations/s]
Permutation test:  12%|█▏        | 1232/10000 [00:13<01:24, 104.37 permutations/s]
Permutation test:  12%|█▏        | 1243/10000 [00:13<01:44, 83.53 permutations/s]
Permutation test:  13%|█▎        | 1253/10000 [00:13<01:50, 78.85 permutations/s]
Permutation test:  13%|█▎        | 1263/10000 [00:13<01:47, 81.00 permutations/s]
Permutation test:  13%|█▎        | 1272/10000 [00:13<01:58, 73.49 permutations/s]
Permutation test:  13%|█▎        | 1281/10000 [00:14<01:56, 74.99 permutations/s]
Permutation test:  13%|█▎        | 1291/10000 [00:14<01:47, 80.70 permutations/s]
Permutation test:  13%|█▎        | 1301/10000 [00:14<01:45, 82.48 permutations/s]
Permutation test:  13%|█▎        | 1315/10000 [00:14<01:30, 96.29 permutations/s]
Permutation test:  13%|█▎        | 1326/10000 [00:14<01:33, 92.41 permutations/s]
Permutation test:  13%|█▎        | 1338/10000 [00:14<01:26, 99.64 permutations/s]
Permutation test:  13%|█▎        | 1349/10000 [00:14<01:32, 93.30 permutations/s]
Permutation test:  14%|█▎        | 1360/10000 [00:14<01:28, 97.66 permutations/s]
Permutation test:  14%|█▎        | 1371/10000 [00:14<01:31, 94.53 permutations/s]
Permutation test:  14%|█▍        | 1386/10000 [00:15<01:20, 106.92 permutations/s]
Permutation test:  14%|█▍        | 1397/10000 [00:15<01:26, 99.68 permutations/s]
Permutation test:  14%|█▍        | 1409/10000 [00:15<01:22, 103.85 permutations/s]
Permutation test:  14%|█▍        | 1427/10000 [00:15<01:11, 120.58 permutations/s]
Permutation test:  14%|█▍        | 1440/10000 [00:15<01:23, 103.09 permutations/s]
Permutation test:  15%|█▍        | 1451/10000 [00:15<01:29, 95.20 permutations/s]
Permutation test:  15%|█▍        | 1461/10000 [00:15<01:35, 89.00 permutations/s]
Permutation test:  15%|█▍        | 1471/10000 [00:16<01:52, 75.65 permutations/s]
Permutation test:  15%|█▍        | 1480/10000 [00:16<01:59, 71.59 permutations/s]
Permutation test:  15%|█▍        | 1489/10000 [00:16<01:53, 74.95 permutations/s]
Permutation test:  15%|█▍        | 1498/10000 [00:16<01:49, 78.00 permutations/s]
Permutation test:  15%|█▌        | 1507/10000 [00:16<01:45, 80.24 permutations/s]
Permutation test:  15%|█▌        | 1516/10000 [00:16<01:48, 78.49 permutations/s]
Permutation test:  15%|█▌        | 1525/10000 [00:16<01:48, 78.40 permutations/s]
Permutation test:  15%|█▌        | 1539/10000 [00:16<01:29, 94.53 permutations/s]
Permutation test:  15%|█▌        | 1549/10000 [00:16<01:32, 91.10 permutations/s]
Permutation test:  16%|█▌        | 1562/10000 [00:17<01:30, 93.39 permutations/s]
Permutation test:  16%|█▌        | 1572/10000 [00:17<01:49, 76.68 permutations/s]
Permutation test:  16%|█▌        | 1583/10000 [00:17<01:41, 83.08 permutations/s]
Permutation test:  16%|█▌        | 1594/10000 [00:17<01:42, 82.25 permutations/s]
Permutation test:  16%|█▌        | 1606/10000 [00:17<01:32, 90.56 permutations/s]
Permutation test:  16%|█▌        | 1617/10000 [00:17<01:28, 95.16 permutations/s]
Permutation test:  16%|█▋        | 1630/10000 [00:17<01:20, 103.45 permutations/s]
Permutation test:  16%|█▋        | 1641/10000 [00:18<01:34, 88.84 permutations/s]
Permutation test:  17%|█▋        | 1651/10000 [00:18<01:33, 89.06 permutations/s]
Permutation test:  17%|█▋        | 1663/10000 [00:18<01:25, 96.97 permutations/s]
Permutation test:  17%|█▋        | 1674/10000 [00:18<01:28, 94.45 permutations/s]
Permutation test:  17%|█▋        | 1684/10000 [00:18<01:27, 94.82 permutations/s]
Permutation test:  17%|█▋        | 1696/10000 [00:18<01:24, 97.87 permutations/s]
Permutation test:  17%|█▋        | 1706/10000 [00:18<01:26, 95.46 permutations/s]
Permutation test:  17%|█▋        | 1716/10000 [00:18<01:41, 81.40 permutations/s]
Permutation test:  17%|█▋        | 1728/10000 [00:18<01:33, 88.86 permutations/s]
Permutation test:  17%|█▋        | 1738/10000 [00:19<01:33, 88.12 permutations/s]
Permutation test:  17%|█▋        | 1749/10000 [00:19<01:37, 85.03 permutations/s]
Permutation test:  18%|█▊        | 1758/10000 [00:19<01:39, 82.93 permutations/s]
Permutation test:  18%|█▊        | 1771/10000 [00:19<01:26, 94.65 permutations/s]
Permutation test:  18%|█▊        | 1781/10000 [00:19<01:28, 92.51 permutations/s]
Permutation test:  18%|█▊        | 1794/10000 [00:19<01:20, 101.40 permutations/s]
Permutation test:  18%|█▊        | 1806/10000 [00:19<01:17, 105.48 permutations/s]
Permutation test:  18%|█▊        | 1820/10000 [00:19<01:11, 114.83 permutations/s]
Permutation test:  18%|█▊        | 1833/10000 [00:19<01:09, 117.92 permutations/s]
Permutation test:  18%|█▊        | 1846/10000 [00:20<01:07, 120.49 permutations/s]
Permutation test:  19%|█▊        | 1859/10000 [00:20<01:16, 106.94 permutations/s]
Permutation test:  19%|█▊        | 1871/10000 [00:20<01:19, 102.01 permutations/s]
Permutation test:  19%|█▉        | 1882/10000 [00:20<01:26, 93.40 permutations/s]
Permutation test:  19%|█▉        | 1892/10000 [00:20<01:28, 91.91 permutations/s]
Permutation test:  19%|█▉        | 1902/10000 [00:20<01:29, 90.40 permutations/s]
Permutation test:  19%|█▉        | 1914/10000 [00:20<01:24, 96.00 permutations/s]
Permutation test:  19%|█▉        | 1924/10000 [00:20<01:27, 92.15 permutations/s]
Permutation test:  19%|█▉        | 1939/10000 [00:21<01:16, 105.44 permutations/s]
Permutation test:  20%|█▉        | 1950/10000 [00:21<01:16, 105.81 permutations/s]
Permutation test:  20%|█▉        | 1963/10000 [00:21<01:12, 110.97 permutations/s]
Permutation test:  20%|█▉        | 1975/10000 [00:21<01:17, 104.16 permutations/s]
Permutation test:  20%|█▉        | 1986/10000 [00:21<01:17, 104.06 permutations/s]
Permutation test:  20%|█▉        | 1997/10000 [00:21<01:19, 100.67 permutations/s]
Permutation test:  20%|██        | 2009/10000 [00:21<01:16, 104.81 permutations/s]
Permutation test:  20%|██        | 2022/10000 [00:21<01:11, 111.43 permutations/s]
Permutation test:  20%|██        | 2034/10000 [00:21<01:11, 111.77 permutations/s]
Permutation test:  20%|██        | 2046/10000 [00:22<01:18, 101.04 permutations/s]
Permutation test:  21%|██        | 2057/10000 [00:22<01:19, 99.53 permutations/s]
Permutation test:  21%|██        | 2068/10000 [00:22<01:29, 89.11 permutations/s]
Permutation test:  21%|██        | 2078/10000 [00:22<01:34, 84.21 permutations/s]
Permutation test:  21%|██        | 2087/10000 [00:22<01:36, 82.39 permutations/s]
Permutation test:  21%|██        | 2099/10000 [00:22<01:26, 90.95 permutations/s]
Permutation test:  21%|██        | 2109/10000 [00:22<01:27, 90.31 permutations/s]
Permutation test:  21%|██        | 2119/10000 [00:22<01:28, 88.84 permutations/s]
Permutation test:  21%|██▏       | 2128/10000 [00:23<01:30, 86.73 permutations/s]
Permutation test:  21%|██▏       | 2139/10000 [00:23<01:33, 84.06 permutations/s]
Permutation test:  22%|██▏       | 2150/10000 [00:23<01:30, 87.20 permutations/s]
Permutation test:  22%|██▏       | 2161/10000 [00:23<01:24, 92.69 permutations/s]
Permutation test:  22%|██▏       | 2171/10000 [00:23<01:24, 93.08 permutations/s]
Permutation test:  22%|██▏       | 2181/10000 [00:23<01:30, 86.22 permutations/s]
Permutation test:  22%|██▏       | 2190/10000 [00:23<01:39, 78.48 permutations/s]
Permutation test:  22%|██▏       | 2203/10000 [00:23<01:26, 90.33 permutations/s]
Permutation test:  22%|██▏       | 2216/10000 [00:24<01:18, 99.67 permutations/s]
Permutation test:  22%|██▏       | 2228/10000 [00:24<01:18, 98.98 permutations/s]
Permutation test:  22%|██▏       | 2241/10000 [00:24<01:18, 98.77 permutations/s]
Permutation test:  23%|██▎       | 2252/10000 [00:24<01:16, 101.60 permutations/s]
Permutation test:  23%|██▎       | 2265/10000 [00:24<01:15, 102.80 permutations/s]
Permutation test:  23%|██▎       | 2276/10000 [00:24<01:14, 103.51 permutations/s]
Permutation test:  23%|██▎       | 2288/10000 [00:24<01:12, 106.81 permutations/s]
Permutation test:  23%|██▎       | 2299/10000 [00:24<01:13, 105.19 permutations/s]
Permutation test:  23%|██▎       | 2312/10000 [00:24<01:09, 111.00 permutations/s]
Permutation test:  23%|██▎       | 2324/10000 [00:25<01:07, 113.51 permutations/s]
Permutation test:  23%|██▎       | 2336/10000 [00:25<01:12, 106.12 permutations/s]
Permutation test:  23%|██▎       | 2348/10000 [00:25<01:09, 109.50 permutations/s]
Permutation test:  24%|██▎       | 2361/10000 [00:25<01:07, 112.83 permutations/s]
Permutation test:  24%|██▎       | 2374/10000 [00:25<01:07, 112.15 permutations/s]
Permutation test:  24%|██▍       | 2386/10000 [00:25<01:11, 106.41 permutations/s]
Permutation test:  24%|██▍       | 2397/10000 [00:25<01:15, 100.12 permutations/s]
Permutation test:  24%|██▍       | 2409/10000 [00:25<01:18, 96.96 permutations/s]
Permutation test:  24%|██▍       | 2423/10000 [00:25<01:12, 104.76 permutations/s]
Permutation test:  24%|██▍       | 2436/10000 [00:26<01:15, 100.84 permutations/s]
Permutation test:  24%|██▍       | 2450/10000 [00:26<01:08, 109.68 permutations/s]
Permutation test:  25%|██▍       | 2463/10000 [00:26<01:06, 113.71 permutations/s]
Permutation test:  25%|██▍       | 2475/10000 [00:26<01:10, 106.26 permutations/s]
Permutation test:  25%|██▍       | 2486/10000 [00:26<01:13, 102.17 permutations/s]
Permutation test:  25%|██▍       | 2498/10000 [00:26<01:11, 105.34 permutations/s]
Permutation test:  25%|██▌       | 2511/10000 [00:26<01:08, 109.73 permutations/s]
Permutation test:  25%|██▌       | 2523/10000 [00:26<01:18, 94.65 permutations/s]
Permutation test:  25%|██▌       | 2533/10000 [00:27<01:20, 92.68 permutations/s]
Permutation test:  25%|██▌       | 2543/10000 [00:27<01:31, 81.71 permutations/s]
Permutation test:  26%|██▌       | 2552/10000 [00:27<01:40, 73.89 permutations/s]
Permutation test:  26%|██▌       | 2560/10000 [00:27<01:45, 70.74 permutations/s]
Permutation test:  26%|██▌       | 2568/10000 [00:27<01:45, 70.61 permutations/s]
Permutation test:  26%|██▌       | 2576/10000 [00:27<01:59, 62.19 permutations/s]
Permutation test:  26%|██▌       | 2583/10000 [00:27<02:08, 57.67 permutations/s]
Permutation test:  26%|██▌       | 2589/10000 [00:28<02:10, 56.81 permutations/s]
Permutation test:  26%|██▌       | 2595/10000 [00:28<02:18, 53.40 permutations/s]
Permutation test:  26%|██▌       | 2607/10000 [00:28<01:47, 68.59 permutations/s]
Permutation test:  26%|██▌       | 2615/10000 [00:28<01:53, 65.32 permutations/s]
Permutation test:  26%|██▌       | 2624/10000 [00:28<01:44, 70.38 permutations/s]
Permutation test:  26%|██▋       | 2632/10000 [00:28<01:47, 68.54 permutations/s]
Permutation test:  26%|██▋       | 2640/10000 [00:28<01:47, 68.20 permutations/s]
Permutation test:  26%|██▋       | 2648/10000 [00:28<01:54, 64.38 permutations/s]
Permutation test:  27%|██▋       | 2657/10000 [00:29<01:55, 63.79 permutations/s]
Permutation test:  27%|██▋       | 2666/10000 [00:29<01:47, 68.36 permutations/s]
Permutation test:  27%|██▋       | 2675/10000 [00:29<01:41, 72.19 permutations/s]
Permutation test:  27%|██▋       | 2684/10000 [00:29<01:47, 68.23 permutations/s]
Permutation test:  27%|██▋       | 2692/10000 [00:29<01:52, 64.77 permutations/s]
Permutation test:  27%|██▋       | 2700/10000 [00:29<01:58, 61.79 permutations/s]
Permutation test:  27%|██▋       | 2707/10000 [00:29<02:05, 58.05 permutations/s]
Permutation test:  27%|██▋       | 2713/10000 [00:29<02:05, 58.02 permutations/s]
Permutation test:  27%|██▋       | 2719/10000 [00:30<02:14, 54.20 permutations/s]
Permutation test:  27%|██▋       | 2725/10000 [00:30<02:10, 55.55 permutations/s]
Permutation test:  27%|██▋       | 2731/10000 [00:30<02:17, 52.90 permutations/s]
Permutation test:  27%|██▋       | 2738/10000 [00:30<02:10, 55.54 permutations/s]
Permutation test:  27%|██▋       | 2746/10000 [00:30<02:09, 55.93 permutations/s]
Permutation test:  28%|██▊       | 2754/10000 [00:30<02:05, 57.71 permutations/s]
Permutation test:  28%|██▊       | 2764/10000 [00:30<01:46, 68.22 permutations/s]
Permutation test:  28%|██▊       | 2776/10000 [00:30<01:39, 72.78 permutations/s]
Permutation test:  28%|██▊       | 2786/10000 [00:31<01:36, 74.45 permutations/s]
Permutation test:  28%|██▊       | 2796/10000 [00:31<01:32, 77.71 permutations/s]
Permutation test:  28%|██▊       | 2804/10000 [00:31<01:35, 74.98 permutations/s]
Permutation test:  28%|██▊       | 2813/10000 [00:31<01:31, 78.31 permutations/s]
Permutation test:  28%|██▊       | 2821/10000 [00:31<01:40, 71.70 permutations/s]
Permutation test:  28%|██▊       | 2831/10000 [00:31<01:41, 70.33 permutations/s]
Permutation test:  28%|██▊       | 2839/10000 [00:31<01:39, 71.95 permutations/s]
Permutation test:  28%|██▊       | 2848/10000 [00:31<01:42, 69.51 permutations/s]
Permutation test:  29%|██▊       | 2856/10000 [00:32<01:45, 67.52 permutations/s]
Permutation test:  29%|██▊       | 2863/10000 [00:32<01:49, 65.33 permutations/s]
Permutation test:  29%|██▊       | 2872/10000 [00:32<01:41, 70.27 permutations/s]
Permutation test:  29%|██▉       | 2880/10000 [00:32<01:47, 66.01 permutations/s]
Permutation test:  29%|██▉       | 2887/10000 [00:32<01:51, 63.97 permutations/s]
Permutation test:  29%|██▉       | 2896/10000 [00:32<01:42, 69.45 permutations/s]
Permutation test:  29%|██▉       | 2904/10000 [00:32<01:46, 66.68 permutations/s]
Permutation test:  29%|██▉       | 2912/10000 [00:32<01:43, 68.70 permutations/s]
Permutation test:  29%|██▉       | 2924/10000 [00:33<01:30, 77.90 permutations/s]
Permutation test:  29%|██▉       | 2932/10000 [00:33<01:30, 78.18 permutations/s]
Permutation test:  29%|██▉       | 2943/10000 [00:33<01:27, 80.67 permutations/s]
Permutation test:  30%|██▉       | 2952/10000 [00:33<01:31, 77.41 permutations/s]
Permutation test:  30%|██▉       | 2960/10000 [00:33<01:37, 72.06 permutations/s]
Permutation test:  30%|██▉       | 2968/10000 [00:33<01:43, 67.66 permutations/s]
Permutation test:  30%|██▉       | 2975/10000 [00:33<01:57, 59.60 permutations/s]
Permutation test:  30%|██▉       | 2982/10000 [00:33<02:06, 55.59 permutations/s]
Permutation test:  30%|██▉       | 2989/10000 [00:34<01:58, 58.92 permutations/s]
Permutation test:  30%|██▉       | 2996/10000 [00:34<02:05, 55.97 permutations/s]
Permutation test:  30%|███       | 3012/10000 [00:34<01:29, 78.37 permutations/s]
Permutation test:  30%|███       | 3021/10000 [00:34<01:36, 72.59 permutations/s]
Permutation test:  30%|███       | 3030/10000 [00:34<01:31, 76.10 permutations/s]
Permutation test:  30%|███       | 3038/10000 [00:34<01:40, 69.25 permutations/s]
Permutation test:  30%|███       | 3046/10000 [00:34<01:37, 71.11 permutations/s]
Permutation test:  31%|███       | 3054/10000 [00:34<01:34, 73.22 permutations/s]
Permutation test:  31%|███       | 3064/10000 [00:35<01:28, 78.42 permutations/s]
Permutation test:  31%|███       | 3072/10000 [00:35<01:36, 71.70 permutations/s]
Permutation test:  31%|███       | 3080/10000 [00:35<01:41, 67.93 permutations/s]
Permutation test:  31%|███       | 3092/10000 [00:35<01:28, 78.23 permutations/s]
Permutation test:  31%|███       | 3100/10000 [00:35<01:33, 74.18 permutations/s]
Permutation test:  31%|███       | 3108/10000 [00:35<01:34, 72.76 permutations/s]
Permutation test:  31%|███       | 3116/10000 [00:35<01:45, 65.09 permutations/s]
Permutation test:  31%|███       | 3123/10000 [00:35<02:06, 54.43 permutations/s]
Permutation test:  31%|███▏      | 3130/10000 [00:36<02:00, 56.95 permutations/s]
Permutation test:  31%|███▏      | 3138/10000 [00:36<01:53, 60.59 permutations/s]
Permutation test:  31%|███▏      | 3145/10000 [00:36<02:07, 53.90 permutations/s]
Permutation test:  32%|███▏      | 3153/10000 [00:36<01:55, 59.24 permutations/s]
Permutation test:  32%|███▏      | 3160/10000 [00:36<01:51, 61.55 permutations/s]
Permutation test:  32%|███▏      | 3167/10000 [00:36<01:51, 61.21 permutations/s]
Permutation test:  32%|███▏      | 3174/10000 [00:36<02:00, 56.43 permutations/s]
Permutation test:  32%|███▏      | 3181/10000 [00:36<01:56, 58.77 permutations/s]
Permutation test:  32%|███▏      | 3190/10000 [00:37<01:44, 65.14 permutations/s]
Permutation test:  32%|███▏      | 3197/10000 [00:37<01:47, 63.03 permutations/s]
Permutation test:  32%|███▏      | 3209/10000 [00:37<01:27, 77.62 permutations/s]
Permutation test:  32%|███▏      | 3222/10000 [00:37<01:13, 91.76 permutations/s]
Permutation test:  32%|███▏      | 3235/10000 [00:37<01:06, 101.26 permutations/s]
Permutation test:  32%|███▏      | 3246/10000 [00:37<01:09, 97.16 permutations/s]
Permutation test:  33%|███▎      | 3259/10000 [00:37<01:04, 105.05 permutations/s]
Permutation test:  33%|███▎      | 3272/10000 [00:37<01:00, 110.78 permutations/s]
Permutation test:  33%|███▎      | 3285/10000 [00:37<00:58, 114.85 permutations/s]
Permutation test:  33%|███▎      | 3297/10000 [00:38<01:00, 110.91 permutations/s]
Permutation test:  33%|███▎      | 3311/10000 [00:38<00:56, 118.21 permutations/s]
Permutation test:  33%|███▎      | 3325/10000 [00:38<00:55, 120.25 permutations/s]
Permutation test:  33%|███▎      | 3338/10000 [00:38<00:55, 120.45 permutations/s]
Permutation test:  34%|███▎      | 3351/10000 [00:38<00:56, 118.36 permutations/s]
Permutation test:  34%|███▎      | 3363/10000 [00:38<00:56, 117.69 permutations/s]
Permutation test:  34%|███▍      | 3376/10000 [00:38<00:56, 116.35 permutations/s]
Permutation test:  34%|███▍      | 3390/10000 [00:38<00:57, 115.20 permutations/s]
Permutation test:  34%|███▍      | 3402/10000 [00:38<00:59, 111.34 permutations/s]
Permutation test:  34%|███▍      | 3414/10000 [00:39<01:07, 97.35 permutations/s]
Permutation test:  34%|███▍      | 3425/10000 [00:39<01:13, 89.20 permutations/s]
Permutation test:  34%|███▍      | 3438/10000 [00:39<01:06, 98.46 permutations/s]
Permutation test:  34%|███▍      | 3450/10000 [00:39<01:03, 102.84 permutations/s]
Permutation test:  35%|███▍      | 3461/10000 [00:39<01:04, 101.46 permutations/s]
Permutation test:  35%|███▍      | 3474/10000 [00:39<01:00, 108.28 permutations/s]
Permutation test:  35%|███▍      | 3486/10000 [00:39<01:02, 103.40 permutations/s]
Permutation test:  35%|███▍      | 3499/10000 [00:39<00:59, 109.32 permutations/s]
Permutation test:  35%|███▌      | 3512/10000 [00:40<00:57, 113.70 permutations/s]
Permutation test:  35%|███▌      | 3525/10000 [00:40<00:55, 117.42 permutations/s]
Permutation test:  35%|███▌      | 3537/10000 [00:40<00:55, 116.29 permutations/s]
Permutation test:  36%|███▌      | 3550/10000 [00:40<00:54, 118.87 permutations/s]
Permutation test:  36%|███▌      | 3563/10000 [00:40<00:54, 117.94 permutations/s]
Permutation test:  36%|███▌      | 3575/10000 [00:40<01:05, 98.50 permutations/s]
Permutation test:  36%|███▌      | 3588/10000 [00:40<01:02, 103.29 permutations/s]
Permutation test:  36%|███▌      | 3599/10000 [00:40<01:03, 100.92 permutations/s]
Permutation test:  36%|███▌      | 3610/10000 [00:40<01:03, 100.00 permutations/s]
Permutation test:  36%|███▌      | 3623/10000 [00:41<00:59, 107.46 permutations/s]
Permutation test:  36%|███▋      | 3635/10000 [00:41<01:00, 105.02 permutations/s]
Permutation test:  36%|███▋      | 3647/10000 [00:41<01:01, 104.14 permutations/s]
Permutation test:  37%|███▋      | 3659/10000 [00:41<00:58, 108.38 permutations/s]
Permutation test:  37%|███▋      | 3672/10000 [00:41<00:55, 113.22 permutations/s]
Permutation test:  37%|███▋      | 3684/10000 [00:41<01:01, 102.37 permutations/s]
Permutation test:  37%|███▋      | 3697/10000 [00:41<00:58, 108.50 permutations/s]
Permutation test:  37%|███▋      | 3709/10000 [00:41<00:56, 111.59 permutations/s]
Permutation test:  37%|███▋      | 3722/10000 [00:41<00:54, 116.18 permutations/s]
Permutation test:  37%|███▋      | 3735/10000 [00:42<00:52, 119.22 permutations/s]
Permutation test:  37%|███▋      | 3748/10000 [00:42<00:52, 119.75 permutations/s]
Permutation test:  38%|███▊      | 3761/10000 [00:42<00:53, 117.39 permutations/s]
Permutation test:  38%|███▊      | 3773/10000 [00:42<00:53, 117.01 permutations/s]
Permutation test:  38%|███▊      | 3785/10000 [00:42<00:56, 109.62 permutations/s]
Permutation test:  38%|███▊      | 3801/10000 [00:42<00:51, 121.53 permutations/s]
Permutation test:  38%|███▊      | 3814/10000 [00:42<00:54, 113.87 permutations/s]
Permutation test:  38%|███▊      | 3827/10000 [00:42<00:53, 116.46 permutations/s]
Permutation test:  38%|███▊      | 3840/10000 [00:42<00:51, 118.92 permutations/s]
Permutation test:  39%|███▊      | 3855/10000 [00:43<00:49, 123.49 permutations/s]
Permutation test:  39%|███▊      | 3868/10000 [00:43<00:55, 110.42 permutations/s]
Permutation test:  39%|███▉      | 3881/10000 [00:43<00:53, 114.52 permutations/s]
Permutation test:  39%|███▉      | 3895/10000 [00:43<00:51, 117.54 permutations/s]
Permutation test:  39%|███▉      | 3908/10000 [00:43<00:50, 120.72 permutations/s]
Permutation test:  39%|███▉      | 3921/10000 [00:43<00:52, 115.83 permutations/s]
Permutation test:  39%|███▉      | 3934/10000 [00:43<00:51, 118.41 permutations/s]
Permutation test:  39%|███▉      | 3946/10000 [00:43<00:52, 114.90 permutations/s]
Permutation test:  40%|███▉      | 3958/10000 [00:43<00:52, 115.02 permutations/s]
Permutation test:  40%|███▉      | 3971/10000 [00:44<00:51, 117.96 permutations/s]
Permutation test:  40%|███▉      | 3983/10000 [00:44<00:51, 117.30 permutations/s]
Permutation test:  40%|███▉      | 3995/10000 [00:44<01:00, 99.49 permutations/s]
Permutation test:  40%|████      | 4006/10000 [00:44<01:01, 97.40 permutations/s]
Permutation test:  40%|████      | 4017/10000 [00:44<01:01, 97.84 permutations/s]
Permutation test:  40%|████      | 4030/10000 [00:44<00:58, 101.81 permutations/s]
Permutation test:  40%|████      | 4041/10000 [00:44<01:00, 99.31 permutations/s]
Permutation test:  41%|████      | 4052/10000 [00:44<01:03, 93.31 permutations/s]
Permutation test:  41%|████      | 4067/10000 [00:45<00:58, 101.08 permutations/s]
Permutation test:  41%|████      | 4081/10000 [00:45<00:53, 109.66 permutations/s]
Permutation test:  41%|████      | 4093/10000 [00:45<00:56, 103.78 permutations/s]
Permutation test:  41%|████      | 4104/10000 [00:45<01:01, 96.36 permutations/s]
Permutation test:  41%|████      | 4116/10000 [00:45<00:58, 100.55 permutations/s]
Permutation test:  41%|████▏     | 4131/10000 [00:45<00:52, 112.32 permutations/s]
Permutation test:  41%|████▏     | 4144/10000 [00:45<00:50, 115.50 permutations/s]
Permutation test:  42%|████▏     | 4157/10000 [00:45<00:49, 118.27 permutations/s]
Permutation test:  42%|████▏     | 4169/10000 [00:45<00:52, 110.16 permutations/s]
Permutation test:  42%|████▏     | 4181/10000 [00:46<01:01, 95.25 permutations/s]
Permutation test:  42%|████▏     | 4192/10000 [00:46<00:59, 97.92 permutations/s]
Permutation test:  42%|████▏     | 4208/10000 [00:46<00:52, 110.59 permutations/s]
Permutation test:  42%|████▏     | 4220/10000 [00:46<00:53, 108.43 permutations/s]
Permutation test:  42%|████▏     | 4232/10000 [00:46<00:56, 101.61 permutations/s]
Permutation test:  42%|████▏     | 4245/10000 [00:46<00:53, 106.92 permutations/s]
Permutation test:  43%|████▎     | 4256/10000 [00:46<00:53, 107.31 permutations/s]
Permutation test:  43%|████▎     | 4268/10000 [00:46<00:55, 103.99 permutations/s]
Permutation test:  43%|████▎     | 4279/10000 [00:47<00:56, 100.63 permutations/s]
Permutation test:  43%|████▎     | 4290/10000 [00:47<00:59, 96.06 permutations/s]
Permutation test:  43%|████▎     | 4301/10000 [00:47<00:57, 99.50 permutations/s]
Permutation test:  43%|████▎     | 4314/10000 [00:47<00:53, 106.72 permutations/s]
Permutation test:  43%|████▎     | 4327/10000 [00:47<00:50, 113.13 permutations/s]
Permutation test:  43%|████▎     | 4339/10000 [00:47<00:54, 103.09 permutations/s]
Permutation test:  44%|████▎     | 4350/10000 [00:47<01:02, 90.54 permutations/s]
Permutation test:  44%|████▎     | 4363/10000 [00:47<00:56, 99.43 permutations/s]
Permutation test:  44%|████▎     | 4374/10000 [00:48<00:56, 98.70 permutations/s]
Permutation test:  44%|████▍     | 4389/10000 [00:48<00:50, 111.92 permutations/s]
Permutation test:  44%|████▍     | 4401/10000 [00:48<00:51, 109.00 permutations/s]
Permutation test:  44%|████▍     | 4414/10000 [00:48<00:49, 113.54 permutations/s]
Permutation test:  44%|████▍     | 4426/10000 [00:48<00:48, 114.93 permutations/s]
Permutation test:  44%|████▍     | 4440/10000 [00:48<00:46, 119.89 permutations/s]
Permutation test:  45%|████▍     | 4453/10000 [00:48<00:50, 110.71 permutations/s]
Permutation test:  45%|████▍     | 4465/10000 [00:48<00:49, 111.32 permutations/s]
Permutation test:  45%|████▍     | 4477/10000 [00:48<00:54, 101.09 permutations/s]
Permutation test:  45%|████▍     | 4488/10000 [00:49<00:53, 103.26 permutations/s]
Permutation test:  45%|████▍     | 4499/10000 [00:49<00:53, 103.36 permutations/s]
Permutation test:  45%|████▌     | 4511/10000 [00:49<00:51, 105.63 permutations/s]
Permutation test:  45%|████▌     | 4525/10000 [00:49<00:47, 114.15 permutations/s]
Permutation test:  45%|████▌     | 4538/10000 [00:49<00:46, 118.35 permutations/s]
Permutation test:  46%|████▌     | 4550/10000 [00:49<00:50, 108.43 permutations/s]
Permutation test:  46%|████▌     | 4564/10000 [00:49<00:47, 114.98 permutations/s]
Permutation test:  46%|████▌     | 4576/10000 [00:49<00:50, 108.00 permutations/s]
Permutation test:  46%|████▌     | 4589/10000 [00:49<00:48, 112.65 permutations/s]
Permutation test:  46%|████▌     | 4601/10000 [00:50<00:51, 104.71 permutations/s]
Permutation test:  46%|████▌     | 4614/10000 [00:50<00:48, 109.97 permutations/s]
Permutation test:  46%|████▋     | 4627/10000 [00:50<00:49, 109.44 permutations/s]
Permutation test:  46%|████▋     | 4640/10000 [00:50<00:47, 113.47 permutations/s]
Permutation test:  47%|████▋     | 4652/10000 [00:50<00:49, 107.00 permutations/s]
Permutation test:  47%|████▋     | 4665/10000 [00:50<00:47, 111.69 permutations/s]
Permutation test:  47%|████▋     | 4677/10000 [00:50<00:50, 105.62 permutations/s]
Permutation test:  47%|████▋     | 4689/10000 [00:50<00:49, 107.95 permutations/s]
Permutation test:  47%|████▋     | 4703/10000 [00:50<00:45, 116.63 permutations/s]
Permutation test:  47%|████▋     | 4719/10000 [00:51<00:43, 121.66 permutations/s]
Permutation test:  47%|████▋     | 4732/10000 [00:51<00:47, 110.80 permutations/s]
Permutation test:  47%|████▋     | 4744/10000 [00:51<00:46, 111.94 permutations/s]
Permutation test:  48%|████▊     | 4757/10000 [00:51<00:45, 115.69 permutations/s]
Permutation test:  48%|████▊     | 4769/10000 [00:51<00:51, 101.59 permutations/s]
Permutation test:  48%|████▊     | 4781/10000 [00:51<00:49, 105.85 permutations/s]
Permutation test:  48%|████▊     | 4795/10000 [00:51<00:50, 102.95 permutations/s]
Permutation test:  48%|████▊     | 4809/10000 [00:51<00:46, 111.18 permutations/s]
Permutation test:  48%|████▊     | 4822/10000 [00:52<00:45, 114.94 permutations/s]
Permutation test:  48%|████▊     | 4834/10000 [00:52<00:48, 106.96 permutations/s]
Permutation test:  48%|████▊     | 4845/10000 [00:52<00:51, 99.36 permutations/s]
Permutation test:  49%|████▊     | 4858/10000 [00:52<00:49, 104.14 permutations/s]
Permutation test:  49%|████▊     | 4872/10000 [00:52<00:46, 111.25 permutations/s]
Permutation test:  49%|████▉     | 4884/10000 [00:52<00:49, 102.43 permutations/s]
Permutation test:  49%|████▉     | 4898/10000 [00:52<00:46, 110.80 permutations/s]
Permutation test:  49%|████▉     | 4910/10000 [00:52<00:45, 112.57 permutations/s]
Permutation test:  49%|████▉     | 4925/10000 [00:52<00:42, 120.63 permutations/s]
Permutation test:  49%|████▉     | 4938/10000 [00:53<00:45, 110.13 permutations/s]
Permutation test:  50%|████▉     | 4952/10000 [00:53<00:43, 116.99 permutations/s]
Permutation test:  50%|████▉     | 4964/10000 [00:53<00:42, 117.64 permutations/s]
Permutation test:  50%|████▉     | 4976/10000 [00:53<00:46, 108.72 permutations/s]
Permutation test:  50%|████▉     | 4988/10000 [00:53<00:45, 110.26 permutations/s]
Permutation test:  50%|█████     | 5001/10000 [00:53<00:44, 113.37 permutations/s]
Permutation test:  50%|█████     | 5015/10000 [00:53<00:41, 119.52 permutations/s]
Permutation test:  50%|█████     | 5028/10000 [00:53<00:41, 121.22 permutations/s]
Permutation test:  50%|█████     | 5041/10000 [00:53<00:42, 116.91 permutations/s]
Permutation test:  51%|█████     | 5053/10000 [00:54<00:46, 107.11 permutations/s]
Permutation test:  51%|█████     | 5066/10000 [00:54<00:43, 112.15 permutations/s]
Permutation test:  51%|█████     | 5078/10000 [00:54<00:43, 112.93 permutations/s]
Permutation test:  51%|█████     | 5090/10000 [00:54<00:43, 112.31 permutations/s]
Permutation test:  51%|█████     | 5102/10000 [00:54<00:44, 109.99 permutations/s]
Permutation test:  51%|█████     | 5114/10000 [00:54<00:47, 102.30 permutations/s]
Permutation test:  51%|█████▏    | 5130/10000 [00:54<00:41, 117.51 permutations/s]
Permutation test:  51%|█████▏    | 5143/10000 [00:54<00:46, 104.14 permutations/s]
Permutation test:  52%|█████▏    | 5158/10000 [00:55<00:45, 107.53 permutations/s]
Permutation test:  52%|█████▏    | 5170/10000 [00:55<00:47, 100.73 permutations/s]
Permutation test:  52%|█████▏    | 5184/10000 [00:55<00:44, 108.31 permutations/s]
Permutation test:  52%|█████▏    | 5197/10000 [00:55<00:42, 112.67 permutations/s]
Permutation test:  52%|█████▏    | 5209/10000 [00:55<00:43, 109.06 permutations/s]
Permutation test:  52%|█████▏    | 5221/10000 [00:55<00:42, 111.72 permutations/s]
Permutation test:  52%|█████▏    | 5234/10000 [00:55<00:41, 115.47 permutations/s]
Permutation test:  52%|█████▏    | 5246/10000 [00:55<00:43, 108.21 permutations/s]
Permutation test:  53%|█████▎    | 5260/10000 [00:55<00:40, 115.70 permutations/s]
Permutation test:  53%|█████▎    | 5272/10000 [00:56<00:44, 107.39 permutations/s]
Permutation test:  53%|█████▎    | 5284/10000 [00:56<00:43, 109.50 permutations/s]
Permutation test:  53%|█████▎    | 5296/10000 [00:56<00:42, 111.48 permutations/s]
Permutation test:  53%|█████▎    | 5308/10000 [00:56<00:45, 103.97 permutations/s]
Permutation test:  53%|█████▎    | 5322/10000 [00:56<00:43, 108.40 permutations/s]
Permutation test:  53%|█████▎    | 5333/10000 [00:56<00:44, 105.19 permutations/s]
Permutation test:  53%|█████▎    | 5346/10000 [00:56<00:42, 110.61 permutations/s]
Permutation test:  54%|█████▎    | 5360/10000 [00:56<00:39, 117.45 permutations/s]
Permutation test:  54%|█████▎    | 5374/10000 [00:57<00:38, 120.07 permutations/s]
Permutation test:  54%|█████▍    | 5387/10000 [00:57<00:44, 102.78 permutations/s]
Permutation test:  54%|█████▍    | 5400/10000 [00:57<00:42, 107.75 permutations/s]
Permutation test:  54%|█████▍    | 5414/10000 [00:57<00:39, 114.84 permutations/s]
Permutation test:  54%|█████▍    | 5426/10000 [00:57<00:39, 115.09 permutations/s]
Permutation test:  54%|█████▍    | 5438/10000 [00:57<00:44, 102.79 permutations/s]
Permutation test:  55%|█████▍    | 5452/10000 [00:57<00:40, 111.18 permutations/s]
Permutation test:  55%|█████▍    | 5464/10000 [00:57<00:39, 113.52 permutations/s]
Permutation test:  55%|█████▍    | 5477/10000 [00:57<00:42, 106.44 permutations/s]
Permutation test:  55%|█████▍    | 5488/10000 [00:58<00:42, 106.15 permutations/s]
Permutation test:  55%|█████▌    | 5501/10000 [00:58<00:41, 107.89 permutations/s]
Permutation test:  55%|█████▌    | 5515/10000 [00:58<00:38, 115.61 permutations/s]
Permutation test:  55%|█████▌    | 5527/10000 [00:58<00:41, 107.30 permutations/s]
Permutation test:  55%|█████▌    | 5540/10000 [00:58<00:40, 109.51 permutations/s]
Permutation test:  56%|█████▌    | 5554/10000 [00:58<00:38, 115.15 permutations/s]
Permutation test:  56%|█████▌    | 5566/10000 [00:58<00:39, 113.12 permutations/s]
Permutation test:  56%|█████▌    | 5578/10000 [00:58<00:40, 110.30 permutations/s]
Permutation test:  56%|█████▌    | 5590/10000 [00:59<00:45, 96.43 permutations/s]
Permutation test:  56%|█████▌    | 5602/10000 [00:59<00:43, 100.72 permutations/s]
Permutation test:  56%|█████▌    | 5615/10000 [00:59<00:41, 106.27 permutations/s]
Permutation test:  56%|█████▋    | 5626/10000 [00:59<00:42, 102.92 permutations/s]
Permutation test:  56%|█████▋    | 5639/10000 [00:59<00:40, 108.98 permutations/s]
Permutation test:  57%|█████▋    | 5651/10000 [00:59<00:45, 96.03 permutations/s]
Permutation test:  57%|█████▋    | 5661/10000 [00:59<00:46, 93.08 permutations/s]
Permutation test:  57%|█████▋    | 5673/10000 [00:59<00:44, 98.33 permutations/s]
Permutation test:  57%|█████▋    | 5684/10000 [00:59<00:43, 98.24 permutations/s]
Permutation test:  57%|█████▋    | 5696/10000 [01:00<00:41, 102.96 permutations/s]
Permutation test:  57%|█████▋    | 5708/10000 [01:00<00:40, 106.45 permutations/s]
Permutation test:  57%|█████▋    | 5719/10000 [01:00<00:40, 106.89 permutations/s]
Permutation test:  57%|█████▋    | 5730/10000 [01:00<00:43, 97.51 permutations/s]
Permutation test:  57%|█████▋    | 5744/10000 [01:00<00:39, 107.70 permutations/s]
Permutation test:  58%|█████▊    | 5755/10000 [01:00<00:40, 104.86 permutations/s]
Permutation test:  58%|█████▊    | 5767/10000 [01:00<00:38, 108.65 permutations/s]
Permutation test:  58%|█████▊    | 5784/10000 [01:00<00:34, 120.66 permutations/s]
Permutation test:  58%|█████▊    | 5797/10000 [01:00<00:35, 118.02 permutations/s]
Permutation test:  58%|█████▊    | 5809/10000 [01:01<00:36, 113.28 permutations/s]
Permutation test:  58%|█████▊    | 5821/10000 [01:01<00:40, 103.96 permutations/s]
Permutation test:  58%|█████▊    | 5832/10000 [01:01<00:42, 97.37 permutations/s]
Permutation test:  58%|█████▊    | 5845/10000 [01:01<00:39, 104.77 permutations/s]
Permutation test:  59%|█████▊    | 5859/10000 [01:01<00:37, 111.77 permutations/s]
Permutation test:  59%|█████▊    | 5872/10000 [01:01<00:35, 115.34 permutations/s]
Permutation test:  59%|█████▉    | 5885/10000 [01:01<00:34, 118.21 permutations/s]
Permutation test:  59%|█████▉    | 5898/10000 [01:01<00:34, 117.33 permutations/s]
Permutation test:  59%|█████▉    | 5912/10000 [01:02<00:33, 122.53 permutations/s]
Permutation test:  59%|█████▉    | 5925/10000 [01:02<00:35, 115.44 permutations/s]
Permutation test:  59%|█████▉    | 5938/10000 [01:02<00:34, 116.73 permutations/s]
Permutation test:  60%|█████▉    | 5950/10000 [01:02<00:36, 110.22 permutations/s]
Permutation test:  60%|█████▉    | 5964/10000 [01:02<00:34, 115.98 permutations/s]
Permutation test:  60%|█████▉    | 5977/10000 [01:02<00:33, 118.59 permutations/s]
Permutation test:  60%|█████▉    | 5989/10000 [01:02<00:35, 113.85 permutations/s]
Permutation test:  60%|██████    | 6001/10000 [01:02<00:35, 111.69 permutations/s]
Permutation test:  60%|██████    | 6013/10000 [01:02<00:40, 99.37 permutations/s]
Permutation test:  60%|██████    | 6024/10000 [01:03<00:40, 98.77 permutations/s]
Permutation test:  60%|██████    | 6035/10000 [01:03<00:41, 96.70 permutations/s]
Permutation test:  60%|██████    | 6048/10000 [01:03<00:38, 103.94 permutations/s]
Permutation test:  61%|██████    | 6061/10000 [01:03<00:35, 109.71 permutations/s]
Permutation test:  61%|██████    | 6074/10000 [01:03<00:34, 114.51 permutations/s]
Permutation test:  61%|██████    | 6086/10000 [01:03<00:34, 114.48 permutations/s]
Permutation test:  61%|██████    | 6099/10000 [01:03<00:33, 117.47 permutations/s]
Permutation test:  61%|██████    | 6112/10000 [01:03<00:32, 120.98 permutations/s]
Permutation test:  61%|██████▏   | 6125/10000 [01:03<00:32, 120.89 permutations/s]
Permutation test:  61%|██████▏   | 6138/10000 [01:04<00:37, 102.27 permutations/s]
Permutation test:  61%|██████▏   | 6149/10000 [01:04<00:39, 97.08 permutations/s]
Permutation test:  62%|██████▏   | 6166/10000 [01:04<00:33, 114.89 permutations/s]
Permutation test:  62%|██████▏   | 6179/10000 [01:04<00:39, 96.82 permutations/s]
Permutation test:  62%|██████▏   | 6193/10000 [01:04<00:35, 106.53 permutations/s]
Permutation test:  62%|██████▏   | 6205/10000 [01:04<00:36, 104.64 permutations/s]
Permutation test:  62%|██████▏   | 6217/10000 [01:04<00:40, 94.40 permutations/s]
Permutation test:  62%|██████▏   | 6227/10000 [01:04<00:39, 94.82 permutations/s]
Permutation test:  62%|██████▏   | 6237/10000 [01:05<00:41, 91.27 permutations/s]
Permutation test:  62%|██████▏   | 6247/10000 [01:05<00:46, 81.06 permutations/s]
Permutation test:  63%|██████▎   | 6261/10000 [01:05<00:40, 93.41 permutations/s]
Permutation test:  63%|██████▎   | 6275/10000 [01:05<00:35, 103.78 permutations/s]
Permutation test:  63%|██████▎   | 6286/10000 [01:05<00:36, 101.61 permutations/s]
Permutation test:  63%|██████▎   | 6297/10000 [01:05<00:36, 102.59 permutations/s]
Permutation test:  63%|██████▎   | 6312/10000 [01:05<00:32, 113.18 permutations/s]
Permutation test:  63%|██████▎   | 6330/10000 [01:05<00:28, 129.57 permutations/s]
Permutation test:  63%|██████▎   | 6344/10000 [01:06<00:40, 90.41 permutations/s]
Permutation test:  64%|██████▎   | 6355/10000 [01:06<00:45, 79.45 permutations/s]
Permutation test:  64%|██████▎   | 6365/10000 [01:06<00:46, 78.16 permutations/s]
Permutation test:  64%|██████▎   | 6374/10000 [01:06<00:47, 75.80 permutations/s]
Permutation test:  64%|██████▍   | 6384/10000 [01:06<00:44, 80.69 permutations/s]
Permutation test:  64%|██████▍   | 6393/10000 [01:06<00:47, 75.32 permutations/s]
Permutation test:  64%|██████▍   | 6404/10000 [01:06<00:43, 82.90 permutations/s]
Permutation test:  64%|██████▍   | 6413/10000 [01:07<00:43, 83.22 permutations/s]
Permutation test:  64%|██████▍   | 6425/10000 [01:07<00:40, 88.54 permutations/s]
Permutation test:  64%|██████▍   | 6435/10000 [01:07<00:40, 87.48 permutations/s]
Permutation test:  64%|██████▍   | 6444/10000 [01:07<00:41, 86.54 permutations/s]
Permutation test:  65%|██████▍   | 6455/10000 [01:07<00:39, 90.78 permutations/s]
Permutation test:  65%|██████▍   | 6465/10000 [01:07<00:38, 91.34 permutations/s]
Permutation test:  65%|██████▍   | 6478/10000 [01:07<00:34, 100.93 permutations/s]
Permutation test:  65%|██████▍   | 6489/10000 [01:07<00:33, 103.43 permutations/s]
Permutation test:  65%|██████▌   | 6500/10000 [01:08<00:40, 86.14 permutations/s]
Permutation test:  65%|██████▌   | 6512/10000 [01:08<00:39, 88.84 permutations/s]
Permutation test:  65%|██████▌   | 6525/10000 [01:08<00:37, 91.79 permutations/s]
Permutation test:  65%|██████▌   | 6538/10000 [01:08<00:34, 101.01 permutations/s]
Permutation test:  66%|██████▌   | 6551/10000 [01:08<00:34, 98.89 permutations/s]
Permutation test:  66%|██████▌   | 6563/10000 [01:08<00:34, 99.34 permutations/s]
Permutation test:  66%|██████▌   | 6574/10000 [01:08<00:34, 99.84 permutations/s]
Permutation test:  66%|██████▌   | 6586/10000 [01:08<00:33, 101.78 permutations/s]
Permutation test:  66%|██████▌   | 6597/10000 [01:09<00:37, 89.72 permutations/s]
Permutation test:  66%|██████▌   | 6607/10000 [01:09<00:36, 91.88 permutations/s]
Permutation test:  66%|██████▌   | 6617/10000 [01:09<00:38, 88.56 permutations/s]
Permutation test:  66%|██████▋   | 6627/10000 [01:09<00:38, 88.66 permutations/s]
Permutation test:  66%|██████▋   | 6637/10000 [01:09<00:38, 88.04 permutations/s]
Permutation test:  67%|██████▋   | 6651/10000 [01:09<00:33, 100.82 permutations/s]
Permutation test:  67%|██████▋   | 6666/10000 [01:09<00:30, 110.61 permutations/s]
Permutation test:  67%|██████▋   | 6679/10000 [01:09<00:28, 114.70 permutations/s]
Permutation test:  67%|██████▋   | 6691/10000 [01:09<00:29, 113.67 permutations/s]
Permutation test:  67%|██████▋   | 6704/10000 [01:10<00:27, 118.20 permutations/s]
Permutation test:  67%|██████▋   | 6716/10000 [01:10<00:28, 113.61 permutations/s]
Permutation test:  67%|██████▋   | 6730/10000 [01:10<00:27, 118.92 permutations/s]
Permutation test:  67%|██████▋   | 6744/10000 [01:10<00:26, 122.79 permutations/s]
Permutation test:  68%|██████▊   | 6757/10000 [01:10<00:25, 124.83 permutations/s]
Permutation test:  68%|██████▊   | 6770/10000 [01:10<00:27, 117.02 permutations/s]
Permutation test:  68%|██████▊   | 6782/10000 [01:10<00:28, 112.26 permutations/s]
Permutation test:  68%|██████▊   | 6794/10000 [01:10<00:30, 105.32 permutations/s]
Permutation test:  68%|██████▊   | 6807/10000 [01:10<00:29, 109.98 permutations/s]
Permutation test:  68%|██████▊   | 6819/10000 [01:11<00:41, 77.49 permutations/s]
Permutation test:  68%|██████▊   | 6829/10000 [01:11<00:52, 60.72 permutations/s]
Permutation test:  68%|██████▊   | 6837/10000 [01:11<00:58, 53.79 permutations/s]
Permutation test:  68%|██████▊   | 6844/10000 [01:11<01:03, 49.82 permutations/s]
Permutation test:  68%|██████▊   | 6850/10000 [01:12<01:06, 47.18 permutations/s]
Permutation test:  69%|██████▊   | 6856/10000 [01:12<01:08, 45.78 permutations/s]
Permutation test:  69%|██████▊   | 6861/10000 [01:12<01:13, 42.82 permutations/s]
Permutation test:  69%|██████▊   | 6866/10000 [01:12<01:16, 41.20 permutations/s]
Permutation test:  69%|██████▊   | 6871/10000 [01:12<01:18, 40.03 permutations/s]
Permutation test:  69%|██████▉   | 6876/10000 [01:12<01:21, 38.40 permutations/s]
Permutation test:  69%|██████▉   | 6881/10000 [01:12<01:18, 39.64 permutations/s]
Permutation test:  69%|██████▉   | 6886/10000 [01:12<01:16, 40.91 permutations/s]
Permutation test:  69%|██████▉   | 6891/10000 [01:13<01:22, 37.89 permutations/s]
Permutation test:  69%|██████▉   | 6896/10000 [01:13<01:21, 37.89 permutations/s]
Permutation test:  69%|██████▉   | 6901/10000 [01:13<01:19, 38.95 permutations/s]
Permutation test:  69%|██████▉   | 6905/10000 [01:13<01:22, 37.68 permutations/s]
Permutation test:  69%|██████▉   | 6910/10000 [01:13<01:19, 38.96 permutations/s]
Permutation test:  69%|██████▉   | 6914/10000 [01:13<01:18, 39.10 permutations/s]
Permutation test:  69%|██████▉   | 6918/10000 [01:13<01:20, 38.22 permutations/s]
Permutation test:  69%|██████▉   | 6923/10000 [01:13<01:20, 38.23 permutations/s]
Permutation test:  69%|██████▉   | 6927/10000 [01:14<01:19, 38.45 permutations/s]
Permutation test:  69%|██████▉   | 6932/10000 [01:14<01:21, 37.56 permutations/s]
Permutation test:  69%|██████▉   | 6936/10000 [01:14<01:21, 37.78 permutations/s]
Permutation test:  69%|██████▉   | 6940/10000 [01:14<01:21, 37.56 permutations/s]
Permutation test:  69%|██████▉   | 6945/10000 [01:14<01:20, 38.06 permutations/s]
Permutation test:  70%|██████▉   | 6950/10000 [01:14<01:17, 39.14 permutations/s]
Permutation test:  70%|██████▉   | 6955/10000 [01:14<01:20, 37.99 permutations/s]
Permutation test:  70%|██████▉   | 6959/10000 [01:14<01:18, 38.49 permutations/s]
Permutation test:  70%|██████▉   | 6964/10000 [01:14<01:17, 39.05 permutations/s]
Permutation test:  70%|██████▉   | 6968/10000 [01:15<01:22, 36.88 permutations/s]
Permutation test:  70%|██████▉   | 6972/10000 [01:15<01:23, 36.40 permutations/s]
Permutation test:  70%|██████▉   | 6976/10000 [01:15<01:22, 36.84 permutations/s]
Permutation test:  70%|██████▉   | 6980/10000 [01:15<01:20, 37.31 permutations/s]
Permutation test:  70%|██████▉   | 6985/10000 [01:15<01:22, 36.38 permutations/s]
Permutation test:  70%|██████▉   | 6989/10000 [01:15<01:23, 36.17 permutations/s]
Permutation test:  70%|██████▉   | 6994/10000 [01:15<01:17, 38.67 permutations/s]
Permutation test:  70%|██████▉   | 6998/10000 [01:15<01:21, 37.00 permutations/s]
Permutation test:  70%|███████   | 7002/10000 [01:16<01:20, 37.40 permutations/s]
Permutation test:  70%|███████   | 7006/10000 [01:16<01:19, 37.70 permutations/s]
Permutation test:  70%|███████   | 7010/10000 [01:16<01:19, 37.46 permutations/s]
Permutation test:  70%|███████   | 7015/10000 [01:16<01:14, 40.18 permutations/s]
Permutation test:  70%|███████   | 7020/10000 [01:16<01:17, 38.22 permutations/s]
Permutation test:  70%|███████   | 7025/10000 [01:16<01:20, 36.97 permutations/s]
Permutation test:  70%|███████   | 7030/10000 [01:16<01:18, 37.99 permutations/s]
Permutation test:  70%|███████   | 7034/10000 [01:16<01:18, 37.68 permutations/s]
Permutation test:  70%|███████   | 7039/10000 [01:16<01:15, 39.35 permutations/s]
Permutation test:  70%|███████   | 7043/10000 [01:17<01:15, 39.27 permutations/s]
Permutation test:  70%|███████   | 7050/10000 [01:17<01:02, 47.37 permutations/s]
Permutation test:  71%|███████   | 7059/10000 [01:17<00:50, 58.01 permutations/s]
Permutation test:  71%|███████   | 7070/10000 [01:17<00:42, 68.66 permutations/s]
Permutation test:  71%|███████   | 7081/10000 [01:17<00:38, 75.95 permutations/s]
Permutation test:  71%|███████   | 7093/10000 [01:17<00:35, 80.94 permutations/s]
Permutation test:  71%|███████   | 7105/10000 [01:17<00:34, 83.28 permutations/s]
Permutation test:  71%|███████   | 7114/10000 [01:17<00:35, 81.54 permutations/s]
Permutation test:  71%|███████▏  | 7127/10000 [01:18<00:30, 94.10 permutations/s]
Permutation test:  71%|███████▏  | 7137/10000 [01:18<00:30, 93.95 permutations/s]
Permutation test:  71%|███████▏  | 7147/10000 [01:18<00:31, 91.21 permutations/s]
Permutation test:  72%|███████▏  | 7157/10000 [01:18<00:38, 73.63 permutations/s]
Permutation test:  72%|███████▏  | 7165/10000 [01:18<00:40, 69.91 permutations/s]
Permutation test:  72%|███████▏  | 7173/10000 [01:18<00:41, 68.88 permutations/s]
Permutation test:  72%|███████▏  | 7181/10000 [01:18<00:41, 67.47 permutations/s]
Permutation test:  72%|███████▏  | 7191/10000 [01:18<00:38, 72.98 permutations/s]
Permutation test:  72%|███████▏  | 7201/10000 [01:19<00:35, 78.80 permutations/s]
Permutation test:  72%|███████▏  | 7210/10000 [01:19<00:36, 76.48 permutations/s]
Permutation test:  72%|███████▏  | 7220/10000 [01:19<00:33, 82.48 permutations/s]
Permutation test:  72%|███████▏  | 7229/10000 [01:19<00:35, 77.02 permutations/s]
Permutation test:  72%|███████▏  | 7237/10000 [01:19<00:36, 75.94 permutations/s]
Permutation test:  72%|███████▏  | 7245/10000 [01:19<00:40, 67.85 permutations/s]
Permutation test:  73%|███████▎  | 7252/10000 [01:19<00:43, 63.40 permutations/s]
Permutation test:  73%|███████▎  | 7261/10000 [01:19<00:39, 69.88 permutations/s]
Permutation test:  73%|███████▎  | 7269/10000 [01:20<00:47, 57.99 permutations/s]
Permutation test:  73%|███████▎  | 7277/10000 [01:20<00:45, 60.29 permutations/s]
Permutation test:  73%|███████▎  | 7284/10000 [01:20<00:45, 59.22 permutations/s]
Permutation test:  73%|███████▎  | 7291/10000 [01:20<00:47, 56.90 permutations/s]
Permutation test:  73%|███████▎  | 7297/10000 [01:20<00:50, 53.27 permutations/s]
Permutation test:  73%|███████▎  | 7305/10000 [01:20<00:46, 58.26 permutations/s]
Permutation test:  73%|███████▎  | 7312/10000 [01:20<00:44, 59.95 permutations/s]
Permutation test:  73%|███████▎  | 7320/10000 [01:20<00:41, 64.40 permutations/s]
Permutation test:  73%|███████▎  | 7333/10000 [01:21<00:33, 80.47 permutations/s]
Permutation test:  73%|███████▎  | 7346/10000 [01:21<00:28, 93.45 permutations/s]
Permutation test:  74%|███████▎  | 7356/10000 [01:21<00:30, 86.96 permutations/s]
Permutation test:  74%|███████▎  | 7365/10000 [01:21<00:36, 73.09 permutations/s]
Permutation test:  74%|███████▎  | 7373/10000 [01:21<00:36, 72.63 permutations/s]
Permutation test:  74%|███████▍  | 7381/10000 [01:21<00:35, 74.20 permutations/s]
Permutation test:  74%|███████▍  | 7389/10000 [01:21<00:42, 60.96 permutations/s]
Permutation test:  74%|███████▍  | 7396/10000 [01:22<00:46, 56.38 permutations/s]
Permutation test:  74%|███████▍  | 7403/10000 [01:22<00:44, 58.64 permutations/s]
Permutation test:  74%|███████▍  | 7412/10000 [01:22<00:40, 63.13 permutations/s]
Permutation test:  74%|███████▍  | 7419/10000 [01:22<00:44, 58.51 permutations/s]
Permutation test:  74%|███████▍  | 7426/10000 [01:22<00:42, 61.05 permutations/s]
Permutation test:  74%|███████▍  | 7435/10000 [01:22<00:38, 67.25 permutations/s]
Permutation test:  74%|███████▍  | 7443/10000 [01:22<00:36, 69.88 permutations/s]
Permutation test:  75%|███████▍  | 7451/10000 [01:22<00:36, 68.91 permutations/s]
Permutation test:  75%|███████▍  | 7459/10000 [01:22<00:42, 60.20 permutations/s]
Permutation test:  75%|███████▍  | 7470/10000 [01:23<00:36, 68.98 permutations/s]
Permutation test:  75%|███████▍  | 7479/10000 [01:23<00:36, 69.94 permutations/s]
Permutation test:  75%|███████▍  | 7487/10000 [01:23<00:35, 70.54 permutations/s]
Permutation test:  75%|███████▍  | 7495/10000 [01:23<00:41, 60.79 permutations/s]
Permutation test:  75%|███████▌  | 7507/10000 [01:23<00:33, 73.59 permutations/s]
Permutation test:  75%|███████▌  | 7515/10000 [01:23<00:33, 74.80 permutations/s]
Permutation test:  75%|███████▌  | 7528/10000 [01:23<00:28, 87.05 permutations/s]
Permutation test:  75%|███████▌  | 7538/10000 [01:23<00:29, 83.19 permutations/s]
Permutation test:  75%|███████▌  | 7549/10000 [01:24<00:27, 89.29 permutations/s]
Permutation test:  76%|███████▌  | 7562/10000 [01:24<00:24, 99.17 permutations/s]
Permutation test:  76%|███████▌  | 7573/10000 [01:24<00:26, 92.85 permutations/s]
Permutation test:  76%|███████▌  | 7583/10000 [01:24<00:27, 88.57 permutations/s]
Permutation test:  76%|███████▌  | 7594/10000 [01:24<00:25, 93.83 permutations/s]
Permutation test:  76%|███████▌  | 7604/10000 [01:24<00:28, 83.51 permutations/s]
Permutation test:  76%|███████▌  | 7615/10000 [01:24<00:26, 88.61 permutations/s]
Permutation test:  76%|███████▋  | 7625/10000 [01:24<00:30, 77.33 permutations/s]
Permutation test:  76%|███████▋  | 7636/10000 [01:25<00:28, 84.01 permutations/s]
Permutation test:  76%|███████▋  | 7645/10000 [01:25<00:31, 74.82 permutations/s]
Permutation test:  77%|███████▋  | 7653/10000 [01:25<00:32, 72.73 permutations/s]
Permutation test:  77%|███████▋  | 7661/10000 [01:25<00:31, 74.38 permutations/s]
Permutation test:  77%|███████▋  | 7669/10000 [01:25<00:31, 73.65 permutations/s]
Permutation test:  77%|███████▋  | 7677/10000 [01:25<00:34, 68.17 permutations/s]
Permutation test:  77%|███████▋  | 7686/10000 [01:25<00:32, 71.59 permutations/s]
Permutation test:  77%|███████▋  | 7700/10000 [01:25<00:26, 86.73 permutations/s]
Permutation test:  77%|███████▋  | 7709/10000 [01:26<00:27, 83.08 permutations/s]
Permutation test:  77%|███████▋  | 7723/10000 [01:26<00:25, 87.95 permutations/s]
Permutation test:  77%|███████▋  | 7733/10000 [01:26<00:27, 83.40 permutations/s]
Permutation test:  77%|███████▋  | 7743/10000 [01:26<00:27, 82.66 permutations/s]
Permutation test:  78%|███████▊  | 7752/10000 [01:26<00:30, 72.58 permutations/s]
Permutation test:  78%|███████▊  | 7760/10000 [01:26<00:31, 72.22 permutations/s]
Permutation test:  78%|███████▊  | 7768/10000 [01:26<00:31, 71.68 permutations/s]
Permutation test:  78%|███████▊  | 7776/10000 [01:26<00:31, 71.41 permutations/s]
Permutation test:  78%|███████▊  | 7784/10000 [01:27<00:33, 66.17 permutations/s]
Permutation test:  78%|███████▊  | 7791/10000 [01:27<00:34, 64.38 permutations/s]
Permutation test:  78%|███████▊  | 7798/10000 [01:27<00:39, 55.69 permutations/s]
Permutation test:  78%|███████▊  | 7804/10000 [01:27<00:40, 54.19 permutations/s]
Permutation test:  78%|███████▊  | 7810/10000 [01:27<00:42, 50.94 permutations/s]
Permutation test:  78%|███████▊  | 7816/10000 [01:27<00:47, 46.17 permutations/s]
Permutation test:  78%|███████▊  | 7821/10000 [01:27<00:49, 44.27 permutations/s]
Permutation test:  78%|███████▊  | 7831/10000 [01:28<00:38, 56.83 permutations/s]
Permutation test:  78%|███████▊  | 7844/10000 [01:28<00:31, 67.69 permutations/s]
Permutation test:  79%|███████▊  | 7851/10000 [01:28<00:31, 68.23 permutations/s]
Permutation test:  79%|███████▊  | 7863/10000 [01:28<00:26, 79.75 permutations/s]
Permutation test:  79%|███████▉  | 7876/10000 [01:28<00:23, 92.26 permutations/s]
Permutation test:  79%|███████▉  | 7886/10000 [01:28<00:22, 92.55 permutations/s]
Permutation test:  79%|███████▉  | 7899/10000 [01:28<00:21, 97.58 permutations/s]
Permutation test:  79%|███████▉  | 7912/10000 [01:28<00:19, 104.67 permutations/s]
Permutation test:  79%|███████▉  | 7923/10000 [01:28<00:23, 88.71 permutations/s]
Permutation test:  79%|███████▉  | 7934/10000 [01:29<00:23, 87.28 permutations/s]
Permutation test:  79%|███████▉  | 7946/10000 [01:29<00:21, 93.64 permutations/s]
Permutation test:  80%|███████▉  | 7956/10000 [01:29<00:23, 88.83 permutations/s]
Permutation test:  80%|███████▉  | 7966/10000 [01:29<00:22, 88.95 permutations/s]
Permutation test:  80%|███████▉  | 7980/10000 [01:29<00:20, 99.11 permutations/s]
Permutation test:  80%|███████▉  | 7994/10000 [01:29<00:18, 106.55 permutations/s]
Permutation test:  80%|████████  | 8007/10000 [01:29<00:18, 110.62 permutations/s]
Permutation test:  80%|████████  | 8020/10000 [01:29<00:17, 113.35 permutations/s]
Permutation test:  80%|████████  | 8033/10000 [01:30<00:16, 116.71 permutations/s]
Permutation test:  80%|████████  | 8045/10000 [01:30<00:17, 110.95 permutations/s]
Permutation test:  81%|████████  | 8057/10000 [01:30<00:17, 113.34 permutations/s]
Permutation test:  81%|████████  | 8069/10000 [01:30<00:19, 97.65 permutations/s]
Permutation test:  81%|████████  | 8081/10000 [01:30<00:18, 102.66 permutations/s]
Permutation test:  81%|████████  | 8095/10000 [01:30<00:17, 108.23 permutations/s]
Permutation test:  81%|████████  | 8107/10000 [01:30<00:22, 84.20 permutations/s]
Permutation test:  81%|████████  | 8117/10000 [01:30<00:22, 83.94 permutations/s]
Permutation test:  81%|████████▏ | 8127/10000 [01:31<00:23, 79.11 permutations/s]
Permutation test:  81%|████████▏ | 8136/10000 [01:31<00:23, 79.97 permutations/s]
Permutation test:  81%|████████▏ | 8147/10000 [01:31<00:21, 86.36 permutations/s]
Permutation test:  82%|████████▏ | 8159/10000 [01:31<00:20, 88.64 permutations/s]
Permutation test:  82%|████████▏ | 8171/10000 [01:31<00:19, 95.84 permutations/s]
Permutation test:  82%|████████▏ | 8181/10000 [01:31<00:20, 87.16 permutations/s]
Permutation test:  82%|████████▏ | 8191/10000 [01:31<00:22, 80.84 permutations/s]
Permutation test:  82%|████████▏ | 8204/10000 [01:31<00:19, 91.38 permutations/s]
Permutation test:  82%|████████▏ | 8214/10000 [01:32<00:20, 87.98 permutations/s]
Permutation test:  82%|████████▏ | 8224/10000 [01:32<00:19, 89.57 permutations/s]
Permutation test:  82%|████████▏ | 8237/10000 [01:32<00:18, 97.81 permutations/s]
Permutation test:  82%|████████▎ | 8250/10000 [01:32<00:16, 106.43 permutations/s]
Permutation test:  83%|████████▎ | 8261/10000 [01:32<00:16, 105.16 permutations/s]
Permutation test:  83%|████████▎ | 8272/10000 [01:32<00:16, 104.16 permutations/s]
Permutation test:  83%|████████▎ | 8285/10000 [01:32<00:16, 106.45 permutations/s]
Permutation test:  83%|████████▎ | 8296/10000 [01:32<00:16, 105.17 permutations/s]
Permutation test:  83%|████████▎ | 8309/10000 [01:32<00:15, 108.79 permutations/s]
Permutation test:  83%|████████▎ | 8320/10000 [01:33<00:16, 102.02 permutations/s]
Permutation test:  83%|████████▎ | 8331/10000 [01:33<00:18, 92.64 permutations/s]
Permutation test:  83%|████████▎ | 8344/10000 [01:33<00:16, 100.76 permutations/s]
Permutation test:  84%|████████▎ | 8355/10000 [01:33<00:16, 100.62 permutations/s]
Permutation test:  84%|████████▎ | 8366/10000 [01:33<00:17, 93.66 permutations/s]
Permutation test:  84%|████████▍ | 8376/10000 [01:33<00:17, 91.71 permutations/s]
Permutation test:  84%|████████▍ | 8388/10000 [01:33<00:16, 98.80 permutations/s]
Permutation test:  84%|████████▍ | 8399/10000 [01:33<00:17, 89.97 permutations/s]
Permutation test:  84%|████████▍ | 8411/10000 [01:34<00:16, 96.68 permutations/s]
Permutation test:  84%|████████▍ | 8421/10000 [01:34<00:19, 81.85 permutations/s]
Permutation test:  84%|████████▍ | 8433/10000 [01:34<00:17, 90.99 permutations/s]
Permutation test:  84%|████████▍ | 8447/10000 [01:34<00:15, 100.56 permutations/s]
Permutation test:  85%|████████▍ | 8458/10000 [01:34<00:16, 92.42 permutations/s]
Permutation test:  85%|████████▍ | 8468/10000 [01:34<00:16, 93.41 permutations/s]
Permutation test:  85%|████████▍ | 8478/10000 [01:34<00:16, 90.11 permutations/s]
Permutation test:  85%|████████▍ | 8488/10000 [01:34<00:16, 91.91 permutations/s]
Permutation test:  85%|████████▌ | 8500/10000 [01:34<00:15, 98.47 permutations/s]
Permutation test:  85%|████████▌ | 8511/10000 [01:35<00:15, 96.75 permutations/s]
Permutation test:  85%|████████▌ | 8523/10000 [01:35<00:14, 99.19 permutations/s]
Permutation test:  85%|████████▌ | 8534/10000 [01:35<00:20, 72.00 permutations/s]
Permutation test:  85%|████████▌ | 8543/10000 [01:35<00:25, 56.65 permutations/s]
Permutation test:  86%|████████▌ | 8550/10000 [01:35<00:28, 50.43 permutations/s]
Permutation test:  86%|████████▌ | 8556/10000 [01:36<00:30, 47.97 permutations/s]
Permutation test:  86%|████████▌ | 8562/10000 [01:36<00:33, 43.12 permutations/s]
Permutation test:  86%|████████▌ | 8567/10000 [01:36<00:33, 42.60 permutations/s]
Permutation test:  86%|████████▌ | 8572/10000 [01:36<00:35, 40.67 permutations/s]
Permutation test:  86%|████████▌ | 8577/10000 [01:36<00:35, 40.64 permutations/s]
Permutation test:  86%|████████▌ | 8582/10000 [01:36<00:35, 39.56 permutations/s]
Permutation test:  86%|████████▌ | 8587/10000 [01:36<00:37, 38.08 permutations/s]
Permutation test:  86%|████████▌ | 8592/10000 [01:37<00:35, 39.33 permutations/s]
Permutation test:  86%|████████▌ | 8596/10000 [01:37<00:36, 38.43 permutations/s]
Permutation test:  86%|████████▌ | 8601/10000 [01:37<00:37, 37.18 permutations/s]
Permutation test:  86%|████████▌ | 8605/10000 [01:37<00:37, 37.19 permutations/s]
Permutation test:  86%|████████▌ | 8609/10000 [01:37<00:38, 36.35 permutations/s]
Permutation test:  86%|████████▌ | 8613/10000 [01:37<00:38, 36.20 permutations/s]
Permutation test:  86%|████████▌ | 8617/10000 [01:37<00:37, 37.17 permutations/s]
Permutation test:  86%|████████▌ | 8622/10000 [01:37<00:35, 39.08 permutations/s]
Permutation test:  86%|████████▋ | 8626/10000 [01:37<00:37, 36.48 permutations/s]
Permutation test:  86%|████████▋ | 8631/10000 [01:38<00:35, 38.95 permutations/s]
Permutation test:  86%|████████▋ | 8635/10000 [01:38<00:37, 36.71 permutations/s]
Permutation test:  86%|████████▋ | 8640/10000 [01:38<00:35, 38.30 permutations/s]
Permutation test:  86%|████████▋ | 8644/10000 [01:38<00:35, 38.26 permutations/s]
Permutation test:  86%|████████▋ | 8648/10000 [01:38<00:35, 37.75 permutations/s]
Permutation test:  87%|████████▋ | 8652/10000 [01:38<00:36, 36.86 permutations/s]
Permutation test:  87%|████████▋ | 8657/10000 [01:38<00:35, 38.33 permutations/s]
Permutation test:  87%|████████▋ | 8662/10000 [01:38<00:34, 38.26 permutations/s]
Permutation test:  87%|████████▋ | 8666/10000 [01:39<00:35, 37.91 permutations/s]
Permutation test:  87%|████████▋ | 8671/10000 [01:39<00:33, 39.45 permutations/s]
Permutation test:  87%|████████▋ | 8676/10000 [01:39<00:32, 40.60 permutations/s]
Permutation test:  87%|████████▋ | 8681/10000 [01:39<00:34, 38.16 permutations/s]
Permutation test:  87%|████████▋ | 8686/10000 [01:39<00:31, 41.12 permutations/s]
Permutation test:  87%|████████▋ | 8691/10000 [01:39<00:33, 39.39 permutations/s]
Permutation test:  87%|████████▋ | 8696/10000 [01:39<00:34, 38.15 permutations/s]
Permutation test:  87%|████████▋ | 8700/10000 [01:39<00:33, 38.58 permutations/s]
Permutation test:  87%|████████▋ | 8704/10000 [01:39<00:33, 38.60 permutations/s]
Permutation test:  87%|████████▋ | 8708/10000 [01:40<00:33, 38.94 permutations/s]
Permutation test:  87%|████████▋ | 8713/10000 [01:40<00:32, 39.41 permutations/s]
Permutation test:  87%|████████▋ | 8717/10000 [01:40<00:34, 37.10 permutations/s]
Permutation test:  87%|████████▋ | 8722/10000 [01:40<00:32, 39.83 permutations/s]
Permutation test:  87%|████████▋ | 8727/10000 [01:40<00:31, 39.94 permutations/s]
Permutation test:  87%|████████▋ | 8732/10000 [01:40<00:32, 38.88 permutations/s]
Permutation test:  87%|████████▋ | 8737/10000 [01:40<00:33, 37.76 permutations/s]
Permutation test:  87%|████████▋ | 8742/10000 [01:40<00:32, 39.21 permutations/s]
Permutation test:  87%|████████▋ | 8746/10000 [01:41<00:34, 36.49 permutations/s]
Permutation test:  88%|████████▊ | 8754/10000 [01:41<00:26, 46.64 permutations/s]
Permutation test:  88%|████████▊ | 8763/10000 [01:41<00:21, 57.91 permutations/s]
Permutation test:  88%|████████▊ | 8770/10000 [01:41<00:22, 53.60 permutations/s]
Permutation test:  88%|████████▊ | 8776/10000 [01:41<00:25, 48.81 permutations/s]
Permutation test:  88%|████████▊ | 8782/10000 [01:41<00:25, 46.99 permutations/s]
Permutation test:  88%|████████▊ | 8787/10000 [01:41<00:28, 42.36 permutations/s]
Permutation test:  88%|████████▊ | 8792/10000 [01:42<00:28, 42.56 permutations/s]
Permutation test:  88%|████████▊ | 8797/10000 [01:42<00:30, 40.10 permutations/s]
Permutation test:  88%|████████▊ | 8802/10000 [01:42<00:30, 39.46 permutations/s]
Permutation test:  88%|████████▊ | 8807/10000 [01:42<00:30, 39.72 permutations/s]
Permutation test:  88%|████████▊ | 8812/10000 [01:42<00:30, 39.51 permutations/s]
Permutation test:  88%|████████▊ | 8816/10000 [01:42<00:31, 38.16 permutations/s]
Permutation test:  88%|████████▊ | 8820/10000 [01:42<00:31, 37.12 permutations/s]
Permutation test:  88%|████████▊ | 8824/10000 [01:42<00:31, 37.19 permutations/s]
Permutation test:  88%|████████▊ | 8829/10000 [01:43<00:32, 36.55 permutations/s]
Permutation test:  88%|████████▊ | 8833/10000 [01:43<00:31, 36.68 permutations/s]
Permutation test:  88%|████████▊ | 8837/10000 [01:43<00:32, 36.29 permutations/s]
Permutation test:  88%|████████▊ | 8841/10000 [01:43<00:31, 36.65 permutations/s]
Permutation test:  88%|████████▊ | 8846/10000 [01:43<00:31, 36.30 permutations/s]
Permutation test:  89%|████████▊ | 8851/10000 [01:43<00:32, 35.45 permutations/s]
Permutation test:  89%|████████▊ | 8856/10000 [01:43<00:30, 37.57 permutations/s]
Permutation test:  89%|████████▊ | 8860/10000 [01:43<00:31, 36.69 permutations/s]
Permutation test:  89%|████████▊ | 8865/10000 [01:43<00:29, 38.98 permutations/s]
Permutation test:  89%|████████▊ | 8869/10000 [01:44<00:30, 36.50 permutations/s]
Permutation test:  89%|████████▊ | 8873/10000 [01:44<00:30, 36.63 permutations/s]
Permutation test:  89%|████████▉ | 8878/10000 [01:44<00:30, 37.04 permutations/s]
Permutation test:  89%|████████▉ | 8882/10000 [01:44<00:29, 37.44 permutations/s]
Permutation test:  89%|████████▉ | 8886/10000 [01:44<00:29, 37.71 permutations/s]
Permutation test:  89%|████████▉ | 8891/10000 [01:44<00:29, 37.57 permutations/s]
Permutation test:  89%|████████▉ | 8895/10000 [01:44<00:29, 38.02 permutations/s]
Permutation test:  89%|████████▉ | 8900/10000 [01:44<00:28, 37.99 permutations/s]
Permutation test:  89%|████████▉ | 8904/10000 [01:45<00:28, 38.04 permutations/s]
Permutation test:  89%|████████▉ | 8909/10000 [01:45<00:26, 41.05 permutations/s]
Permutation test:  89%|████████▉ | 8914/10000 [01:45<00:26, 40.39 permutations/s]
Permutation test:  89%|████████▉ | 8919/10000 [01:45<00:29, 36.89 permutations/s]
Permutation test:  89%|████████▉ | 8923/10000 [01:45<00:30, 35.89 permutations/s]
Permutation test:  89%|████████▉ | 8928/10000 [01:45<00:28, 37.23 permutations/s]
Permutation test:  89%|████████▉ | 8932/10000 [01:45<00:28, 37.51 permutations/s]
Permutation test:  89%|████████▉ | 8936/10000 [01:45<00:29, 35.92 permutations/s]
Permutation test:  89%|████████▉ | 8940/10000 [01:46<00:29, 35.49 permutations/s]
Permutation test:  89%|████████▉ | 8944/10000 [01:46<00:29, 36.34 permutations/s]
Permutation test:  89%|████████▉ | 8949/10000 [01:46<00:29, 36.02 permutations/s]
Permutation test:  90%|████████▉ | 8954/10000 [01:46<00:27, 37.76 permutations/s]
Permutation test:  90%|████████▉ | 8958/10000 [01:46<00:27, 37.56 permutations/s]
Permutation test:  90%|████████▉ | 8962/10000 [01:46<00:29, 35.53 permutations/s]
Permutation test:  90%|████████▉ | 8966/10000 [01:46<00:29, 35.39 permutations/s]
Permutation test:  90%|████████▉ | 8970/10000 [01:46<00:29, 35.01 permutations/s]
Permutation test:  90%|████████▉ | 8974/10000 [01:46<00:29, 34.51 permutations/s]
Permutation test:  90%|████████▉ | 8978/10000 [01:47<00:29, 35.20 permutations/s]
Permutation test:  90%|████████▉ | 8985/10000 [01:47<00:24, 41.42 permutations/s]
Permutation test:  90%|████████▉ | 8992/10000 [01:47<00:22, 45.59 permutations/s]
Permutation test:  90%|████████▉ | 8999/10000 [01:47<00:19, 50.91 permutations/s]
Permutation test:  90%|█████████ | 9006/10000 [01:47<00:18, 54.99 permutations/s]
Permutation test:  90%|█████████ | 9012/10000 [01:47<00:17, 55.29 permutations/s]
Permutation test:  90%|█████████ | 9019/10000 [01:47<00:17, 57.38 permutations/s]
Permutation test:  90%|█████████ | 9025/10000 [01:47<00:17, 54.35 permutations/s]
Permutation test:  90%|█████████ | 9031/10000 [01:47<00:17, 53.96 permutations/s]
Permutation test:  90%|█████████ | 9041/10000 [01:48<00:14, 66.36 permutations/s]
Permutation test:  90%|█████████ | 9050/10000 [01:48<00:13, 72.86 permutations/s]
Permutation test:  91%|█████████ | 9058/10000 [01:48<00:15, 62.46 permutations/s]
Permutation test:  91%|█████████ | 9065/10000 [01:48<00:17, 52.63 permutations/s]
Permutation test:  91%|█████████ | 9074/10000 [01:48<00:15, 60.52 permutations/s]
Permutation test:  91%|█████████ | 9085/10000 [01:48<00:12, 72.56 permutations/s]
Permutation test:  91%|█████████ | 9093/10000 [01:48<00:12, 70.29 permutations/s]
Permutation test:  91%|█████████ | 9101/10000 [01:49<00:14, 63.03 permutations/s]
Permutation test:  91%|█████████ | 9108/10000 [01:49<00:13, 63.81 permutations/s]
Permutation test:  91%|█████████ | 9115/10000 [01:49<00:13, 63.27 permutations/s]
Permutation test:  91%|█████████▏| 9125/10000 [01:49<00:12, 70.98 permutations/s]
Permutation test:  91%|█████████▏| 9133/10000 [01:49<00:12, 68.88 permutations/s]
Permutation test:  91%|█████████▏| 9141/10000 [01:49<00:14, 59.95 permutations/s]
Permutation test:  91%|█████████▏| 9148/10000 [01:49<00:14, 60.59 permutations/s]
Permutation test:  92%|█████████▏| 9155/10000 [01:49<00:16, 50.80 permutations/s]
Permutation test:  92%|█████████▏| 9161/10000 [01:50<00:17, 48.53 permutations/s]
Permutation test:  92%|█████████▏| 9167/10000 [01:50<00:16, 50.98 permutations/s]
Permutation test:  92%|█████████▏| 9173/10000 [01:50<00:16, 50.86 permutations/s]
Permutation test:  92%|█████████▏| 9180/10000 [01:50<00:15, 53.44 permutations/s]
Permutation test:  92%|█████████▏| 9188/10000 [01:50<00:14, 57.97 permutations/s]
Permutation test:  92%|█████████▏| 9195/10000 [01:50<00:14, 57.49 permutations/s]
Permutation test:  92%|█████████▏| 9203/10000 [01:50<00:13, 59.74 permutations/s]
Permutation test:  92%|█████████▏| 9213/10000 [01:50<00:11, 68.59 permutations/s]
Permutation test:  92%|█████████▏| 9220/10000 [01:51<00:11, 68.72 permutations/s]
Permutation test:  92%|█████████▏| 9228/10000 [01:51<00:11, 69.75 permutations/s]
Permutation test:  92%|█████████▏| 9237/10000 [01:51<00:10, 75.29 permutations/s]
Permutation test:  92%|█████████▏| 9245/10000 [01:51<00:10, 71.48 permutations/s]
Permutation test:  93%|█████████▎| 9253/10000 [01:51<00:10, 69.71 permutations/s]
Permutation test:  93%|█████████▎| 9261/10000 [01:51<00:11, 65.40 permutations/s]
Permutation test:  93%|█████████▎| 9268/10000 [01:51<00:13, 53.29 permutations/s]
Permutation test:  93%|█████████▎| 9275/10000 [01:51<00:13, 55.08 permutations/s]
Permutation test:  93%|█████████▎| 9281/10000 [01:52<00:14, 48.00 permutations/s]
Permutation test:  93%|█████████▎| 9291/10000 [01:52<00:12, 55.07 permutations/s]
Permutation test:  93%|█████████▎| 9299/10000 [01:52<00:12, 55.85 permutations/s]
Permutation test:  93%|█████████▎| 9305/10000 [01:52<00:12, 54.05 permutations/s]
Permutation test:  93%|█████████▎| 9311/10000 [01:52<00:12, 54.91 permutations/s]
Permutation test:  93%|█████████▎| 9317/10000 [01:52<00:12, 53.69 permutations/s]
Permutation test:  93%|█████████▎| 9324/10000 [01:52<00:11, 56.96 permutations/s]
Permutation test:  93%|█████████▎| 9330/10000 [01:52<00:12, 52.43 permutations/s]
Permutation test:  93%|█████████▎| 9340/10000 [01:53<00:10, 64.10 permutations/s]
Permutation test:  93%|█████████▎| 9348/10000 [01:53<00:09, 65.89 permutations/s]
Permutation test:  94%|█████████▎| 9355/10000 [01:53<00:11, 55.70 permutations/s]
Permutation test:  94%|█████████▎| 9361/10000 [01:53<00:13, 47.78 permutations/s]
Permutation test:  94%|█████████▎| 9367/10000 [01:53<00:14, 44.16 permutations/s]
Permutation test:  94%|█████████▎| 9372/10000 [01:53<00:15, 39.55 permutations/s]
Permutation test:  94%|█████████▍| 9377/10000 [01:54<00:15, 39.74 permutations/s]
Permutation test:  94%|█████████▍| 9382/10000 [01:54<00:16, 37.94 permutations/s]
Permutation test:  94%|█████████▍| 9386/10000 [01:54<00:16, 37.07 permutations/s]
Permutation test:  94%|█████████▍| 9390/10000 [01:54<00:16, 37.40 permutations/s]
Permutation test:  94%|█████████▍| 9394/10000 [01:54<00:16, 37.70 permutations/s]
Permutation test:  94%|█████████▍| 9398/10000 [01:54<00:16, 36.78 permutations/s]
Permutation test:  94%|█████████▍| 9402/10000 [01:54<00:16, 36.07 permutations/s]
Permutation test:  94%|█████████▍| 9406/10000 [01:54<00:16, 36.05 permutations/s]
Permutation test:  94%|█████████▍| 9410/10000 [01:54<00:15, 37.08 permutations/s]
Permutation test:  94%|█████████▍| 9414/10000 [01:55<00:15, 36.64 permutations/s]
Permutation test:  94%|█████████▍| 9418/10000 [01:55<00:15, 36.72 permutations/s]
Permutation test:  94%|█████████▍| 9423/10000 [01:55<00:14, 39.57 permutations/s]
Permutation test:  94%|█████████▍| 9429/10000 [01:55<00:13, 42.19 permutations/s]
Permutation test:  94%|█████████▍| 9438/10000 [01:55<00:11, 50.21 permutations/s]
Permutation test:  94%|█████████▍| 9445/10000 [01:55<00:10, 50.92 permutations/s]
Permutation test:  95%|█████████▍| 9451/10000 [01:55<00:11, 48.30 permutations/s]
Permutation test:  95%|█████████▍| 9459/10000 [01:55<00:10, 51.10 permutations/s]
Permutation test:  95%|█████████▍| 9466/10000 [01:56<00:10, 51.71 permutations/s]
Permutation test:  95%|█████████▍| 9472/10000 [01:56<00:10, 52.78 permutations/s]
Permutation test:  95%|█████████▍| 9478/10000 [01:56<00:09, 52.71 permutations/s]
Permutation test:  95%|█████████▍| 9486/10000 [01:56<00:08, 59.34 permutations/s]
Permutation test:  95%|█████████▍| 9494/10000 [01:56<00:07, 64.26 permutations/s]
Permutation test:  95%|█████████▌| 9501/10000 [01:56<00:09, 54.01 permutations/s]
Permutation test:  95%|█████████▌| 9507/10000 [01:56<00:09, 53.99 permutations/s]
Permutation test:  95%|█████████▌| 9516/10000 [01:56<00:07, 62.60 permutations/s]
Permutation test:  95%|█████████▌| 9525/10000 [01:57<00:07, 66.05 permutations/s]
Permutation test:  95%|█████████▌| 9534/10000 [01:57<00:06, 71.91 permutations/s]
Permutation test:  95%|█████████▌| 9542/10000 [01:57<00:06, 69.17 permutations/s]
Permutation test:  96%|█████████▌| 9553/10000 [01:57<00:05, 77.85 permutations/s]
Permutation test:  96%|█████████▌| 9561/10000 [01:57<00:05, 77.55 permutations/s]
Permutation test:  96%|█████████▌| 9569/10000 [01:57<00:06, 71.70 permutations/s]
Permutation test:  96%|█████████▌| 9590/10000 [01:57<00:03, 107.34 permutations/s]
Permutation test:  96%|█████████▌| 9602/10000 [01:57<00:04, 82.15 permutations/s]
Permutation test:  96%|█████████▌| 9612/10000 [01:58<00:04, 85.06 permutations/s]
Permutation test:  96%|█████████▋| 9627/10000 [01:58<00:04, 91.38 permutations/s]
Permutation test:  96%|█████████▋| 9637/10000 [01:58<00:03, 91.80 permutations/s]
Permutation test:  96%|█████████▋| 9647/10000 [01:58<00:03, 90.63 permutations/s]
Permutation test:  97%|█████████▋| 9659/10000 [01:58<00:03, 98.16 permutations/s]
Permutation test:  97%|█████████▋| 9671/10000 [01:58<00:03, 103.28 permutations/s]
Permutation test:  97%|█████████▋| 9682/10000 [01:58<00:03, 103.39 permutations/s]
Permutation test:  97%|█████████▋| 9694/10000 [01:58<00:02, 107.55 permutations/s]
Permutation test:  97%|█████████▋| 9706/10000 [01:58<00:02, 111.04 permutations/s]
Permutation test:  97%|█████████▋| 9722/10000 [01:59<00:02, 118.41 permutations/s]
Permutation test:  97%|█████████▋| 9734/10000 [01:59<00:02, 112.69 permutations/s]
Permutation test:  97%|█████████▋| 9746/10000 [01:59<00:02, 113.16 permutations/s]
Permutation test:  98%|█████████▊| 9758/10000 [01:59<00:02, 113.84 permutations/s]
Permutation test:  98%|█████████▊| 9770/10000 [01:59<00:02, 104.61 permutations/s]
Permutation test:  98%|█████████▊| 9784/10000 [01:59<00:01, 109.73 permutations/s]
Permutation test:  98%|█████████▊| 9796/10000 [01:59<00:02, 101.59 permutations/s]
Permutation test:  98%|█████████▊| 9808/10000 [01:59<00:01, 105.25 permutations/s]
Permutation test:  98%|█████████▊| 9821/10000 [01:59<00:01, 110.69 permutations/s]
Permutation test:  98%|█████████▊| 9834/10000 [02:00<00:01, 106.86 permutations/s]
Permutation test:  98%|█████████▊| 9846/10000 [02:00<00:01, 101.64 permutations/s]
Permutation test:  99%|█████████▊| 9858/10000 [02:00<00:01, 96.34 permutations/s]
Permutation test:  99%|█████████▊| 9868/10000 [02:00<00:01, 92.43 permutations/s]
Permutation test:  99%|█████████▉| 9878/10000 [02:00<00:01, 87.28 permutations/s]
Permutation test:  99%|█████████▉| 9890/10000 [02:00<00:01, 95.26 permutations/s]
Permutation test:  99%|█████████▉| 9901/10000 [02:00<00:01, 98.41 permutations/s]
Permutation test:  99%|█████████▉| 9914/10000 [02:00<00:00, 106.53 permutations/s]
Permutation test:  99%|█████████▉| 9926/10000 [02:01<00:00, 104.73 permutations/s]
Permutation test:  99%|█████████▉| 9937/10000 [02:01<00:00, 104.63 permutations/s]
Permutation test:  99%|█████████▉| 9949/10000 [02:01<00:00, 108.42 permutations/s]
Permutation test: 100%|█████████▉| 9960/10000 [02:01<00:00, 99.06 permutations/s]
Permutation test: 100%|█████████▉| 9972/10000 [02:01<00:00, 103.29 permutations/s]
Permutation test: 100%|█████████▉| 9983/10000 [02:01<00:00, 105.08 permutations/s]
Permutation test: 100%|█████████▉| 9996/10000 [02:01<00:00, 98.78 permutations/s]
Permutation test: 100%|██████████| 10000/10000 [02:01<00:00, 82.14 permutations/s]

A quick plot suggests an early effect related to n_chars around 130 ms, and a later effect of cloze around 400 ms:

p = plot.TopoButterfly(lm, t=0.130, axh=2, w=6)
sensor lm

Detailed plots of the two effects show that the cluster is quite variable due to noise in the data.

p = plot.TopoArray(lm.masked_parameter_map('n_chars'), t=[0.110, 0.130, 0.150], title='N Chars')
p = plot.TopoArray(lm.masked_parameter_map('cloze'), t=[0.380, 0.400, 0.420], title='Cloze')
  • N Chars
  • Cloze

To access some of the test results we need to know the index of different effects:

('intercept', 'n_chars', 'cloze')

Create a plot that shows the spatial cluster extent across time.

EFFECTS = [
    ('n_chars', (0.110, 0.150)),
    ('cloze', (0.380, 0.420)),
]

t_maps = []
for effect, time in EFFECTS:
    # t-maps are retrieved by effect name
    t = lm.t(effect).mean(time=time)
    # p-maps are stored in a list, so we need to know the index of te effect
    index = lm.effects.index(effect)
    # We are interested in the maximal spatial cluster extent, i.e., any sensor that is part of the cluster at any time
    p = lm.p[index].min(time=time)
    # Create a masked average t map
    t_av = t.mask(p > 0.05)
    t_maps.append(t_av)

p = plot.Topomap(t_maps, columns=2)
n_chars, cloze

Total running time of the script: (2 minutes 6.346 seconds)

Gallery generated by Sphinx-Gallery