Multiple regression

Multiple regression designs apply to at least two scenarios.

  • Analyzing a single subject’s data when trials are associated with one or multiple continuous variables.

  • Analyzing group data when subjects are associated with one or multiple individual difference variables.

Here the analysis is illustrated for a simulated dataset from a single subject. Group analysis works analogously, except that each case in the datatset would represent a different subject rather than a different trial.

For such group analysis, it is necessary to reduce each subject’s data to a single case first because multiple regression assumes a fixed effects model. Such designs are described under Two-stage test.

Simulated data

# sphinx_gallery_thumbnail_number = 2
from eelbrain import *


data = datasets.simulate_erp(snr=0.5)
data.head()
# cloze predictability n_chars
0 0.026139 low 4
1 0.99529 high 5
2 0.93062 high 3
3 0.82404 high 7
4 0.17041 low 4
5 0.18508 low 4
6 0.23345 low 4
7 0.80784 high 3
8 0.24979 low 7
9 0.26753 low 4
NDVars: eeg


The data represents 80 trials from a simulated word reading paradigm, where each word is associated with a word length (n_chars) and predictability (cloze).

p = plot.Scatter('cloze', 'n_chars', data=data, h=3)
sensor lm

Plot the average of each level on n_chars to illustrate the linear increase of the response around 130 ms with n_char.

p = plot.TopoButterfly('eeg', 'n_chars', data=data, t=.130, axh=2, w=6)
sensor lm

Multiple regression

Fit a multiple regression model. Estimate $p$-values using a cluster-based permuatation test, using a cluster-forming threshold of uncorrected $p$=.05 and 10,000 permutations (the default).

lm = testnd.LM('eeg', 'n_chars + cloze', data=data, tstart=0.050, tstop=0.500, pmin=0.05)
Permutation test:   0%|          | 0/10000 [00:00<?, ? permutations/s]
Permutation test:   0%|          | 8/10000 [00:00<02:07, 78.15 permutations/s]
Permutation test:   0%|          | 20/10000 [00:00<01:42, 97.72 permutations/s]
Permutation test:   0%|          | 35/10000 [00:00<01:26, 115.24 permutations/s]
Permutation test:   0%|          | 47/10000 [00:00<02:03, 80.54 permutations/s]
Permutation test:   1%|          | 57/10000 [00:00<02:13, 74.48 permutations/s]
Permutation test:   1%|          | 66/10000 [00:00<02:17, 72.49 permutations/s]
Permutation test:   1%|          | 79/10000 [00:00<01:57, 84.29 permutations/s]
Permutation test:   1%|          | 93/10000 [00:01<01:43, 95.57 permutations/s]
Permutation test:   1%|          | 104/10000 [00:01<01:54, 86.79 permutations/s]
Permutation test:   1%|          | 114/10000 [00:01<01:49, 90.02 permutations/s]
Permutation test:   1%|          | 124/10000 [00:01<01:57, 83.79 permutations/s]
Permutation test:   1%|▏         | 133/10000 [00:01<01:58, 83.39 permutations/s]
Permutation test:   1%|▏         | 142/10000 [00:01<02:09, 75.99 permutations/s]
Permutation test:   2%|▏         | 155/10000 [00:01<01:59, 82.08 permutations/s]
Permutation test:   2%|▏         | 167/10000 [00:01<01:55, 84.84 permutations/s]
Permutation test:   2%|▏         | 177/10000 [00:02<01:50, 88.50 permutations/s]
Permutation test:   2%|▏         | 187/10000 [00:02<01:51, 87.79 permutations/s]
Permutation test:   2%|▏         | 201/10000 [00:02<01:37, 100.45 permutations/s]
Permutation test:   2%|▏         | 212/10000 [00:02<01:46, 92.17 permutations/s]
Permutation test:   2%|▏         | 222/10000 [00:02<01:56, 83.89 permutations/s]
Permutation test:   2%|▏         | 231/10000 [00:02<02:01, 80.69 permutations/s]
Permutation test:   2%|▏         | 244/10000 [00:02<01:46, 91.35 permutations/s]
Permutation test:   3%|▎         | 254/10000 [00:02<01:46, 91.36 permutations/s]
Permutation test:   3%|▎         | 265/10000 [00:03<01:41, 96.02 permutations/s]
Permutation test:   3%|▎         | 275/10000 [00:03<01:55, 84.28 permutations/s]
Permutation test:   3%|▎         | 287/10000 [00:03<01:44, 93.32 permutations/s]
Permutation test:   3%|▎         | 297/10000 [00:03<01:42, 95.05 permutations/s]
Permutation test:   3%|▎         | 307/10000 [00:03<01:45, 91.71 permutations/s]
Permutation test:   3%|▎         | 317/10000 [00:03<01:48, 89.12 permutations/s]
Permutation test:   3%|▎         | 327/10000 [00:03<01:47, 89.86 permutations/s]
Permutation test:   3%|▎         | 337/10000 [00:03<01:53, 85.39 permutations/s]
Permutation test:   4%|▎         | 350/10000 [00:03<01:45, 91.29 permutations/s]
Permutation test:   4%|▎         | 360/10000 [00:04<01:52, 85.44 permutations/s]
Permutation test:   4%|▎         | 371/10000 [00:04<01:46, 90.77 permutations/s]
Permutation test:   4%|▍         | 381/10000 [00:04<01:47, 89.55 permutations/s]
Permutation test:   4%|▍         | 391/10000 [00:04<01:52, 85.72 permutations/s]
Permutation test:   4%|▍         | 403/10000 [00:04<01:49, 87.50 permutations/s]
Permutation test:   4%|▍         | 412/10000 [00:04<01:48, 88.09 permutations/s]
Permutation test:   4%|▍         | 423/10000 [00:04<01:42, 93.82 permutations/s]
Permutation test:   4%|▍         | 438/10000 [00:04<01:31, 104.88 permutations/s]
Permutation test:   4%|▍         | 450/10000 [00:05<01:31, 104.54 permutations/s]
Permutation test:   5%|▍         | 461/10000 [00:05<01:40, 94.57 permutations/s]
Permutation test:   5%|▍         | 473/10000 [00:05<01:35, 100.11 permutations/s]
Permutation test:   5%|▍         | 484/10000 [00:05<01:44, 91.42 permutations/s]
Permutation test:   5%|▍         | 494/10000 [00:05<01:52, 84.50 permutations/s]
Permutation test:   5%|▌         | 504/10000 [00:05<01:49, 86.77 permutations/s]
Permutation test:   5%|▌         | 513/10000 [00:05<01:56, 81.71 permutations/s]
Permutation test:   5%|▌         | 522/10000 [00:05<02:03, 76.98 permutations/s]
Permutation test:   5%|▌         | 539/10000 [00:06<01:35, 99.03 permutations/s]
Permutation test:   6%|▌         | 550/10000 [00:06<01:40, 93.97 permutations/s]
Permutation test:   6%|▌         | 563/10000 [00:06<01:34, 100.20 permutations/s]
Permutation test:   6%|▌         | 577/10000 [00:06<01:27, 107.09 permutations/s]
Permutation test:   6%|▌         | 589/10000 [00:06<01:33, 100.93 permutations/s]
Permutation test:   6%|▌         | 600/10000 [00:06<01:41, 92.77 permutations/s]
Permutation test:   6%|▌         | 610/10000 [00:06<01:54, 82.31 permutations/s]
Permutation test:   6%|▌         | 619/10000 [00:06<01:59, 78.25 permutations/s]
Permutation test:   6%|▋         | 628/10000 [00:07<02:22, 65.90 permutations/s]
Permutation test:   6%|▋         | 635/10000 [00:07<02:22, 65.52 permutations/s]
Permutation test:   6%|▋         | 643/10000 [00:07<02:16, 68.41 permutations/s]
Permutation test:   7%|▋         | 651/10000 [00:07<02:11, 70.96 permutations/s]
Permutation test:   7%|▋         | 660/10000 [00:07<02:06, 73.99 permutations/s]
Permutation test:   7%|▋         | 668/10000 [00:07<02:10, 71.74 permutations/s]
Permutation test:   7%|▋         | 676/10000 [00:07<02:21, 66.05 permutations/s]
Permutation test:   7%|▋         | 690/10000 [00:07<01:53, 81.71 permutations/s]
Permutation test:   7%|▋         | 699/10000 [00:08<02:06, 73.33 permutations/s]
Permutation test:   7%|▋         | 709/10000 [00:08<01:57, 79.40 permutations/s]
Permutation test:   7%|▋         | 718/10000 [00:08<01:53, 81.78 permutations/s]
Permutation test:   7%|▋         | 727/10000 [00:08<01:52, 82.20 permutations/s]
Permutation test:   7%|▋         | 736/10000 [00:08<01:52, 82.50 permutations/s]
Permutation test:   7%|▋         | 749/10000 [00:08<01:38, 93.57 permutations/s]
Permutation test:   8%|▊         | 760/10000 [00:08<01:42, 90.41 permutations/s]
Permutation test:   8%|▊         | 770/10000 [00:08<01:39, 92.71 permutations/s]
Permutation test:   8%|▊         | 780/10000 [00:09<01:40, 91.47 permutations/s]
Permutation test:   8%|▊         | 794/10000 [00:09<01:29, 102.67 permutations/s]
Permutation test:   8%|▊         | 805/10000 [00:09<01:28, 103.43 permutations/s]
Permutation test:   8%|▊         | 816/10000 [00:09<01:30, 102.02 permutations/s]
Permutation test:   8%|▊         | 827/10000 [00:09<01:30, 101.38 permutations/s]
Permutation test:   8%|▊         | 838/10000 [00:09<01:28, 103.69 permutations/s]
Permutation test:   9%|▊         | 852/10000 [00:09<01:21, 112.12 permutations/s]
Permutation test:   9%|▊         | 864/10000 [00:09<01:37, 93.25 permutations/s]
Permutation test:   9%|▉         | 875/10000 [00:09<01:34, 96.35 permutations/s]
Permutation test:   9%|▉         | 887/10000 [00:10<01:29, 101.51 permutations/s]
Permutation test:   9%|▉         | 899/10000 [00:10<01:27, 104.26 permutations/s]
Permutation test:   9%|▉         | 910/10000 [00:10<01:33, 97.12 permutations/s]
Permutation test:   9%|▉         | 924/10000 [00:10<01:28, 102.15 permutations/s]
Permutation test:   9%|▉         | 935/10000 [00:10<01:31, 98.97 permutations/s]
Permutation test:   9%|▉         | 948/10000 [00:10<01:27, 103.94 permutations/s]
Permutation test:  10%|▉         | 959/10000 [00:10<01:32, 98.17 permutations/s]
Permutation test:  10%|▉         | 969/10000 [00:10<01:38, 91.88 permutations/s]
Permutation test:  10%|▉         | 982/10000 [00:10<01:32, 97.73 permutations/s]
Permutation test:  10%|▉         | 992/10000 [00:11<01:35, 94.51 permutations/s]
Permutation test:  10%|█         | 1004/10000 [00:11<01:34, 95.15 permutations/s]
Permutation test:  10%|█         | 1016/10000 [00:11<01:30, 99.52 permutations/s]
Permutation test:  10%|█         | 1027/10000 [00:11<01:32, 97.32 permutations/s]
Permutation test:  10%|█         | 1037/10000 [00:11<01:34, 94.76 permutations/s]
Permutation test:  10%|█         | 1047/10000 [00:11<01:39, 90.34 permutations/s]
Permutation test:  11%|█         | 1057/10000 [00:11<01:52, 79.66 permutations/s]
Permutation test:  11%|█         | 1066/10000 [00:11<01:49, 81.25 permutations/s]
Permutation test:  11%|█         | 1075/10000 [00:12<01:48, 82.25 permutations/s]
Permutation test:  11%|█         | 1084/10000 [00:12<01:49, 81.29 permutations/s]
Permutation test:  11%|█         | 1093/10000 [00:12<01:49, 81.15 permutations/s]
Permutation test:  11%|█         | 1102/10000 [00:12<01:48, 82.27 permutations/s]
Permutation test:  11%|█         | 1112/10000 [00:12<01:44, 85.38 permutations/s]
Permutation test:  11%|█         | 1122/10000 [00:12<01:44, 84.64 permutations/s]
Permutation test:  11%|█▏        | 1133/10000 [00:12<01:36, 91.57 permutations/s]
Permutation test:  11%|█▏        | 1148/10000 [00:12<01:23, 105.72 permutations/s]
Permutation test:  12%|█▏        | 1159/10000 [00:12<01:29, 98.95 permutations/s]
Permutation test:  12%|█▏        | 1170/10000 [00:13<01:36, 91.19 permutations/s]
Permutation test:  12%|█▏        | 1180/10000 [00:13<01:38, 89.62 permutations/s]
Permutation test:  12%|█▏        | 1190/10000 [00:13<01:45, 83.73 permutations/s]
Permutation test:  12%|█▏        | 1202/10000 [00:13<01:35, 92.58 permutations/s]
Permutation test:  12%|█▏        | 1216/10000 [00:13<01:24, 104.23 permutations/s]
Permutation test:  12%|█▏        | 1227/10000 [00:13<01:24, 103.58 permutations/s]
Permutation test:  12%|█▏        | 1239/10000 [00:13<01:27, 100.38 permutations/s]
Permutation test:  13%|█▎        | 1251/10000 [00:13<01:24, 103.23 permutations/s]
Permutation test:  13%|█▎        | 1262/10000 [00:14<01:26, 100.60 permutations/s]
Permutation test:  13%|█▎        | 1273/10000 [00:14<01:29, 97.85 permutations/s]
Permutation test:  13%|█▎        | 1286/10000 [00:14<01:22, 105.81 permutations/s]
Permutation test:  13%|█▎        | 1297/10000 [00:14<01:32, 93.63 permutations/s]
Permutation test:  13%|█▎        | 1309/10000 [00:14<01:26, 100.07 permutations/s]
Permutation test:  13%|█▎        | 1322/10000 [00:14<01:22, 105.00 permutations/s]
Permutation test:  13%|█▎        | 1333/10000 [00:14<01:24, 102.73 permutations/s]
Permutation test:  13%|█▎        | 1344/10000 [00:14<01:27, 98.88 permutations/s]
Permutation test:  14%|█▎        | 1358/10000 [00:14<01:19, 109.37 permutations/s]
Permutation test:  14%|█▎        | 1370/10000 [00:15<01:29, 96.37 permutations/s]
Permutation test:  14%|█▍        | 1381/10000 [00:15<01:33, 92.35 permutations/s]
Permutation test:  14%|█▍        | 1391/10000 [00:15<01:34, 91.21 permutations/s]
Permutation test:  14%|█▍        | 1401/10000 [00:15<01:35, 90.26 permutations/s]
Permutation test:  14%|█▍        | 1413/10000 [00:15<01:29, 95.84 permutations/s]
Permutation test:  14%|█▍        | 1423/10000 [00:15<01:34, 91.11 permutations/s]
Permutation test:  14%|█▍        | 1434/10000 [00:15<01:30, 95.01 permutations/s]
Permutation test:  14%|█▍        | 1444/10000 [00:15<01:32, 92.30 permutations/s]
Permutation test:  15%|█▍        | 1456/10000 [00:16<01:33, 91.09 permutations/s]
Permutation test:  15%|█▍        | 1466/10000 [00:16<01:33, 91.56 permutations/s]
Permutation test:  15%|█▍        | 1476/10000 [00:16<01:35, 89.38 permutations/s]
Permutation test:  15%|█▍        | 1487/10000 [00:16<01:32, 91.61 permutations/s]
Permutation test:  15%|█▍        | 1497/10000 [00:16<01:30, 93.82 permutations/s]
Permutation test:  15%|█▌        | 1507/10000 [00:16<01:30, 93.40 permutations/s]
Permutation test:  15%|█▌        | 1519/10000 [00:16<01:29, 94.53 permutations/s]
Permutation test:  15%|█▌        | 1529/10000 [00:16<01:37, 86.70 permutations/s]
Permutation test:  15%|█▌        | 1542/10000 [00:16<01:30, 93.88 permutations/s]
Permutation test:  16%|█▌        | 1552/10000 [00:17<01:42, 82.49 permutations/s]
Permutation test:  16%|█▌        | 1561/10000 [00:17<01:44, 80.48 permutations/s]
Permutation test:  16%|█▌        | 1570/10000 [00:17<01:50, 76.63 permutations/s]
Permutation test:  16%|█▌        | 1582/10000 [00:17<01:37, 86.52 permutations/s]
Permutation test:  16%|█▌        | 1591/10000 [00:17<01:44, 80.70 permutations/s]
Permutation test:  16%|█▌        | 1602/10000 [00:17<01:36, 87.37 permutations/s]
Permutation test:  16%|█▌        | 1611/10000 [00:17<01:41, 82.31 permutations/s]
Permutation test:  16%|█▌        | 1622/10000 [00:17<01:34, 89.10 permutations/s]
Permutation test:  16%|█▋        | 1632/10000 [00:18<01:31, 91.90 permutations/s]
Permutation test:  16%|█▋        | 1642/10000 [00:18<01:32, 90.09 permutations/s]
Permutation test:  17%|█▋        | 1657/10000 [00:18<01:21, 102.92 permutations/s]
Permutation test:  17%|█▋        | 1668/10000 [00:18<01:21, 101.98 permutations/s]
Permutation test:  17%|█▋        | 1681/10000 [00:18<01:18, 106.36 permutations/s]
Permutation test:  17%|█▋        | 1696/10000 [00:18<01:13, 113.51 permutations/s]
Permutation test:  17%|█▋        | 1708/10000 [00:18<01:20, 102.61 permutations/s]
Permutation test:  17%|█▋        | 1719/10000 [00:18<01:21, 101.93 permutations/s]
Permutation test:  17%|█▋        | 1730/10000 [00:19<01:44, 79.31 permutations/s]
Permutation test:  17%|█▋        | 1739/10000 [00:19<01:56, 70.89 permutations/s]
Permutation test:  17%|█▋        | 1747/10000 [00:19<01:54, 71.78 permutations/s]
Permutation test:  18%|█▊        | 1755/10000 [00:19<01:54, 71.97 permutations/s]
Permutation test:  18%|█▊        | 1765/10000 [00:19<01:46, 77.60 permutations/s]
Permutation test:  18%|█▊        | 1774/10000 [00:19<01:54, 71.86 permutations/s]
Permutation test:  18%|█▊        | 1782/10000 [00:19<01:54, 71.81 permutations/s]
Permutation test:  18%|█▊        | 1790/10000 [00:19<02:00, 68.29 permutations/s]
Permutation test:  18%|█▊        | 1797/10000 [00:20<02:04, 65.74 permutations/s]
Permutation test:  18%|█▊        | 1805/10000 [00:20<02:07, 64.46 permutations/s]
Permutation test:  18%|█▊        | 1814/10000 [00:20<01:58, 69.22 permutations/s]
Permutation test:  18%|█▊        | 1822/10000 [00:20<02:00, 68.08 permutations/s]
Permutation test:  18%|█▊        | 1829/10000 [00:20<02:07, 64.06 permutations/s]
Permutation test:  18%|█▊        | 1836/10000 [00:20<02:07, 63.85 permutations/s]
Permutation test:  18%|█▊        | 1843/10000 [00:20<02:09, 63.10 permutations/s]
Permutation test:  19%|█▊        | 1853/10000 [00:20<01:56, 69.95 permutations/s]
Permutation test:  19%|█▊        | 1861/10000 [00:21<02:00, 67.57 permutations/s]
Permutation test:  19%|█▊        | 1868/10000 [00:21<01:59, 68.18 permutations/s]
Permutation test:  19%|█▉        | 1875/10000 [00:21<02:07, 63.81 permutations/s]
Permutation test:  19%|█▉        | 1886/10000 [00:21<01:47, 75.35 permutations/s]
Permutation test:  19%|█▉        | 1894/10000 [00:21<01:50, 73.38 permutations/s]
Permutation test:  19%|█▉        | 1903/10000 [00:21<01:45, 77.07 permutations/s]
Permutation test:  19%|█▉        | 1912/10000 [00:21<01:43, 77.91 permutations/s]
Permutation test:  19%|█▉        | 1920/10000 [00:21<01:43, 77.72 permutations/s]
Permutation test:  19%|█▉        | 1928/10000 [00:21<01:49, 73.39 permutations/s]
Permutation test:  19%|█▉        | 1936/10000 [00:22<01:55, 69.91 permutations/s]
Permutation test:  19%|█▉        | 1944/10000 [00:22<01:54, 70.35 permutations/s]
Permutation test:  20%|█▉        | 1952/10000 [00:22<01:57, 68.35 permutations/s]
Permutation test:  20%|█▉        | 1959/10000 [00:22<02:00, 66.71 permutations/s]
Permutation test:  20%|█▉        | 1966/10000 [00:22<02:08, 62.39 permutations/s]
Permutation test:  20%|█▉        | 1973/10000 [00:22<02:12, 60.55 permutations/s]
Permutation test:  20%|█▉        | 1981/10000 [00:22<02:09, 61.83 permutations/s]
Permutation test:  20%|█▉        | 1994/10000 [00:22<01:42, 77.78 permutations/s]
Permutation test:  20%|██        | 2002/10000 [00:23<01:45, 75.95 permutations/s]
Permutation test:  20%|██        | 2010/10000 [00:23<01:45, 76.08 permutations/s]
Permutation test:  20%|██        | 2018/10000 [00:23<01:56, 68.77 permutations/s]
Permutation test:  20%|██        | 2026/10000 [00:23<01:54, 69.69 permutations/s]
Permutation test:  20%|██        | 2034/10000 [00:23<01:57, 68.09 permutations/s]
Permutation test:  20%|██        | 2044/10000 [00:23<01:51, 71.23 permutations/s]
Permutation test:  21%|██        | 2052/10000 [00:23<01:59, 66.43 permutations/s]
Permutation test:  21%|██        | 2059/10000 [00:23<02:05, 63.04 permutations/s]
Permutation test:  21%|██        | 2066/10000 [00:24<02:06, 62.69 permutations/s]
Permutation test:  21%|██        | 2073/10000 [00:24<02:13, 59.58 permutations/s]
Permutation test:  21%|██        | 2082/10000 [00:24<02:05, 63.30 permutations/s]
Permutation test:  21%|██        | 2090/10000 [00:24<01:59, 66.07 permutations/s]
Permutation test:  21%|██        | 2099/10000 [00:24<01:52, 70.02 permutations/s]
Permutation test:  21%|██        | 2111/10000 [00:24<01:38, 80.18 permutations/s]
Permutation test:  21%|██        | 2120/10000 [00:24<01:46, 73.75 permutations/s]
Permutation test:  21%|██▏       | 2128/10000 [00:24<01:49, 71.90 permutations/s]
Permutation test:  21%|██▏       | 2136/10000 [00:25<01:56, 67.65 permutations/s]
Permutation test:  21%|██▏       | 2143/10000 [00:25<02:07, 61.47 permutations/s]
Permutation test:  22%|██▏       | 2150/10000 [00:25<02:06, 62.24 permutations/s]
Permutation test:  22%|██▏       | 2158/10000 [00:25<01:58, 66.21 permutations/s]
Permutation test:  22%|██▏       | 2165/10000 [00:25<02:00, 64.90 permutations/s]
Permutation test:  22%|██▏       | 2175/10000 [00:25<01:45, 74.14 permutations/s]
Permutation test:  22%|██▏       | 2183/10000 [00:25<01:47, 72.68 permutations/s]
Permutation test:  22%|██▏       | 2191/10000 [00:25<01:57, 66.21 permutations/s]
Permutation test:  22%|██▏       | 2200/10000 [00:25<01:52, 69.47 permutations/s]
Permutation test:  22%|██▏       | 2208/10000 [00:26<01:48, 71.57 permutations/s]
Permutation test:  22%|██▏       | 2216/10000 [00:26<01:51, 69.90 permutations/s]
Permutation test:  22%|██▏       | 2224/10000 [00:26<01:47, 72.25 permutations/s]
Permutation test:  22%|██▏       | 2232/10000 [00:26<01:46, 72.92 permutations/s]
Permutation test:  22%|██▏       | 2241/10000 [00:26<01:47, 72.33 permutations/s]
Permutation test:  22%|██▏       | 2249/10000 [00:26<01:52, 69.06 permutations/s]
Permutation test:  23%|██▎       | 2259/10000 [00:26<01:46, 72.79 permutations/s]
Permutation test:  23%|██▎       | 2271/10000 [00:26<01:30, 85.02 permutations/s]
Permutation test:  23%|██▎       | 2280/10000 [00:27<01:41, 75.84 permutations/s]
Permutation test:  23%|██▎       | 2292/10000 [00:27<01:31, 84.42 permutations/s]
Permutation test:  23%|██▎       | 2306/10000 [00:27<01:18, 97.95 permutations/s]
Permutation test:  23%|██▎       | 2320/10000 [00:27<01:11, 108.05 permutations/s]
Permutation test:  23%|██▎       | 2333/10000 [00:27<01:08, 112.74 permutations/s]
Permutation test:  23%|██▎       | 2345/10000 [00:27<01:11, 107.59 permutations/s]
Permutation test:  24%|██▎       | 2357/10000 [00:27<01:09, 109.67 permutations/s]
Permutation test:  24%|██▎       | 2371/10000 [00:27<01:06, 115.50 permutations/s]
Permutation test:  24%|██▍       | 2384/10000 [00:27<01:04, 118.48 permutations/s]
Permutation test:  24%|██▍       | 2397/10000 [00:28<01:03, 120.31 permutations/s]
Permutation test:  24%|██▍       | 2410/10000 [00:28<01:02, 121.63 permutations/s]
Permutation test:  24%|██▍       | 2423/10000 [00:28<01:08, 111.22 permutations/s]
Permutation test:  24%|██▍       | 2437/10000 [00:28<01:04, 117.79 permutations/s]
Permutation test:  24%|██▍       | 2449/10000 [00:28<01:04, 117.18 permutations/s]
Permutation test:  25%|██▍       | 2461/10000 [00:28<01:06, 114.10 permutations/s]
Permutation test:  25%|██▍       | 2474/10000 [00:28<01:04, 117.20 permutations/s]
Permutation test:  25%|██▍       | 2488/10000 [00:28<01:02, 120.95 permutations/s]
Permutation test:  25%|██▌       | 2501/10000 [00:28<01:01, 121.95 permutations/s]
Permutation test:  25%|██▌       | 2514/10000 [00:29<01:07, 110.46 permutations/s]
Permutation test:  25%|██▌       | 2527/10000 [00:29<01:05, 114.49 permutations/s]
Permutation test:  25%|██▌       | 2542/10000 [00:29<01:00, 122.93 permutations/s]
Permutation test:  26%|██▌       | 2555/10000 [00:29<01:00, 123.39 permutations/s]
Permutation test:  26%|██▌       | 2570/10000 [00:29<00:59, 124.23 permutations/s]
Permutation test:  26%|██▌       | 2583/10000 [00:29<01:03, 116.37 permutations/s]
Permutation test:  26%|██▌       | 2596/10000 [00:29<01:02, 118.99 permutations/s]
Permutation test:  26%|██▌       | 2609/10000 [00:29<01:00, 121.26 permutations/s]
Permutation test:  26%|██▌       | 2622/10000 [00:29<01:01, 119.99 permutations/s]
Permutation test:  26%|██▋       | 2635/10000 [00:30<01:08, 107.82 permutations/s]
Permutation test:  26%|██▋       | 2649/10000 [00:30<01:05, 112.35 permutations/s]
Permutation test:  27%|██▋       | 2664/10000 [00:30<01:02, 117.35 permutations/s]
Permutation test:  27%|██▋       | 2677/10000 [00:30<01:01, 119.28 permutations/s]
Permutation test:  27%|██▋       | 2690/10000 [00:30<01:01, 118.95 permutations/s]
Permutation test:  27%|██▋       | 2702/10000 [00:30<01:02, 117.45 permutations/s]
Permutation test:  27%|██▋       | 2714/10000 [00:30<01:02, 116.82 permutations/s]
Permutation test:  27%|██▋       | 2728/10000 [00:30<00:59, 121.77 permutations/s]
Permutation test:  27%|██▋       | 2741/10000 [00:30<00:59, 123.02 permutations/s]
Permutation test:  28%|██▊       | 2754/10000 [00:31<01:00, 120.14 permutations/s]
Permutation test:  28%|██▊       | 2767/10000 [00:31<01:00, 119.18 permutations/s]
Permutation test:  28%|██▊       | 2779/10000 [00:31<01:01, 117.72 permutations/s]
Permutation test:  28%|██▊       | 2791/10000 [00:31<01:02, 115.15 permutations/s]
Permutation test:  28%|██▊       | 2803/10000 [00:31<01:05, 110.22 permutations/s]
Permutation test:  28%|██▊       | 2815/10000 [00:31<01:04, 111.75 permutations/s]
Permutation test:  28%|██▊       | 2829/10000 [00:31<01:02, 114.53 permutations/s]
Permutation test:  28%|██▊       | 2841/10000 [00:31<01:08, 103.94 permutations/s]
Permutation test:  29%|██▊       | 2852/10000 [00:32<01:23, 85.71 permutations/s]
Permutation test:  29%|██▊       | 2862/10000 [00:32<01:36, 73.60 permutations/s]
Permutation test:  29%|██▊       | 2870/10000 [00:32<01:36, 73.53 permutations/s]
Permutation test:  29%|██▉       | 2879/10000 [00:32<01:35, 74.84 permutations/s]
Permutation test:  29%|██▉       | 2887/10000 [00:32<01:39, 71.65 permutations/s]
Permutation test:  29%|██▉       | 2895/10000 [00:32<01:38, 72.37 permutations/s]
Permutation test:  29%|██▉       | 2907/10000 [00:32<01:30, 78.33 permutations/s]
Permutation test:  29%|██▉       | 2915/10000 [00:32<01:31, 77.65 permutations/s]
Permutation test:  29%|██▉       | 2923/10000 [00:33<01:37, 72.52 permutations/s]
Permutation test:  29%|██▉       | 2931/10000 [00:33<01:37, 72.19 permutations/s]
Permutation test:  29%|██▉       | 2939/10000 [00:33<01:46, 66.55 permutations/s]
Permutation test:  29%|██▉       | 2946/10000 [00:33<01:48, 64.77 permutations/s]
Permutation test:  30%|██▉       | 2953/10000 [00:33<01:49, 64.11 permutations/s]
Permutation test:  30%|██▉       | 2960/10000 [00:33<01:55, 61.19 permutations/s]
Permutation test:  30%|██▉       | 2968/10000 [00:33<01:54, 61.57 permutations/s]
Permutation test:  30%|██▉       | 2975/10000 [00:33<01:53, 61.85 permutations/s]
Permutation test:  30%|██▉       | 2985/10000 [00:34<01:42, 68.25 permutations/s]
Permutation test:  30%|██▉       | 2995/10000 [00:34<01:38, 71.28 permutations/s]
Permutation test:  30%|███       | 3003/10000 [00:34<01:41, 69.13 permutations/s]
Permutation test:  30%|███       | 3010/10000 [00:34<01:45, 66.07 permutations/s]
Permutation test:  30%|███       | 3017/10000 [00:34<01:51, 62.63 permutations/s]
Permutation test:  30%|███       | 3024/10000 [00:34<01:52, 61.92 permutations/s]
Permutation test:  30%|███       | 3032/10000 [00:34<01:52, 62.11 permutations/s]
Permutation test:  30%|███       | 3040/10000 [00:34<01:44, 66.58 permutations/s]
Permutation test:  30%|███       | 3047/10000 [00:34<01:43, 66.91 permutations/s]
Permutation test:  31%|███       | 3054/10000 [00:35<01:50, 62.98 permutations/s]
Permutation test:  31%|███       | 3062/10000 [00:35<01:44, 66.12 permutations/s]
Permutation test:  31%|███       | 3069/10000 [00:35<01:43, 67.17 permutations/s]
Permutation test:  31%|███       | 3079/10000 [00:35<01:32, 74.58 permutations/s]
Permutation test:  31%|███       | 3087/10000 [00:35<01:31, 75.61 permutations/s]
Permutation test:  31%|███       | 3098/10000 [00:35<01:22, 83.73 permutations/s]
Permutation test:  31%|███       | 3107/10000 [00:35<01:25, 80.43 permutations/s]
Permutation test:  31%|███       | 3116/10000 [00:35<01:29, 77.34 permutations/s]
Permutation test:  31%|███       | 3124/10000 [00:35<01:34, 73.12 permutations/s]
Permutation test:  31%|███▏      | 3132/10000 [00:36<01:34, 72.59 permutations/s]
Permutation test:  31%|███▏      | 3142/10000 [00:36<01:28, 77.49 permutations/s]
Permutation test:  32%|███▏      | 3150/10000 [00:36<01:29, 76.94 permutations/s]
Permutation test:  32%|███▏      | 3158/10000 [00:36<01:30, 75.71 permutations/s]
Permutation test:  32%|███▏      | 3169/10000 [00:36<01:20, 84.87 permutations/s]
Permutation test:  32%|███▏      | 3178/10000 [00:36<01:31, 74.62 permutations/s]
Permutation test:  32%|███▏      | 3186/10000 [00:36<01:35, 71.42 permutations/s]
Permutation test:  32%|███▏      | 3197/10000 [00:36<01:23, 81.03 permutations/s]
Permutation test:  32%|███▏      | 3206/10000 [00:37<01:37, 69.54 permutations/s]
Permutation test:  32%|███▏      | 3214/10000 [00:37<01:44, 64.75 permutations/s]
Permutation test:  32%|███▏      | 3222/10000 [00:37<01:43, 65.35 permutations/s]
Permutation test:  32%|███▏      | 3233/10000 [00:37<01:29, 75.51 permutations/s]
Permutation test:  32%|███▏      | 3242/10000 [00:37<01:26, 78.53 permutations/s]
Permutation test:  33%|███▎      | 3252/10000 [00:37<01:23, 80.42 permutations/s]
Permutation test:  33%|███▎      | 3261/10000 [00:37<01:29, 75.19 permutations/s]
Permutation test:  33%|███▎      | 3269/10000 [00:37<01:34, 71.34 permutations/s]
Permutation test:  33%|███▎      | 3277/10000 [00:38<01:35, 70.49 permutations/s]
Permutation test:  33%|███▎      | 3285/10000 [00:38<01:42, 65.65 permutations/s]
Permutation test:  33%|███▎      | 3292/10000 [00:38<01:41, 66.07 permutations/s]
Permutation test:  33%|███▎      | 3299/10000 [00:38<01:39, 67.09 permutations/s]
Permutation test:  33%|███▎      | 3307/10000 [00:38<01:35, 69.91 permutations/s]
Permutation test:  33%|███▎      | 3316/10000 [00:38<01:30, 73.72 permutations/s]
Permutation test:  33%|███▎      | 3325/10000 [00:38<01:26, 77.49 permutations/s]
Permutation test:  33%|███▎      | 3333/10000 [00:38<01:27, 76.34 permutations/s]
Permutation test:  33%|███▎      | 3344/10000 [00:38<01:19, 84.07 permutations/s]
Permutation test:  34%|███▎      | 3353/10000 [00:39<01:28, 75.39 permutations/s]
Permutation test:  34%|███▎      | 3361/10000 [00:39<01:28, 74.83 permutations/s]
Permutation test:  34%|███▎      | 3369/10000 [00:39<01:32, 71.87 permutations/s]
Permutation test:  34%|███▍      | 3377/10000 [00:39<01:38, 66.92 permutations/s]
Permutation test:  34%|███▍      | 3385/10000 [00:39<01:39, 66.78 permutations/s]
Permutation test:  34%|███▍      | 3392/10000 [00:39<01:38, 66.94 permutations/s]
Permutation test:  34%|███▍      | 3399/10000 [00:39<01:40, 65.60 permutations/s]
Permutation test:  34%|███▍      | 3406/10000 [00:39<01:43, 63.97 permutations/s]
Permutation test:  34%|███▍      | 3413/10000 [00:40<01:49, 60.43 permutations/s]
Permutation test:  34%|███▍      | 3420/10000 [00:40<01:49, 59.87 permutations/s]
Permutation test:  34%|███▍      | 3429/10000 [00:40<01:37, 67.65 permutations/s]
Permutation test:  34%|███▍      | 3439/10000 [00:40<01:32, 71.24 permutations/s]
Permutation test:  34%|███▍      | 3447/10000 [00:40<01:34, 69.05 permutations/s]
Permutation test:  35%|███▍      | 3455/10000 [00:40<01:34, 69.04 permutations/s]
Permutation test:  35%|███▍      | 3462/10000 [00:40<01:37, 67.23 permutations/s]
Permutation test:  35%|███▍      | 3469/10000 [00:40<01:44, 62.60 permutations/s]
Permutation test:  35%|███▍      | 3476/10000 [00:41<01:47, 60.62 permutations/s]
Permutation test:  35%|███▍      | 3483/10000 [00:41<01:46, 61.20 permutations/s]
Permutation test:  35%|███▍      | 3491/10000 [00:41<01:41, 64.08 permutations/s]
Permutation test:  35%|███▍      | 3499/10000 [00:41<01:36, 67.03 permutations/s]
Permutation test:  35%|███▌      | 3506/10000 [00:41<01:35, 67.83 permutations/s]
Permutation test:  35%|███▌      | 3513/10000 [00:41<01:42, 63.14 permutations/s]
Permutation test:  35%|███▌      | 3521/10000 [00:41<01:41, 63.84 permutations/s]
Permutation test:  35%|███▌      | 3528/10000 [00:41<01:50, 58.73 permutations/s]
Permutation test:  35%|███▌      | 3536/10000 [00:41<01:46, 60.93 permutations/s]
Permutation test:  35%|███▌      | 3543/10000 [00:42<01:52, 57.32 permutations/s]
Permutation test:  36%|███▌      | 3551/10000 [00:42<01:44, 61.99 permutations/s]
Permutation test:  36%|███▌      | 3558/10000 [00:42<01:42, 62.69 permutations/s]
Permutation test:  36%|███▌      | 3568/10000 [00:42<01:29, 71.74 permutations/s]
Permutation test:  36%|███▌      | 3576/10000 [00:42<01:38, 65.10 permutations/s]
Permutation test:  36%|███▌      | 3584/10000 [00:42<01:38, 65.25 permutations/s]
Permutation test:  36%|███▌      | 3591/10000 [00:42<01:39, 64.48 permutations/s]
Permutation test:  36%|███▌      | 3601/10000 [00:42<01:28, 72.21 permutations/s]
Permutation test:  36%|███▌      | 3609/10000 [00:43<01:28, 71.93 permutations/s]
Permutation test:  36%|███▌      | 3617/10000 [00:43<01:30, 70.81 permutations/s]
Permutation test:  36%|███▋      | 3626/10000 [00:43<01:30, 70.18 permutations/s]
Permutation test:  36%|███▋      | 3634/10000 [00:43<01:38, 64.71 permutations/s]
Permutation test:  36%|███▋      | 3643/10000 [00:43<01:34, 67.51 permutations/s]
Permutation test:  37%|███▋      | 3652/10000 [00:43<01:26, 73.20 permutations/s]
Permutation test:  37%|███▋      | 3660/10000 [00:43<01:27, 72.49 permutations/s]
Permutation test:  37%|███▋      | 3669/10000 [00:43<01:24, 75.06 permutations/s]
Permutation test:  37%|███▋      | 3677/10000 [00:43<01:24, 74.42 permutations/s]
Permutation test:  37%|███▋      | 3685/10000 [00:44<01:28, 71.27 permutations/s]
Permutation test:  37%|███▋      | 3693/10000 [00:44<01:39, 63.64 permutations/s]
Permutation test:  37%|███▋      | 3703/10000 [00:44<01:29, 70.52 permutations/s]
Permutation test:  37%|███▋      | 3711/10000 [00:44<01:28, 70.94 permutations/s]
Permutation test:  37%|███▋      | 3719/10000 [00:44<01:33, 67.01 permutations/s]
Permutation test:  37%|███▋      | 3726/10000 [00:44<01:41, 62.00 permutations/s]
Permutation test:  37%|███▋      | 3733/10000 [00:44<01:40, 62.09 permutations/s]
Permutation test:  37%|███▋      | 3741/10000 [00:44<01:35, 65.48 permutations/s]
Permutation test:  37%|███▋      | 3749/10000 [00:45<01:31, 68.59 permutations/s]
Permutation test:  38%|███▊      | 3757/10000 [00:45<01:30, 68.63 permutations/s]
Permutation test:  38%|███▊      | 3765/10000 [00:45<01:28, 70.11 permutations/s]
Permutation test:  38%|███▊      | 3773/10000 [00:45<01:29, 69.19 permutations/s]
Permutation test:  38%|███▊      | 3781/10000 [00:45<01:29, 69.10 permutations/s]
Permutation test:  38%|███▊      | 3791/10000 [00:45<01:22, 75.55 permutations/s]
Permutation test:  38%|███▊      | 3799/10000 [00:45<01:29, 69.36 permutations/s]
Permutation test:  38%|███▊      | 3807/10000 [00:45<01:33, 66.04 permutations/s]
Permutation test:  38%|███▊      | 3814/10000 [00:46<01:33, 66.33 permutations/s]
Permutation test:  38%|███▊      | 3821/10000 [00:46<01:35, 64.45 permutations/s]
Permutation test:  38%|███▊      | 3829/10000 [00:46<01:32, 66.50 permutations/s]
Permutation test:  38%|███▊      | 3840/10000 [00:46<01:19, 77.90 permutations/s]
Permutation test:  38%|███▊      | 3848/10000 [00:46<01:22, 74.43 permutations/s]
Permutation test:  39%|███▊      | 3856/10000 [00:46<01:21, 75.84 permutations/s]
Permutation test:  39%|███▊      | 3864/10000 [00:46<01:26, 70.99 permutations/s]
Permutation test:  39%|███▊      | 3872/10000 [00:46<01:27, 70.43 permutations/s]
Permutation test:  39%|███▉      | 3883/10000 [00:46<01:16, 79.61 permutations/s]
Permutation test:  39%|███▉      | 3892/10000 [00:47<01:20, 75.58 permutations/s]
Permutation test:  39%|███▉      | 3900/10000 [00:47<01:22, 73.70 permutations/s]
Permutation test:  39%|███▉      | 3908/10000 [00:47<01:24, 71.96 permutations/s]
Permutation test:  39%|███▉      | 3917/10000 [00:47<01:20, 75.48 permutations/s]
Permutation test:  39%|███▉      | 3926/10000 [00:47<01:24, 72.23 permutations/s]
Permutation test:  39%|███▉      | 3938/10000 [00:47<01:12, 83.18 permutations/s]
Permutation test:  39%|███▉      | 3947/10000 [00:47<01:12, 83.95 permutations/s]
Permutation test:  40%|███▉      | 3956/10000 [00:47<01:16, 78.87 permutations/s]
Permutation test:  40%|███▉      | 3965/10000 [00:48<01:20, 74.65 permutations/s]
Permutation test:  40%|███▉      | 3973/10000 [00:48<01:22, 72.97 permutations/s]
Permutation test:  40%|███▉      | 3981/10000 [00:48<01:32, 65.34 permutations/s]
Permutation test:  40%|███▉      | 3989/10000 [00:48<01:31, 65.76 permutations/s]
Permutation test:  40%|███▉      | 3997/10000 [00:48<01:29, 67.20 permutations/s]
Permutation test:  40%|████      | 4005/10000 [00:48<01:27, 68.44 permutations/s]
Permutation test:  40%|████      | 4012/10000 [00:48<01:30, 66.06 permutations/s]
Permutation test:  40%|████      | 4020/10000 [00:48<01:26, 68.98 permutations/s]
Permutation test:  40%|████      | 4029/10000 [00:48<01:23, 71.60 permutations/s]
Permutation test:  40%|████      | 4037/10000 [00:49<01:21, 73.11 permutations/s]
Permutation test:  40%|████      | 4045/10000 [00:49<01:32, 64.34 permutations/s]
Permutation test:  41%|████      | 4052/10000 [00:49<01:33, 63.81 permutations/s]
Permutation test:  41%|████      | 4059/10000 [00:49<01:37, 60.98 permutations/s]
Permutation test:  41%|████      | 4068/10000 [00:49<01:27, 68.10 permutations/s]
Permutation test:  41%|████      | 4076/10000 [00:49<01:24, 70.15 permutations/s]
Permutation test:  41%|████      | 4084/10000 [00:49<01:26, 68.32 permutations/s]
Permutation test:  41%|████      | 4091/10000 [00:49<01:31, 64.60 permutations/s]
Permutation test:  41%|████      | 4098/10000 [00:50<01:32, 64.05 permutations/s]
Permutation test:  41%|████      | 4105/10000 [00:50<01:30, 64.85 permutations/s]
Permutation test:  41%|████      | 4112/10000 [00:50<01:32, 63.54 permutations/s]
Permutation test:  41%|████      | 4119/10000 [00:50<01:30, 65.27 permutations/s]
Permutation test:  41%|████▏     | 4127/10000 [00:50<01:29, 65.72 permutations/s]
Permutation test:  41%|████▏     | 4135/10000 [00:50<01:27, 67.39 permutations/s]
Permutation test:  41%|████▏     | 4142/10000 [00:50<01:28, 66.09 permutations/s]
Permutation test:  41%|████▏     | 4149/10000 [00:50<01:28, 65.98 permutations/s]
Permutation test:  42%|████▏     | 4157/10000 [00:50<01:24, 69.02 permutations/s]
Permutation test:  42%|████▏     | 4167/10000 [00:51<01:15, 77.70 permutations/s]
Permutation test:  42%|████▏     | 4175/10000 [00:51<01:23, 69.36 permutations/s]
Permutation test:  42%|████▏     | 4183/10000 [00:51<01:24, 68.44 permutations/s]
Permutation test:  42%|████▏     | 4190/10000 [00:51<01:27, 66.76 permutations/s]
Permutation test:  42%|████▏     | 4197/10000 [00:51<01:29, 64.86 permutations/s]
Permutation test:  42%|████▏     | 4205/10000 [00:51<01:27, 65.96 permutations/s]
Permutation test:  42%|████▏     | 4215/10000 [00:51<01:20, 72.13 permutations/s]
Permutation test:  42%|████▏     | 4225/10000 [00:51<01:13, 78.93 permutations/s]
Permutation test:  42%|████▏     | 4233/10000 [00:51<01:19, 72.79 permutations/s]
Permutation test:  42%|████▏     | 4241/10000 [00:52<01:24, 67.91 permutations/s]
Permutation test:  42%|████▏     | 4249/10000 [00:52<01:22, 69.88 permutations/s]
Permutation test:  43%|████▎     | 4258/10000 [00:52<01:20, 71.76 permutations/s]
Permutation test:  43%|████▎     | 4266/10000 [00:52<01:18, 73.51 permutations/s]
Permutation test:  43%|████▎     | 4274/10000 [00:52<01:17, 73.57 permutations/s]
Permutation test:  43%|████▎     | 4283/10000 [00:52<01:14, 76.61 permutations/s]
Permutation test:  43%|████▎     | 4292/10000 [00:52<01:11, 80.17 permutations/s]
Permutation test:  43%|████▎     | 4301/10000 [00:52<01:13, 77.82 permutations/s]
Permutation test:  43%|████▎     | 4309/10000 [00:53<01:17, 73.09 permutations/s]
Permutation test:  43%|████▎     | 4317/10000 [00:53<01:24, 67.42 permutations/s]
Permutation test:  43%|████▎     | 4325/10000 [00:53<01:21, 69.93 permutations/s]
Permutation test:  43%|████▎     | 4333/10000 [00:53<01:24, 66.83 permutations/s]
Permutation test:  43%|████▎     | 4340/10000 [00:53<01:27, 64.61 permutations/s]
Permutation test:  44%|████▎     | 4350/10000 [00:53<01:16, 73.55 permutations/s]
Permutation test:  44%|████▎     | 4358/10000 [00:53<01:16, 73.75 permutations/s]
Permutation test:  44%|████▎     | 4366/10000 [00:53<01:22, 68.67 permutations/s]
Permutation test:  44%|████▎     | 4374/10000 [00:53<01:25, 66.14 permutations/s]
Permutation test:  44%|████▍     | 4382/10000 [00:54<01:21, 68.94 permutations/s]
Permutation test:  44%|████▍     | 4390/10000 [00:54<01:26, 65.17 permutations/s]
Permutation test:  44%|████▍     | 4397/10000 [00:54<01:29, 62.41 permutations/s]
Permutation test:  44%|████▍     | 4407/10000 [00:54<01:19, 70.28 permutations/s]
Permutation test:  44%|████▍     | 4415/10000 [00:54<01:22, 67.36 permutations/s]
Permutation test:  44%|████▍     | 4422/10000 [00:54<01:25, 65.04 permutations/s]
Permutation test:  44%|████▍     | 4430/10000 [00:54<01:26, 64.64 permutations/s]
Permutation test:  44%|████▍     | 4440/10000 [00:54<01:17, 71.74 permutations/s]
Permutation test:  44%|████▍     | 4449/10000 [00:55<01:13, 75.52 permutations/s]
Permutation test:  45%|████▍     | 4457/10000 [00:55<01:16, 72.05 permutations/s]
Permutation test:  45%|████▍     | 4465/10000 [00:55<01:22, 67.02 permutations/s]
Permutation test:  45%|████▍     | 4472/10000 [00:55<01:22, 67.04 permutations/s]
Permutation test:  45%|████▍     | 4480/10000 [00:55<01:21, 67.81 permutations/s]
Permutation test:  45%|████▍     | 4488/10000 [00:55<01:20, 68.59 permutations/s]
Permutation test:  45%|████▍     | 4497/10000 [00:55<01:20, 68.58 permutations/s]
Permutation test:  45%|████▌     | 4505/10000 [00:55<01:17, 70.81 permutations/s]
Permutation test:  45%|████▌     | 4513/10000 [00:55<01:18, 69.73 permutations/s]
Permutation test:  45%|████▌     | 4521/10000 [00:56<01:16, 71.42 permutations/s]
Permutation test:  45%|████▌     | 4532/10000 [00:56<01:11, 76.36 permutations/s]
Permutation test:  45%|████▌     | 4540/10000 [00:56<01:14, 73.25 permutations/s]
Permutation test:  45%|████▌     | 4548/10000 [00:56<01:18, 69.81 permutations/s]
Permutation test:  46%|████▌     | 4558/10000 [00:56<01:12, 74.64 permutations/s]
Permutation test:  46%|████▌     | 4566/10000 [00:56<01:13, 73.76 permutations/s]
Permutation test:  46%|████▌     | 4574/10000 [00:56<01:16, 70.88 permutations/s]
Permutation test:  46%|████▌     | 4582/10000 [00:56<01:19, 68.31 permutations/s]
Permutation test:  46%|████▌     | 4589/10000 [00:57<01:20, 67.12 permutations/s]
Permutation test:  46%|████▌     | 4596/10000 [00:57<01:24, 63.87 permutations/s]
Permutation test:  46%|████▌     | 4603/10000 [00:57<01:24, 64.12 permutations/s]
Permutation test:  46%|████▌     | 4610/10000 [00:57<01:32, 58.35 permutations/s]
Permutation test:  46%|████▌     | 4617/10000 [00:57<01:28, 60.75 permutations/s]
Permutation test:  46%|████▋     | 4626/10000 [00:57<01:18, 68.30 permutations/s]
Permutation test:  46%|████▋     | 4635/10000 [00:57<01:12, 74.17 permutations/s]
Permutation test:  46%|████▋     | 4643/10000 [00:57<01:16, 70.22 permutations/s]
Permutation test:  47%|████▋     | 4651/10000 [00:58<01:20, 66.42 permutations/s]
Permutation test:  47%|████▋     | 4658/10000 [00:58<01:26, 61.65 permutations/s]
Permutation test:  47%|████▋     | 4666/10000 [00:58<01:22, 64.29 permutations/s]
Permutation test:  47%|████▋     | 4675/10000 [00:58<01:18, 67.54 permutations/s]
Permutation test:  47%|████▋     | 4684/10000 [00:58<01:16, 69.71 permutations/s]
Permutation test:  47%|████▋     | 4692/10000 [00:58<01:14, 70.90 permutations/s]
Permutation test:  47%|████▋     | 4700/10000 [00:58<01:13, 71.74 permutations/s]
Permutation test:  47%|████▋     | 4708/10000 [00:58<01:18, 67.45 permutations/s]
Permutation test:  47%|████▋     | 4718/10000 [00:58<01:12, 73.18 permutations/s]
Permutation test:  47%|████▋     | 4726/10000 [00:59<01:17, 67.65 permutations/s]
Permutation test:  47%|████▋     | 4736/10000 [00:59<01:10, 75.00 permutations/s]
Permutation test:  47%|████▋     | 4744/10000 [00:59<01:11, 73.31 permutations/s]
Permutation test:  48%|████▊     | 4753/10000 [00:59<01:11, 73.07 permutations/s]
Permutation test:  48%|████▊     | 4763/10000 [00:59<01:07, 77.73 permutations/s]
Permutation test:  48%|████▊     | 4772/10000 [00:59<01:04, 80.98 permutations/s]
Permutation test:  48%|████▊     | 4781/10000 [00:59<01:05, 79.96 permutations/s]
Permutation test:  48%|████▊     | 4791/10000 [00:59<01:01, 84.75 permutations/s]
Permutation test:  48%|████▊     | 4802/10000 [00:59<00:59, 87.66 permutations/s]
Permutation test:  48%|████▊     | 4811/10000 [01:00<01:01, 84.58 permutations/s]
Permutation test:  48%|████▊     | 4820/10000 [01:00<01:06, 77.56 permutations/s]
Permutation test:  48%|████▊     | 4828/10000 [01:00<01:11, 72.18 permutations/s]
Permutation test:  48%|████▊     | 4836/10000 [01:00<01:13, 70.52 permutations/s]
Permutation test:  48%|████▊     | 4844/10000 [01:00<01:18, 66.08 permutations/s]
Permutation test:  49%|████▊     | 4851/10000 [01:00<01:22, 62.26 permutations/s]
Permutation test:  49%|████▊     | 4858/10000 [01:00<01:22, 62.25 permutations/s]
Permutation test:  49%|████▊     | 4867/10000 [01:01<01:19, 64.65 permutations/s]
Permutation test:  49%|████▉     | 4876/10000 [01:01<01:16, 66.56 permutations/s]
Permutation test:  49%|████▉     | 4885/10000 [01:01<01:12, 70.23 permutations/s]
Permutation test:  49%|████▉     | 4893/10000 [01:01<01:17, 65.88 permutations/s]
Permutation test:  49%|████▉     | 4900/10000 [01:01<01:17, 66.21 permutations/s]
Permutation test:  49%|████▉     | 4911/10000 [01:01<01:06, 76.89 permutations/s]
Permutation test:  49%|████▉     | 4921/10000 [01:01<01:06, 75.92 permutations/s]
Permutation test:  49%|████▉     | 4929/10000 [01:01<01:07, 74.58 permutations/s]
Permutation test:  49%|████▉     | 4937/10000 [01:01<01:11, 70.52 permutations/s]
Permutation test:  49%|████▉     | 4946/10000 [01:02<01:12, 69.42 permutations/s]
Permutation test:  50%|████▉     | 4954/10000 [01:02<01:17, 65.40 permutations/s]
Permutation test:  50%|████▉     | 4962/10000 [01:02<01:14, 67.78 permutations/s]
Permutation test:  50%|████▉     | 4970/10000 [01:02<01:11, 70.80 permutations/s]
Permutation test:  50%|████▉     | 4978/10000 [01:02<01:13, 68.77 permutations/s]
Permutation test:  50%|████▉     | 4985/10000 [01:02<01:13, 68.50 permutations/s]
Permutation test:  50%|████▉     | 4994/10000 [01:02<01:08, 72.77 permutations/s]
Permutation test:  50%|█████     | 5003/10000 [01:02<01:08, 73.35 permutations/s]
Permutation test:  50%|█████     | 5014/10000 [01:03<01:04, 76.82 permutations/s]
Permutation test:  50%|█████     | 5022/10000 [01:03<01:12, 68.91 permutations/s]
Permutation test:  50%|█████     | 5029/10000 [01:03<01:14, 67.02 permutations/s]
Permutation test:  50%|█████     | 5036/10000 [01:03<01:14, 66.50 permutations/s]
Permutation test:  50%|█████     | 5043/10000 [01:03<01:16, 64.83 permutations/s]
Permutation test:  51%|█████     | 5052/10000 [01:03<01:10, 69.86 permutations/s]
Permutation test:  51%|█████     | 5061/10000 [01:03<01:06, 74.44 permutations/s]
Permutation test:  51%|█████     | 5069/10000 [01:03<01:05, 75.25 permutations/s]
Permutation test:  51%|█████     | 5077/10000 [01:03<01:04, 75.87 permutations/s]
Permutation test:  51%|█████     | 5086/10000 [01:04<01:03, 77.07 permutations/s]
Permutation test:  51%|█████     | 5094/10000 [01:04<01:06, 73.79 permutations/s]
Permutation test:  51%|█████     | 5102/10000 [01:04<01:10, 69.29 permutations/s]
Permutation test:  51%|█████     | 5111/10000 [01:04<01:09, 70.33 permutations/s]
Permutation test:  51%|█████     | 5119/10000 [01:04<01:11, 68.56 permutations/s]
Permutation test:  51%|█████▏    | 5126/10000 [01:04<01:16, 64.11 permutations/s]
Permutation test:  51%|█████▏    | 5134/10000 [01:04<01:13, 66.31 permutations/s]
Permutation test:  51%|█████▏    | 5145/10000 [01:04<01:04, 75.69 permutations/s]
Permutation test:  52%|█████▏    | 5153/10000 [01:05<01:03, 76.58 permutations/s]
Permutation test:  52%|█████▏    | 5161/10000 [01:05<01:12, 66.50 permutations/s]
Permutation test:  52%|█████▏    | 5168/10000 [01:05<01:13, 65.93 permutations/s]
Permutation test:  52%|█████▏    | 5175/10000 [01:05<01:15, 63.77 permutations/s]
Permutation test:  52%|█████▏    | 5182/10000 [01:05<01:14, 64.27 permutations/s]
Permutation test:  52%|█████▏    | 5190/10000 [01:05<01:12, 66.74 permutations/s]
Permutation test:  52%|█████▏    | 5198/10000 [01:05<01:09, 69.00 permutations/s]
Permutation test:  52%|█████▏    | 5205/10000 [01:05<01:11, 66.84 permutations/s]
Permutation test:  52%|█████▏    | 5212/10000 [01:05<01:12, 65.74 permutations/s]
Permutation test:  52%|█████▏    | 5219/10000 [01:06<01:11, 66.70 permutations/s]
Permutation test:  52%|█████▏    | 5227/10000 [01:06<01:09, 69.14 permutations/s]
Permutation test:  52%|█████▏    | 5236/10000 [01:06<01:03, 75.05 permutations/s]
Permutation test:  52%|█████▏    | 5245/10000 [01:06<01:00, 78.36 permutations/s]
Permutation test:  53%|█████▎    | 5253/10000 [01:06<01:00, 78.81 permutations/s]
Permutation test:  53%|█████▎    | 5261/10000 [01:06<01:05, 72.42 permutations/s]
Permutation test:  53%|█████▎    | 5269/10000 [01:06<01:06, 70.65 permutations/s]
Permutation test:  53%|█████▎    | 5277/10000 [01:06<01:10, 66.65 permutations/s]
Permutation test:  53%|█████▎    | 5288/10000 [01:06<01:00, 77.28 permutations/s]
Permutation test:  53%|█████▎    | 5296/10000 [01:07<01:04, 72.55 permutations/s]
Permutation test:  53%|█████▎    | 5304/10000 [01:07<01:05, 71.79 permutations/s]
Permutation test:  53%|█████▎    | 5312/10000 [01:07<01:05, 71.32 permutations/s]
Permutation test:  53%|█████▎    | 5320/10000 [01:07<01:04, 72.14 permutations/s]
Permutation test:  53%|█████▎    | 5328/10000 [01:07<01:03, 73.25 permutations/s]
Permutation test:  53%|█████▎    | 5336/10000 [01:07<01:08, 67.87 permutations/s]
Permutation test:  53%|█████▎    | 5343/10000 [01:07<01:13, 63.65 permutations/s]
Permutation test:  54%|█████▎    | 5350/10000 [01:07<01:14, 62.67 permutations/s]
Permutation test:  54%|█████▎    | 5357/10000 [01:08<01:12, 64.01 permutations/s]
Permutation test:  54%|█████▎    | 5364/10000 [01:08<01:10, 65.53 permutations/s]
Permutation test:  54%|█████▎    | 5372/10000 [01:08<01:11, 64.61 permutations/s]
Permutation test:  54%|█████▍    | 5379/10000 [01:08<01:12, 63.77 permutations/s]
Permutation test:  54%|█████▍    | 5389/10000 [01:08<01:03, 72.06 permutations/s]
Permutation test:  54%|█████▍    | 5397/10000 [01:08<01:08, 67.62 permutations/s]
Permutation test:  54%|█████▍    | 5405/10000 [01:08<01:07, 68.08 permutations/s]
Permutation test:  54%|█████▍    | 5412/10000 [01:08<01:09, 65.81 permutations/s]
Permutation test:  54%|█████▍    | 5420/10000 [01:08<01:07, 67.69 permutations/s]
Permutation test:  54%|█████▍    | 5427/10000 [01:09<01:09, 65.98 permutations/s]
Permutation test:  54%|█████▍    | 5434/10000 [01:09<01:12, 62.91 permutations/s]
Permutation test:  54%|█████▍    | 5441/10000 [01:09<01:15, 60.25 permutations/s]
Permutation test:  54%|█████▍    | 5448/10000 [01:09<01:14, 60.94 permutations/s]
Permutation test:  55%|█████▍    | 5455/10000 [01:09<01:11, 63.24 permutations/s]
Permutation test:  55%|█████▍    | 5463/10000 [01:09<01:08, 66.62 permutations/s]
Permutation test:  55%|█████▍    | 5473/10000 [01:09<01:02, 72.51 permutations/s]
Permutation test:  55%|█████▍    | 5481/10000 [01:09<01:03, 71.56 permutations/s]
Permutation test:  55%|█████▍    | 5490/10000 [01:09<01:03, 70.48 permutations/s]
Permutation test:  55%|█████▍    | 5498/10000 [01:10<01:02, 72.09 permutations/s]
Permutation test:  55%|█████▌    | 5506/10000 [01:10<01:06, 67.56 permutations/s]
Permutation test:  55%|█████▌    | 5513/10000 [01:10<01:07, 66.16 permutations/s]
Permutation test:  55%|█████▌    | 5522/10000 [01:10<01:03, 71.02 permutations/s]
Permutation test:  55%|█████▌    | 5530/10000 [01:10<01:01, 72.67 permutations/s]
Permutation test:  55%|█████▌    | 5538/10000 [01:10<01:01, 72.64 permutations/s]
Permutation test:  55%|█████▌    | 5546/10000 [01:10<01:01, 71.93 permutations/s]
Permutation test:  56%|█████▌    | 5554/10000 [01:10<01:06, 66.82 permutations/s]
Permutation test:  56%|█████▌    | 5564/10000 [01:11<01:01, 72.50 permutations/s]
Permutation test:  56%|█████▌    | 5572/10000 [01:11<01:03, 69.44 permutations/s]
Permutation test:  56%|█████▌    | 5580/10000 [01:11<01:10, 62.90 permutations/s]
Permutation test:  56%|█████▌    | 5588/10000 [01:11<01:05, 67.02 permutations/s]
Permutation test:  56%|█████▌    | 5597/10000 [01:11<01:02, 70.82 permutations/s]
Permutation test:  56%|█████▌    | 5607/10000 [01:11<00:57, 76.90 permutations/s]
Permutation test:  56%|█████▌    | 5615/10000 [01:11<00:57, 76.73 permutations/s]
Permutation test:  56%|█████▌    | 5623/10000 [01:11<01:00, 72.38 permutations/s]
Permutation test:  56%|█████▋    | 5631/10000 [01:11<01:01, 70.94 permutations/s]
Permutation test:  56%|█████▋    | 5641/10000 [01:12<00:55, 78.49 permutations/s]
Permutation test:  56%|█████▋    | 5649/10000 [01:12<00:56, 77.68 permutations/s]
Permutation test:  57%|█████▋    | 5657/10000 [01:12<00:56, 76.68 permutations/s]
Permutation test:  57%|█████▋    | 5665/10000 [01:12<00:57, 75.73 permutations/s]
Permutation test:  57%|█████▋    | 5673/10000 [01:12<01:03, 67.97 permutations/s]
Permutation test:  57%|█████▋    | 5681/10000 [01:12<01:01, 70.33 permutations/s]
Permutation test:  57%|█████▋    | 5689/10000 [01:12<01:03, 67.56 permutations/s]
Permutation test:  57%|█████▋    | 5696/10000 [01:12<01:04, 67.15 permutations/s]
Permutation test:  57%|█████▋    | 5703/10000 [01:13<01:03, 67.91 permutations/s]
Permutation test:  57%|█████▋    | 5712/10000 [01:13<00:59, 71.55 permutations/s]
Permutation test:  57%|█████▋    | 5720/10000 [01:13<01:00, 70.64 permutations/s]
Permutation test:  57%|█████▋    | 5730/10000 [01:13<00:56, 75.39 permutations/s]
Permutation test:  57%|█████▋    | 5738/10000 [01:13<00:57, 73.58 permutations/s]
Permutation test:  57%|█████▋    | 5747/10000 [01:13<00:57, 74.05 permutations/s]
Permutation test:  58%|█████▊    | 5755/10000 [01:13<00:59, 71.72 permutations/s]
Permutation test:  58%|█████▊    | 5763/10000 [01:13<01:08, 61.66 permutations/s]
Permutation test:  58%|█████▊    | 5773/10000 [01:13<00:59, 70.69 permutations/s]
Permutation test:  58%|█████▊    | 5781/10000 [01:14<01:02, 67.44 permutations/s]
Permutation test:  58%|█████▊    | 5789/10000 [01:14<01:05, 64.59 permutations/s]
Permutation test:  58%|█████▊    | 5798/10000 [01:14<01:00, 69.77 permutations/s]
Permutation test:  58%|█████▊    | 5806/10000 [01:14<00:59, 70.30 permutations/s]
Permutation test:  58%|█████▊    | 5814/10000 [01:14<00:58, 72.03 permutations/s]
Permutation test:  58%|█████▊    | 5822/10000 [01:14<00:58, 71.76 permutations/s]
Permutation test:  58%|█████▊    | 5830/10000 [01:14<01:01, 67.93 permutations/s]
Permutation test:  58%|█████▊    | 5839/10000 [01:14<00:57, 72.58 permutations/s]
Permutation test:  58%|█████▊    | 5847/10000 [01:15<01:01, 67.21 permutations/s]
Permutation test:  59%|█████▊    | 5854/10000 [01:15<01:04, 64.62 permutations/s]
Permutation test:  59%|█████▊    | 5861/10000 [01:15<01:08, 60.85 permutations/s]
Permutation test:  59%|█████▊    | 5870/10000 [01:15<01:02, 65.65 permutations/s]
Permutation test:  59%|█████▉    | 5877/10000 [01:15<01:02, 66.13 permutations/s]
Permutation test:  59%|█████▉    | 5886/10000 [01:15<00:57, 71.02 permutations/s]
Permutation test:  59%|█████▉    | 5894/10000 [01:15<01:01, 66.88 permutations/s]
Permutation test:  59%|█████▉    | 5901/10000 [01:15<01:02, 65.65 permutations/s]
Permutation test:  59%|█████▉    | 5908/10000 [01:16<01:03, 64.10 permutations/s]
Permutation test:  59%|█████▉    | 5916/10000 [01:16<00:59, 68.28 permutations/s]
Permutation test:  59%|█████▉    | 5923/10000 [01:16<01:02, 65.05 permutations/s]
Permutation test:  59%|█████▉    | 5930/10000 [01:16<01:06, 61.21 permutations/s]
Permutation test:  59%|█████▉    | 5937/10000 [01:16<01:04, 62.97 permutations/s]
Permutation test:  59%|█████▉    | 5945/10000 [01:16<01:02, 64.66 permutations/s]
Permutation test:  60%|█████▉    | 5952/10000 [01:16<01:03, 64.05 permutations/s]
Permutation test:  60%|█████▉    | 5962/10000 [01:16<00:55, 72.88 permutations/s]
Permutation test:  60%|█████▉    | 5970/10000 [01:16<00:57, 69.57 permutations/s]
Permutation test:  60%|█████▉    | 5978/10000 [01:17<00:56, 70.80 permutations/s]
Permutation test:  60%|█████▉    | 5986/10000 [01:17<00:57, 70.26 permutations/s]
Permutation test:  60%|█████▉    | 5994/10000 [01:17<00:58, 68.52 permutations/s]
Permutation test:  60%|██████    | 6002/10000 [01:17<01:00, 66.58 permutations/s]
Permutation test:  60%|██████    | 6009/10000 [01:17<00:59, 66.57 permutations/s]
Permutation test:  60%|██████    | 6016/10000 [01:17<00:59, 66.61 permutations/s]
Permutation test:  60%|██████    | 6023/10000 [01:17<00:58, 67.45 permutations/s]
Permutation test:  60%|██████    | 6030/10000 [01:17<01:00, 65.70 permutations/s]
Permutation test:  60%|██████    | 6039/10000 [01:17<00:56, 70.12 permutations/s]
Permutation test:  60%|██████    | 6049/10000 [01:18<00:52, 75.09 permutations/s]
Permutation test:  61%|██████    | 6057/10000 [01:18<00:57, 68.22 permutations/s]
Permutation test:  61%|██████    | 6066/10000 [01:18<00:54, 72.37 permutations/s]
Permutation test:  61%|██████    | 6074/10000 [01:18<00:55, 71.35 permutations/s]
Permutation test:  61%|██████    | 6082/10000 [01:18<00:56, 69.93 permutations/s]
Permutation test:  61%|██████    | 6091/10000 [01:18<00:53, 73.71 permutations/s]
Permutation test:  61%|██████    | 6099/10000 [01:18<00:54, 71.50 permutations/s]
Permutation test:  61%|██████    | 6107/10000 [01:18<00:58, 66.00 permutations/s]
Permutation test:  61%|██████    | 6115/10000 [01:19<00:56, 69.13 permutations/s]
Permutation test:  61%|██████    | 6123/10000 [01:19<00:54, 70.93 permutations/s]
Permutation test:  61%|██████▏   | 6131/10000 [01:19<01:01, 62.41 permutations/s]
Permutation test:  61%|██████▏   | 6139/10000 [01:19<00:58, 66.32 permutations/s]
Permutation test:  61%|██████▏   | 6146/10000 [01:19<00:58, 65.87 permutations/s]
Permutation test:  62%|██████▏   | 6154/10000 [01:19<00:56, 68.20 permutations/s]
Permutation test:  62%|██████▏   | 6161/10000 [01:19<00:58, 65.71 permutations/s]
Permutation test:  62%|██████▏   | 6170/10000 [01:19<00:53, 71.83 permutations/s]
Permutation test:  62%|██████▏   | 6178/10000 [01:19<00:55, 68.58 permutations/s]
Permutation test:  62%|██████▏   | 6185/10000 [01:20<00:57, 66.17 permutations/s]
Permutation test:  62%|██████▏   | 6192/10000 [01:20<00:56, 67.15 permutations/s]
Permutation test:  62%|██████▏   | 6199/10000 [01:20<00:56, 67.13 permutations/s]
Permutation test:  62%|██████▏   | 6206/10000 [01:20<00:56, 67.25 permutations/s]
Permutation test:  62%|██████▏   | 6213/10000 [01:20<01:02, 60.44 permutations/s]
Permutation test:  62%|██████▏   | 6222/10000 [01:20<00:55, 68.19 permutations/s]
Permutation test:  62%|██████▏   | 6230/10000 [01:20<00:56, 66.37 permutations/s]
Permutation test:  62%|██████▏   | 6237/10000 [01:20<00:59, 62.93 permutations/s]
Permutation test:  62%|██████▏   | 6246/10000 [01:20<00:53, 69.58 permutations/s]
Permutation test:  63%|██████▎   | 6254/10000 [01:21<00:52, 71.82 permutations/s]
Permutation test:  63%|██████▎   | 6262/10000 [01:21<00:58, 63.56 permutations/s]
Permutation test:  63%|██████▎   | 6269/10000 [01:21<01:05, 57.10 permutations/s]
Permutation test:  63%|██████▎   | 6275/10000 [01:21<01:07, 55.04 permutations/s]
Permutation test:  63%|██████▎   | 6282/10000 [01:21<01:04, 57.93 permutations/s]
Permutation test:  63%|██████▎   | 6289/10000 [01:21<01:01, 60.63 permutations/s]
Permutation test:  63%|██████▎   | 6301/10000 [01:21<00:48, 75.80 permutations/s]
Permutation test:  63%|██████▎   | 6314/10000 [01:21<00:41, 88.80 permutations/s]
Permutation test:  63%|██████▎   | 6328/10000 [01:22<00:36, 100.03 permutations/s]
Permutation test:  63%|██████▎   | 6343/10000 [01:22<00:32, 113.58 permutations/s]
Permutation test:  64%|██████▎   | 6357/10000 [01:22<00:30, 119.77 permutations/s]
Permutation test:  64%|██████▎   | 6372/10000 [01:22<00:28, 126.88 permutations/s]
Permutation test:  64%|██████▍   | 6388/10000 [01:22<00:27, 133.39 permutations/s]
Permutation test:  64%|██████▍   | 6402/10000 [01:22<00:28, 125.15 permutations/s]
Permutation test:  64%|██████▍   | 6415/10000 [01:22<00:29, 121.17 permutations/s]
Permutation test:  64%|██████▍   | 6428/10000 [01:22<00:29, 119.61 permutations/s]
Permutation test:  64%|██████▍   | 6441/10000 [01:22<00:30, 115.86 permutations/s]
Permutation test:  65%|██████▍   | 6454/10000 [01:23<00:29, 118.72 permutations/s]
Permutation test:  65%|██████▍   | 6467/10000 [01:23<00:29, 120.38 permutations/s]
Permutation test:  65%|██████▍   | 6481/10000 [01:23<00:28, 123.12 permutations/s]
Permutation test:  65%|██████▍   | 6494/10000 [01:23<00:28, 122.14 permutations/s]
Permutation test:  65%|██████▌   | 6509/10000 [01:23<00:27, 128.81 permutations/s]
Permutation test:  65%|██████▌   | 6522/10000 [01:23<00:28, 123.50 permutations/s]
Permutation test:  65%|██████▌   | 6538/10000 [01:23<00:27, 125.63 permutations/s]
Permutation test:  66%|██████▌   | 6551/10000 [01:23<00:27, 124.42 permutations/s]
Permutation test:  66%|██████▌   | 6567/10000 [01:23<00:25, 134.17 permutations/s]
Permutation test:  66%|██████▌   | 6581/10000 [01:24<00:28, 118.52 permutations/s]
Permutation test:  66%|██████▌   | 6594/10000 [01:24<00:28, 121.04 permutations/s]
Permutation test:  66%|██████▌   | 6609/10000 [01:24<00:26, 128.17 permutations/s]
Permutation test:  66%|██████▌   | 6623/10000 [01:24<00:29, 116.14 permutations/s]
Permutation test:  66%|██████▋   | 6636/10000 [01:24<00:30, 112.12 permutations/s]
Permutation test:  66%|██████▋   | 6648/10000 [01:24<00:32, 104.55 permutations/s]
Permutation test:  67%|██████▋   | 6661/10000 [01:24<00:30, 109.36 permutations/s]
Permutation test:  67%|██████▋   | 6676/10000 [01:24<00:27, 119.05 permutations/s]
Permutation test:  67%|██████▋   | 6689/10000 [01:25<00:28, 115.64 permutations/s]
Permutation test:  67%|██████▋   | 6701/10000 [01:25<00:33, 97.11 permutations/s]
Permutation test:  67%|██████▋   | 6712/10000 [01:25<00:37, 86.84 permutations/s]
Permutation test:  67%|██████▋   | 6722/10000 [01:25<00:40, 81.53 permutations/s]
Permutation test:  67%|██████▋   | 6731/10000 [01:25<00:40, 79.88 permutations/s]
Permutation test:  67%|██████▋   | 6740/10000 [01:25<00:44, 73.80 permutations/s]
Permutation test:  67%|██████▋   | 6748/10000 [01:25<00:45, 70.90 permutations/s]
Permutation test:  68%|██████▊   | 6756/10000 [01:25<00:45, 71.15 permutations/s]
Permutation test:  68%|██████▊   | 6764/10000 [01:26<00:51, 62.30 permutations/s]
Permutation test:  68%|██████▊   | 6771/10000 [01:26<00:51, 63.29 permutations/s]
Permutation test:  68%|██████▊   | 6778/10000 [01:26<00:51, 62.56 permutations/s]
Permutation test:  68%|██████▊   | 6787/10000 [01:26<00:47, 67.71 permutations/s]
Permutation test:  68%|██████▊   | 6795/10000 [01:26<00:48, 66.15 permutations/s]
Permutation test:  68%|██████▊   | 6802/10000 [01:26<00:50, 63.85 permutations/s]
Permutation test:  68%|██████▊   | 6809/10000 [01:26<00:50, 62.72 permutations/s]
Permutation test:  68%|██████▊   | 6819/10000 [01:26<00:44, 71.32 permutations/s]
Permutation test:  68%|██████▊   | 6827/10000 [01:27<00:46, 68.27 permutations/s]
Permutation test:  68%|██████▊   | 6834/10000 [01:27<00:46, 68.70 permutations/s]
Permutation test:  68%|██████▊   | 6841/10000 [01:27<00:53, 58.81 permutations/s]
Permutation test:  68%|██████▊   | 6848/10000 [01:27<00:52, 60.36 permutations/s]
Permutation test:  69%|██████▊   | 6855/10000 [01:27<00:51, 61.26 permutations/s]
Permutation test:  69%|██████▊   | 6864/10000 [01:27<00:45, 68.53 permutations/s]
Permutation test:  69%|██████▊   | 6872/10000 [01:27<00:46, 67.92 permutations/s]
Permutation test:  69%|██████▉   | 6882/10000 [01:27<00:44, 70.61 permutations/s]
Permutation test:  69%|██████▉   | 6890/10000 [01:28<00:45, 68.13 permutations/s]
Permutation test:  69%|██████▉   | 6897/10000 [01:28<00:47, 65.76 permutations/s]
Permutation test:  69%|██████▉   | 6905/10000 [01:28<00:45, 68.76 permutations/s]
Permutation test:  69%|██████▉   | 6912/10000 [01:28<00:46, 66.21 permutations/s]
Permutation test:  69%|██████▉   | 6922/10000 [01:28<00:41, 75.06 permutations/s]
Permutation test:  69%|██████▉   | 6931/10000 [01:28<00:42, 72.95 permutations/s]
Permutation test:  69%|██████▉   | 6941/10000 [01:28<00:38, 79.42 permutations/s]
Permutation test:  70%|██████▉   | 6950/10000 [01:28<00:39, 76.51 permutations/s]
Permutation test:  70%|██████▉   | 6961/10000 [01:28<00:38, 79.96 permutations/s]
Permutation test:  70%|██████▉   | 6970/10000 [01:29<00:40, 74.94 permutations/s]
Permutation test:  70%|██████▉   | 6978/10000 [01:29<00:42, 71.90 permutations/s]
Permutation test:  70%|██████▉   | 6988/10000 [01:29<00:39, 75.92 permutations/s]
Permutation test:  70%|██████▉   | 6997/10000 [01:29<00:38, 77.92 permutations/s]
Permutation test:  70%|███████   | 7006/10000 [01:29<00:38, 78.48 permutations/s]
Permutation test:  70%|███████   | 7016/10000 [01:29<00:35, 83.60 permutations/s]
Permutation test:  70%|███████   | 7025/10000 [01:29<00:41, 71.86 permutations/s]
Permutation test:  70%|███████   | 7033/10000 [01:30<00:44, 66.61 permutations/s]
Permutation test:  70%|███████   | 7040/10000 [01:30<00:44, 66.51 permutations/s]
Permutation test:  70%|███████   | 7047/10000 [01:30<00:44, 67.01 permutations/s]
Permutation test:  71%|███████   | 7055/10000 [01:30<00:42, 69.08 permutations/s]
Permutation test:  71%|███████   | 7065/10000 [01:30<00:37, 77.37 permutations/s]
Permutation test:  71%|███████   | 7073/10000 [01:30<00:38, 75.66 permutations/s]
Permutation test:  71%|███████   | 7081/10000 [01:30<00:43, 67.75 permutations/s]
Permutation test:  71%|███████   | 7089/10000 [01:30<00:41, 70.43 permutations/s]
Permutation test:  71%|███████   | 7097/10000 [01:30<00:44, 65.70 permutations/s]
Permutation test:  71%|███████   | 7107/10000 [01:31<00:38, 74.51 permutations/s]
Permutation test:  71%|███████   | 7115/10000 [01:31<00:40, 70.60 permutations/s]
Permutation test:  71%|███████   | 7123/10000 [01:31<00:41, 69.94 permutations/s]
Permutation test:  71%|███████▏  | 7132/10000 [01:31<00:39, 71.97 permutations/s]
Permutation test:  71%|███████▏  | 7140/10000 [01:31<00:41, 69.09 permutations/s]
Permutation test:  72%|███████▏  | 7151/10000 [01:31<00:35, 79.19 permutations/s]
Permutation test:  72%|███████▏  | 7160/10000 [01:31<00:34, 82.04 permutations/s]
Permutation test:  72%|███████▏  | 7169/10000 [01:31<00:37, 75.30 permutations/s]
Permutation test:  72%|███████▏  | 7177/10000 [01:31<00:38, 74.27 permutations/s]
Permutation test:  72%|███████▏  | 7185/10000 [01:32<00:41, 68.62 permutations/s]
Permutation test:  72%|███████▏  | 7193/10000 [01:32<00:42, 65.78 permutations/s]
Permutation test:  72%|███████▏  | 7200/10000 [01:32<00:42, 66.28 permutations/s]
Permutation test:  72%|███████▏  | 7211/10000 [01:32<00:38, 71.76 permutations/s]
Permutation test:  72%|███████▏  | 7219/10000 [01:32<00:40, 68.22 permutations/s]
Permutation test:  72%|███████▏  | 7227/10000 [01:32<00:41, 67.17 permutations/s]
Permutation test:  72%|███████▏  | 7234/10000 [01:32<00:42, 65.18 permutations/s]
Permutation test:  72%|███████▏  | 7242/10000 [01:32<00:41, 66.07 permutations/s]
Permutation test:  72%|███████▎  | 7250/10000 [01:33<00:40, 67.89 permutations/s]
Permutation test:  73%|███████▎  | 7257/10000 [01:33<00:42, 64.32 permutations/s]
Permutation test:  73%|███████▎  | 7264/10000 [01:33<00:44, 61.81 permutations/s]
Permutation test:  73%|███████▎  | 7273/10000 [01:33<00:40, 67.89 permutations/s]
Permutation test:  73%|███████▎  | 7281/10000 [01:33<00:38, 70.33 permutations/s]
Permutation test:  73%|███████▎  | 7291/10000 [01:33<00:34, 77.57 permutations/s]
Permutation test:  73%|███████▎  | 7299/10000 [01:33<00:37, 72.65 permutations/s]
Permutation test:  73%|███████▎  | 7307/10000 [01:33<00:36, 73.05 permutations/s]
Permutation test:  73%|███████▎  | 7315/10000 [01:34<00:38, 69.73 permutations/s]
Permutation test:  73%|███████▎  | 7323/10000 [01:34<00:37, 70.59 permutations/s]
Permutation test:  73%|███████▎  | 7331/10000 [01:34<00:37, 71.84 permutations/s]
Permutation test:  73%|███████▎  | 7339/10000 [01:34<00:40, 66.06 permutations/s]
Permutation test:  73%|███████▎  | 7347/10000 [01:34<00:38, 68.89 permutations/s]
Permutation test:  74%|███████▎  | 7355/10000 [01:34<00:37, 70.87 permutations/s]
Permutation test:  74%|███████▎  | 7364/10000 [01:34<00:37, 71.02 permutations/s]
Permutation test:  74%|███████▎  | 7372/10000 [01:34<00:38, 68.96 permutations/s]
Permutation test:  74%|███████▍  | 7379/10000 [01:34<00:38, 67.78 permutations/s]
Permutation test:  74%|███████▍  | 7390/10000 [01:35<00:33, 77.49 permutations/s]
Permutation test:  74%|███████▍  | 7398/10000 [01:35<00:38, 67.91 permutations/s]
Permutation test:  74%|███████▍  | 7406/10000 [01:35<00:41, 62.07 permutations/s]
Permutation test:  74%|███████▍  | 7413/10000 [01:35<00:40, 63.42 permutations/s]
Permutation test:  74%|███████▍  | 7420/10000 [01:35<00:41, 62.90 permutations/s]
Permutation test:  74%|███████▍  | 7431/10000 [01:35<00:35, 73.23 permutations/s]
Permutation test:  74%|███████▍  | 7439/10000 [01:35<00:35, 71.85 permutations/s]
Permutation test:  74%|███████▍  | 7447/10000 [01:35<00:38, 66.25 permutations/s]
Permutation test:  75%|███████▍  | 7457/10000 [01:36<00:36, 70.63 permutations/s]
Permutation test:  75%|███████▍  | 7469/10000 [01:36<00:31, 80.51 permutations/s]
Permutation test:  75%|███████▍  | 7478/10000 [01:36<00:33, 74.63 permutations/s]
Permutation test:  75%|███████▍  | 7488/10000 [01:36<00:32, 77.24 permutations/s]
Permutation test:  75%|███████▍  | 7496/10000 [01:36<00:33, 75.47 permutations/s]
Permutation test:  75%|███████▌  | 7504/10000 [01:36<00:35, 70.73 permutations/s]
Permutation test:  75%|███████▌  | 7512/10000 [01:36<00:34, 71.49 permutations/s]
Permutation test:  75%|███████▌  | 7520/10000 [01:36<00:35, 69.73 permutations/s]
Permutation test:  75%|███████▌  | 7530/10000 [01:37<00:32, 76.66 permutations/s]
Permutation test:  75%|███████▌  | 7538/10000 [01:37<00:34, 71.30 permutations/s]
Permutation test:  75%|███████▌  | 7546/10000 [01:37<00:35, 69.94 permutations/s]
Permutation test:  76%|███████▌  | 7555/10000 [01:37<00:34, 70.05 permutations/s]
Permutation test:  76%|███████▌  | 7563/10000 [01:37<00:35, 69.06 permutations/s]
Permutation test:  76%|███████▌  | 7571/10000 [01:37<00:36, 66.43 permutations/s]
Permutation test:  76%|███████▌  | 7581/10000 [01:37<00:33, 71.94 permutations/s]
Permutation test:  76%|███████▌  | 7589/10000 [01:37<00:34, 70.22 permutations/s]
Permutation test:  76%|███████▌  | 7597/10000 [01:38<00:35, 68.03 permutations/s]
Permutation test:  76%|███████▌  | 7604/10000 [01:38<00:36, 65.22 permutations/s]
Permutation test:  76%|███████▌  | 7611/10000 [01:38<00:37, 64.38 permutations/s]
Permutation test:  76%|███████▌  | 7619/10000 [01:38<00:35, 67.91 permutations/s]
Permutation test:  76%|███████▋  | 7628/10000 [01:38<00:32, 73.62 permutations/s]
Permutation test:  76%|███████▋  | 7636/10000 [01:38<00:31, 74.81 permutations/s]
Permutation test:  76%|███████▋  | 7644/10000 [01:38<00:32, 72.10 permutations/s]
Permutation test:  77%|███████▋  | 7653/10000 [01:38<00:32, 73.24 permutations/s]
Permutation test:  77%|███████▋  | 7661/10000 [01:38<00:32, 71.80 permutations/s]
Permutation test:  77%|███████▋  | 7669/10000 [01:39<00:32, 72.44 permutations/s]
Permutation test:  77%|███████▋  | 7677/10000 [01:39<00:31, 72.91 permutations/s]
Permutation test:  77%|███████▋  | 7685/10000 [01:39<00:32, 70.16 permutations/s]
Permutation test:  77%|███████▋  | 7693/10000 [01:39<00:33, 68.84 permutations/s]
Permutation test:  77%|███████▋  | 7701/10000 [01:39<00:34, 65.75 permutations/s]
Permutation test:  77%|███████▋  | 7710/10000 [01:39<00:31, 71.74 permutations/s]
Permutation test:  77%|███████▋  | 7718/10000 [01:39<00:32, 71.29 permutations/s]
Permutation test:  77%|███████▋  | 7727/10000 [01:39<00:30, 74.88 permutations/s]
Permutation test:  77%|███████▋  | 7738/10000 [01:39<00:28, 79.89 permutations/s]
Permutation test:  77%|███████▋  | 7747/10000 [01:40<00:29, 77.68 permutations/s]
Permutation test:  78%|███████▊  | 7757/10000 [01:40<00:27, 80.93 permutations/s]
Permutation test:  78%|███████▊  | 7766/10000 [01:40<00:29, 75.23 permutations/s]
Permutation test:  78%|███████▊  | 7774/10000 [01:40<00:30, 73.51 permutations/s]
Permutation test:  78%|███████▊  | 7782/10000 [01:40<00:30, 73.66 permutations/s]
Permutation test:  78%|███████▊  | 7790/10000 [01:40<00:34, 64.94 permutations/s]
Permutation test:  78%|███████▊  | 7798/10000 [01:40<00:33, 66.02 permutations/s]
Permutation test:  78%|███████▊  | 7807/10000 [01:40<00:30, 71.41 permutations/s]
Permutation test:  78%|███████▊  | 7816/10000 [01:41<00:30, 71.68 permutations/s]
Permutation test:  78%|███████▊  | 7824/10000 [01:41<00:29, 73.21 permutations/s]
Permutation test:  78%|███████▊  | 7832/10000 [01:41<00:29, 73.31 permutations/s]
Permutation test:  78%|███████▊  | 7840/10000 [01:41<00:30, 70.71 permutations/s]
Permutation test:  78%|███████▊  | 7848/10000 [01:41<00:32, 65.51 permutations/s]
Permutation test:  79%|███████▊  | 7857/10000 [01:41<00:29, 71.58 permutations/s]
Permutation test:  79%|███████▊  | 7865/10000 [01:41<00:32, 65.59 permutations/s]
Permutation test:  79%|███████▊  | 7873/10000 [01:41<00:30, 68.93 permutations/s]
Permutation test:  79%|███████▉  | 7881/10000 [01:42<00:30, 68.44 permutations/s]
Permutation test:  79%|███████▉  | 7888/10000 [01:42<00:31, 66.09 permutations/s]
Permutation test:  79%|███████▉  | 7895/10000 [01:42<00:32, 64.99 permutations/s]
Permutation test:  79%|███████▉  | 7902/10000 [01:42<00:32, 64.70 permutations/s]
Permutation test:  79%|███████▉  | 7911/10000 [01:42<00:29, 70.38 permutations/s]
Permutation test:  79%|███████▉  | 7919/10000 [01:42<00:31, 66.30 permutations/s]
Permutation test:  79%|███████▉  | 7927/10000 [01:42<00:30, 68.76 permutations/s]
Permutation test:  79%|███████▉  | 7934/10000 [01:42<00:30, 67.02 permutations/s]
Permutation test:  79%|███████▉  | 7943/10000 [01:42<00:30, 67.89 permutations/s]
Permutation test:  80%|███████▉  | 7953/10000 [01:43<00:27, 75.49 permutations/s]
Permutation test:  80%|███████▉  | 7961/10000 [01:43<00:26, 76.55 permutations/s]
Permutation test:  80%|███████▉  | 7969/10000 [01:43<00:28, 71.95 permutations/s]
Permutation test:  80%|███████▉  | 7977/10000 [01:43<00:30, 65.72 permutations/s]
Permutation test:  80%|███████▉  | 7985/10000 [01:43<00:29, 69.15 permutations/s]
Permutation test:  80%|███████▉  | 7993/10000 [01:43<00:29, 69.12 permutations/s]
Permutation test:  80%|████████  | 8001/10000 [01:43<00:28, 69.40 permutations/s]
Permutation test:  80%|████████  | 8009/10000 [01:43<00:30, 66.33 permutations/s]
Permutation test:  80%|████████  | 8016/10000 [01:43<00:30, 65.98 permutations/s]
Permutation test:  80%|████████  | 8028/10000 [01:44<00:26, 74.06 permutations/s]
Permutation test:  80%|████████  | 8037/10000 [01:44<00:27, 72.33 permutations/s]
Permutation test:  80%|████████  | 8045/10000 [01:44<00:29, 66.72 permutations/s]
Permutation test:  81%|████████  | 8055/10000 [01:44<00:26, 74.21 permutations/s]
Permutation test:  81%|████████  | 8063/10000 [01:44<00:26, 73.55 permutations/s]
Permutation test:  81%|████████  | 8071/10000 [01:44<00:29, 64.79 permutations/s]
Permutation test:  81%|████████  | 8079/10000 [01:44<00:28, 67.82 permutations/s]
Permutation test:  81%|████████  | 8088/10000 [01:44<00:26, 73.04 permutations/s]
Permutation test:  81%|████████  | 8096/10000 [01:45<00:25, 74.65 permutations/s]
Permutation test:  81%|████████  | 8104/10000 [01:45<00:27, 68.55 permutations/s]
Permutation test:  81%|████████  | 8112/10000 [01:45<00:27, 68.64 permutations/s]
Permutation test:  81%|████████  | 8120/10000 [01:45<00:29, 63.63 permutations/s]
Permutation test:  81%|████████▏ | 8127/10000 [01:45<00:29, 63.35 permutations/s]
Permutation test:  81%|████████▏ | 8137/10000 [01:45<00:25, 71.99 permutations/s]
Permutation test:  81%|████████▏ | 8148/10000 [01:45<00:24, 74.94 permutations/s]
Permutation test:  82%|████████▏ | 8156/10000 [01:45<00:25, 72.67 permutations/s]
Permutation test:  82%|████████▏ | 8164/10000 [01:46<00:25, 71.48 permutations/s]
Permutation test:  82%|████████▏ | 8172/10000 [01:46<00:26, 69.33 permutations/s]
Permutation test:  82%|████████▏ | 8179/10000 [01:46<00:26, 68.12 permutations/s]
Permutation test:  82%|████████▏ | 8186/10000 [01:46<00:29, 61.33 permutations/s]
Permutation test:  82%|████████▏ | 8196/10000 [01:46<00:26, 68.49 permutations/s]
Permutation test:  82%|████████▏ | 8204/10000 [01:46<00:25, 69.20 permutations/s]
Permutation test:  82%|████████▏ | 8214/10000 [01:46<00:25, 70.78 permutations/s]
Permutation test:  82%|████████▏ | 8222/10000 [01:46<00:26, 67.45 permutations/s]
Permutation test:  82%|████████▏ | 8232/10000 [01:47<00:23, 74.27 permutations/s]
Permutation test:  82%|████████▏ | 8240/10000 [01:47<00:24, 70.56 permutations/s]
Permutation test:  82%|████████▏ | 8248/10000 [01:47<00:26, 67.15 permutations/s]
Permutation test:  83%|████████▎ | 8258/10000 [01:47<00:24, 70.16 permutations/s]
Permutation test:  83%|████████▎ | 8267/10000 [01:47<00:23, 74.38 permutations/s]
Permutation test:  83%|████████▎ | 8275/10000 [01:47<00:22, 75.81 permutations/s]
Permutation test:  83%|████████▎ | 8284/10000 [01:47<00:21, 79.50 permutations/s]
Permutation test:  83%|████████▎ | 8293/10000 [01:47<00:24, 70.09 permutations/s]
Permutation test:  83%|████████▎ | 8303/10000 [01:48<00:22, 73.79 permutations/s]
Permutation test:  83%|████████▎ | 8313/10000 [01:48<00:21, 80.09 permutations/s]
Permutation test:  83%|████████▎ | 8322/10000 [01:48<00:24, 68.60 permutations/s]
Permutation test:  83%|████████▎ | 8331/10000 [01:48<00:22, 73.04 permutations/s]
Permutation test:  83%|████████▎ | 8339/10000 [01:48<00:24, 68.54 permutations/s]
Permutation test:  83%|████████▎ | 8347/10000 [01:48<00:24, 66.75 permutations/s]
Permutation test:  84%|████████▎ | 8356/10000 [01:48<00:22, 71.84 permutations/s]
Permutation test:  84%|████████▎ | 8364/10000 [01:48<00:23, 70.32 permutations/s]
Permutation test:  84%|████████▎ | 8372/10000 [01:49<00:22, 71.59 permutations/s]
Permutation test:  84%|████████▍ | 8380/10000 [01:49<00:22, 70.50 permutations/s]
Permutation test:  84%|████████▍ | 8388/10000 [01:49<00:23, 70.09 permutations/s]
Permutation test:  84%|████████▍ | 8396/10000 [01:49<00:24, 65.02 permutations/s]
Permutation test:  84%|████████▍ | 8405/10000 [01:49<00:22, 70.05 permutations/s]
Permutation test:  84%|████████▍ | 8414/10000 [01:49<00:22, 70.20 permutations/s]
Permutation test:  84%|████████▍ | 8423/10000 [01:49<00:21, 72.97 permutations/s]
Permutation test:  84%|████████▍ | 8431/10000 [01:49<00:21, 73.27 permutations/s]
Permutation test:  84%|████████▍ | 8442/10000 [01:49<00:19, 78.87 permutations/s]
Permutation test:  85%|████████▍ | 8451/10000 [01:50<00:19, 81.01 permutations/s]
Permutation test:  85%|████████▍ | 8460/10000 [01:50<00:18, 81.68 permutations/s]
Permutation test:  85%|████████▍ | 8469/10000 [01:50<00:22, 69.39 permutations/s]
Permutation test:  85%|████████▍ | 8477/10000 [01:50<00:21, 69.93 permutations/s]
Permutation test:  85%|████████▍ | 8485/10000 [01:50<00:22, 67.04 permutations/s]
Permutation test:  85%|████████▍ | 8492/10000 [01:50<00:23, 64.53 permutations/s]
Permutation test:  85%|████████▌ | 8500/10000 [01:50<00:22, 67.09 permutations/s]
Permutation test:  85%|████████▌ | 8507/10000 [01:50<00:22, 66.43 permutations/s]
Permutation test:  85%|████████▌ | 8519/10000 [01:51<00:18, 78.43 permutations/s]
Permutation test:  85%|████████▌ | 8527/10000 [01:51<00:21, 69.77 permutations/s]
Permutation test:  85%|████████▌ | 8535/10000 [01:51<00:21, 69.48 permutations/s]
Permutation test:  85%|████████▌ | 8543/10000 [01:51<00:22, 64.80 permutations/s]
Permutation test:  86%|████████▌ | 8553/10000 [01:51<00:20, 70.71 permutations/s]
Permutation test:  86%|████████▌ | 8562/10000 [01:51<00:19, 75.50 permutations/s]
Permutation test:  86%|████████▌ | 8570/10000 [01:51<00:19, 72.95 permutations/s]
Permutation test:  86%|████████▌ | 8578/10000 [01:51<00:20, 67.93 permutations/s]
Permutation test:  86%|████████▌ | 8587/10000 [01:52<00:19, 72.58 permutations/s]
Permutation test:  86%|████████▌ | 8596/10000 [01:52<00:18, 75.51 permutations/s]
Permutation test:  86%|████████▌ | 8604/10000 [01:52<00:19, 72.13 permutations/s]
Permutation test:  86%|████████▌ | 8612/10000 [01:52<00:18, 73.37 permutations/s]
Permutation test:  86%|████████▌ | 8623/10000 [01:52<00:16, 82.47 permutations/s]
Permutation test:  86%|████████▋ | 8634/10000 [01:52<00:15, 86.27 permutations/s]
Permutation test:  86%|████████▋ | 8643/10000 [01:52<00:18, 74.39 permutations/s]
Permutation test:  87%|████████▋ | 8651/10000 [01:52<00:18, 72.14 permutations/s]
Permutation test:  87%|████████▋ | 8659/10000 [01:52<00:19, 70.42 permutations/s]
Permutation test:  87%|████████▋ | 8668/10000 [01:53<00:17, 74.75 permutations/s]
Permutation test:  87%|████████▋ | 8677/10000 [01:53<00:18, 72.55 permutations/s]
Permutation test:  87%|████████▋ | 8685/10000 [01:53<00:18, 69.56 permutations/s]
Permutation test:  87%|████████▋ | 8693/10000 [01:53<00:21, 61.99 permutations/s]
Permutation test:  87%|████████▋ | 8703/10000 [01:53<00:18, 69.76 permutations/s]
Permutation test:  87%|████████▋ | 8711/10000 [01:53<00:19, 67.72 permutations/s]
Permutation test:  87%|████████▋ | 8718/10000 [01:53<00:19, 66.71 permutations/s]
Permutation test:  87%|████████▋ | 8725/10000 [01:53<00:19, 64.91 permutations/s]
Permutation test:  87%|████████▋ | 8732/10000 [01:54<00:19, 63.61 permutations/s]
Permutation test:  87%|████████▋ | 8739/10000 [01:54<00:20, 62.02 permutations/s]
Permutation test:  87%|████████▋ | 8747/10000 [01:54<00:19, 65.39 permutations/s]
Permutation test:  88%|████████▊ | 8755/10000 [01:54<00:18, 67.90 permutations/s]
Permutation test:  88%|████████▊ | 8763/10000 [01:54<00:17, 69.67 permutations/s]
Permutation test:  88%|████████▊ | 8771/10000 [01:54<00:17, 71.74 permutations/s]
Permutation test:  88%|████████▊ | 8779/10000 [01:54<00:16, 73.11 permutations/s]
Permutation test:  88%|████████▊ | 8787/10000 [01:54<00:18, 65.44 permutations/s]
Permutation test:  88%|████████▊ | 8795/10000 [01:55<00:17, 67.81 permutations/s]
Permutation test:  88%|████████▊ | 8802/10000 [01:55<00:18, 66.33 permutations/s]
Permutation test:  88%|████████▊ | 8810/10000 [01:55<00:17, 67.90 permutations/s]
Permutation test:  88%|████████▊ | 8817/10000 [01:55<00:18, 65.48 permutations/s]
Permutation test:  88%|████████▊ | 8824/10000 [01:55<00:18, 63.35 permutations/s]
Permutation test:  88%|████████▊ | 8831/10000 [01:55<00:18, 63.89 permutations/s]
Permutation test:  88%|████████▊ | 8839/10000 [01:55<00:17, 67.41 permutations/s]
Permutation test:  88%|████████▊ | 8846/10000 [01:55<00:17, 65.24 permutations/s]
Permutation test:  89%|████████▊ | 8853/10000 [01:55<00:18, 63.07 permutations/s]
Permutation test:  89%|████████▊ | 8861/10000 [01:56<00:17, 65.63 permutations/s]
Permutation test:  89%|████████▊ | 8869/10000 [01:56<00:16, 66.80 permutations/s]
Permutation test:  89%|████████▉ | 8876/10000 [01:56<00:17, 66.02 permutations/s]
Permutation test:  89%|████████▉ | 8884/10000 [01:56<00:17, 64.89 permutations/s]
Permutation test:  89%|████████▉ | 8891/10000 [01:56<00:16, 66.18 permutations/s]
Permutation test:  89%|████████▉ | 8898/10000 [01:56<00:18, 60.00 permutations/s]
Permutation test:  89%|████████▉ | 8905/10000 [01:56<00:17, 61.24 permutations/s]
Permutation test:  89%|████████▉ | 8912/10000 [01:56<00:18, 60.40 permutations/s]
Permutation test:  89%|████████▉ | 8920/10000 [01:56<00:17, 63.46 permutations/s]
Permutation test:  89%|████████▉ | 8931/10000 [01:57<00:14, 71.42 permutations/s]
Permutation test:  89%|████████▉ | 8939/10000 [01:57<00:15, 67.98 permutations/s]
Permutation test:  89%|████████▉ | 8946/10000 [01:57<00:16, 65.80 permutations/s]
Permutation test:  90%|████████▉ | 8953/10000 [01:57<00:17, 61.22 permutations/s]
Permutation test:  90%|████████▉ | 8960/10000 [01:57<00:16, 63.23 permutations/s]
Permutation test:  90%|████████▉ | 8971/10000 [01:57<00:13, 73.99 permutations/s]
Permutation test:  90%|████████▉ | 8979/10000 [01:57<00:14, 72.75 permutations/s]
Permutation test:  90%|████████▉ | 8987/10000 [01:57<00:14, 70.89 permutations/s]
Permutation test:  90%|████████▉ | 8995/10000 [01:58<00:14, 71.17 permutations/s]
Permutation test:  90%|█████████ | 9003/10000 [01:58<00:14, 70.37 permutations/s]
Permutation test:  90%|█████████ | 9014/10000 [01:58<00:12, 79.41 permutations/s]
Permutation test:  90%|█████████ | 9028/10000 [01:58<00:10, 96.01 permutations/s]
Permutation test:  90%|█████████ | 9038/10000 [01:58<00:11, 86.89 permutations/s]
Permutation test:  90%|█████████ | 9047/10000 [01:58<00:12, 75.32 permutations/s]
Permutation test:  91%|█████████ | 9055/10000 [01:58<00:13, 68.98 permutations/s]
Permutation test:  91%|█████████ | 9063/10000 [01:58<00:13, 70.89 permutations/s]
Permutation test:  91%|█████████ | 9074/10000 [01:59<00:11, 79.25 permutations/s]
Permutation test:  91%|█████████ | 9083/10000 [01:59<00:11, 81.25 permutations/s]
Permutation test:  91%|█████████ | 9092/10000 [01:59<00:12, 74.91 permutations/s]
Permutation test:  91%|█████████ | 9100/10000 [01:59<00:12, 73.01 permutations/s]
Permutation test:  91%|█████████ | 9108/10000 [01:59<00:13, 65.35 permutations/s]
Permutation test:  91%|█████████ | 9115/10000 [01:59<00:13, 64.12 permutations/s]
Permutation test:  91%|█████████ | 9123/10000 [01:59<00:13, 64.73 permutations/s]
Permutation test:  91%|█████████▏| 9132/10000 [01:59<00:12, 69.16 permutations/s]
Permutation test:  91%|█████████▏| 9141/10000 [01:59<00:11, 74.16 permutations/s]
Permutation test:  91%|█████████▏| 9149/10000 [02:00<00:12, 69.99 permutations/s]
Permutation test:  92%|█████████▏| 9159/10000 [02:00<00:10, 77.08 permutations/s]
Permutation test:  92%|█████████▏| 9167/10000 [02:00<00:11, 73.07 permutations/s]
Permutation test:  92%|█████████▏| 9175/10000 [02:00<00:11, 69.65 permutations/s]
Permutation test:  92%|█████████▏| 9183/10000 [02:00<00:12, 67.43 permutations/s]
Permutation test:  92%|█████████▏| 9190/10000 [02:00<00:12, 66.80 permutations/s]
Permutation test:  92%|█████████▏| 9197/10000 [02:00<00:13, 61.23 permutations/s]
Permutation test:  92%|█████████▏| 9205/10000 [02:00<00:12, 63.97 permutations/s]
Permutation test:  92%|█████████▏| 9215/10000 [02:01<00:11, 68.30 permutations/s]
Permutation test:  92%|█████████▏| 9223/10000 [02:01<00:11, 69.97 permutations/s]
Permutation test:  92%|█████████▏| 9231/10000 [02:01<00:10, 71.87 permutations/s]
Permutation test:  92%|█████████▏| 9239/10000 [02:01<00:11, 68.13 permutations/s]
Permutation test:  92%|█████████▏| 9248/10000 [02:01<00:10, 72.39 permutations/s]
Permutation test:  93%|█████████▎| 9256/10000 [02:01<00:10, 68.53 permutations/s]
Permutation test:  93%|█████████▎| 9263/10000 [02:01<00:10, 67.49 permutations/s]
Permutation test:  93%|█████████▎| 9270/10000 [02:01<00:11, 62.18 permutations/s]
Permutation test:  93%|█████████▎| 9278/10000 [02:02<00:11, 64.24 permutations/s]
Permutation test:  93%|█████████▎| 9285/10000 [02:02<00:11, 60.55 permutations/s]
Permutation test:  93%|█████████▎| 9292/10000 [02:02<00:11, 62.34 permutations/s]
Permutation test:  93%|█████████▎| 9299/10000 [02:02<00:11, 58.73 permutations/s]
Permutation test:  93%|█████████▎| 9310/10000 [02:02<00:10, 66.45 permutations/s]
Permutation test:  93%|█████████▎| 9320/10000 [02:02<00:09, 73.48 permutations/s]
Permutation test:  93%|█████████▎| 9328/10000 [02:02<00:09, 67.50 permutations/s]
Permutation test:  93%|█████████▎| 9335/10000 [02:02<00:10, 66.09 permutations/s]
Permutation test:  93%|█████████▎| 9342/10000 [02:02<00:09, 66.60 permutations/s]
Permutation test:  94%|█████████▎| 9353/10000 [02:03<00:08, 75.56 permutations/s]
Permutation test:  94%|█████████▎| 9361/10000 [02:03<00:09, 69.36 permutations/s]
Permutation test:  94%|█████████▎| 9369/10000 [02:03<00:10, 62.36 permutations/s]
Permutation test:  94%|█████████▍| 9379/10000 [02:03<00:08, 71.47 permutations/s]
Permutation test:  94%|█████████▍| 9387/10000 [02:03<00:08, 70.25 permutations/s]
Permutation test:  94%|█████████▍| 9398/10000 [02:03<00:07, 80.32 permutations/s]
Permutation test:  94%|█████████▍| 9407/10000 [02:03<00:07, 74.85 permutations/s]
Permutation test:  94%|█████████▍| 9415/10000 [02:03<00:08, 73.08 permutations/s]
Permutation test:  94%|█████████▍| 9423/10000 [02:04<00:08, 69.20 permutations/s]
Permutation test:  94%|█████████▍| 9432/10000 [02:04<00:07, 73.07 permutations/s]
Permutation test:  94%|█████████▍| 9440/10000 [02:04<00:08, 65.84 permutations/s]
Permutation test:  94%|█████████▍| 9450/10000 [02:04<00:07, 72.56 permutations/s]
Permutation test:  95%|█████████▍| 9458/10000 [02:04<00:07, 73.32 permutations/s]
Permutation test:  95%|█████████▍| 9466/10000 [02:04<00:08, 64.77 permutations/s]
Permutation test:  95%|█████████▍| 9473/10000 [02:04<00:08, 62.30 permutations/s]
Permutation test:  95%|█████████▍| 9480/10000 [02:05<00:09, 57.44 permutations/s]
Permutation test:  95%|█████████▍| 9489/10000 [02:05<00:07, 64.34 permutations/s]
Permutation test:  95%|█████████▍| 9498/10000 [02:05<00:07, 63.96 permutations/s]
Permutation test:  95%|█████████▌| 9505/10000 [02:05<00:07, 63.61 permutations/s]
Permutation test:  95%|█████████▌| 9512/10000 [02:05<00:08, 60.28 permutations/s]
Permutation test:  95%|█████████▌| 9522/10000 [02:05<00:06, 68.66 permutations/s]
Permutation test:  95%|█████████▌| 9533/10000 [02:05<00:05, 78.12 permutations/s]
Permutation test:  95%|█████████▌| 9544/10000 [02:05<00:05, 83.04 permutations/s]
Permutation test:  96%|█████████▌| 9553/10000 [02:05<00:05, 82.27 permutations/s]
Permutation test:  96%|█████████▌| 9562/10000 [02:06<00:05, 81.75 permutations/s]
Permutation test:  96%|█████████▌| 9571/10000 [02:06<00:05, 82.10 permutations/s]
Permutation test:  96%|█████████▌| 9580/10000 [02:06<00:05, 77.56 permutations/s]
Permutation test:  96%|█████████▌| 9594/10000 [02:06<00:04, 89.41 permutations/s]
Permutation test:  96%|█████████▌| 9603/10000 [02:06<00:04, 88.46 permutations/s]
Permutation test:  96%|█████████▌| 9612/10000 [02:06<00:04, 84.35 permutations/s]
Permutation test:  96%|█████████▌| 9622/10000 [02:06<00:04, 83.18 permutations/s]
Permutation test:  96%|█████████▋| 9637/10000 [02:06<00:03, 98.95 permutations/s]
Permutation test:  96%|█████████▋| 9648/10000 [02:07<00:03, 88.66 permutations/s]
Permutation test:  97%|█████████▋| 9658/10000 [02:07<00:04, 81.49 permutations/s]
Permutation test:  97%|█████████▋| 9670/10000 [02:07<00:03, 89.11 permutations/s]
Permutation test:  97%|█████████▋| 9680/10000 [02:07<00:03, 81.83 permutations/s]
Permutation test:  97%|█████████▋| 9689/10000 [02:07<00:03, 79.16 permutations/s]
Permutation test:  97%|█████████▋| 9698/10000 [02:07<00:03, 77.26 permutations/s]
Permutation test:  97%|█████████▋| 9709/10000 [02:07<00:03, 82.94 permutations/s]
Permutation test:  97%|█████████▋| 9720/10000 [02:07<00:03, 84.99 permutations/s]
Permutation test:  97%|█████████▋| 9729/10000 [02:08<00:03, 83.43 permutations/s]
Permutation test:  97%|█████████▋| 9739/10000 [02:08<00:03, 85.86 permutations/s]
Permutation test:  98%|█████████▊| 9753/10000 [02:08<00:02, 97.51 permutations/s]
Permutation test:  98%|█████████▊| 9764/10000 [02:08<00:02, 99.71 permutations/s]
Permutation test:  98%|█████████▊| 9775/10000 [02:08<00:02, 96.42 permutations/s]
Permutation test:  98%|█████████▊| 9785/10000 [02:08<00:02, 93.27 permutations/s]
Permutation test:  98%|█████████▊| 9796/10000 [02:08<00:02, 94.91 permutations/s]
Permutation test:  98%|█████████▊| 9808/10000 [02:08<00:01, 100.21 permutations/s]
Permutation test:  98%|█████████▊| 9820/10000 [02:08<00:01, 102.44 permutations/s]
Permutation test:  98%|█████████▊| 9831/10000 [02:09<00:01, 104.46 permutations/s]
Permutation test:  98%|█████████▊| 9842/10000 [02:09<00:01, 93.47 permutations/s]
Permutation test:  99%|█████████▊| 9852/10000 [02:09<00:01, 83.03 permutations/s]
Permutation test:  99%|█████████▊| 9861/10000 [02:09<00:01, 84.57 permutations/s]
Permutation test:  99%|█████████▊| 9870/10000 [02:09<00:01, 80.77 permutations/s]
Permutation test:  99%|█████████▉| 9879/10000 [02:09<00:01, 77.03 permutations/s]
Permutation test:  99%|█████████▉| 9887/10000 [02:09<00:01, 71.81 permutations/s]
Permutation test:  99%|█████████▉| 9895/10000 [02:09<00:01, 69.04 permutations/s]
Permutation test:  99%|█████████▉| 9906/10000 [02:10<00:01, 79.34 permutations/s]
Permutation test:  99%|█████████▉| 9915/10000 [02:10<00:01, 75.58 permutations/s]
Permutation test:  99%|█████████▉| 9923/10000 [02:10<00:01, 76.20 permutations/s]
Permutation test:  99%|█████████▉| 9934/10000 [02:10<00:00, 80.10 permutations/s]
Permutation test:  99%|█████████▉| 9946/10000 [02:10<00:00, 84.46 permutations/s]
Permutation test: 100%|█████████▉| 9957/10000 [02:10<00:00, 88.24 permutations/s]
Permutation test: 100%|█████████▉| 9968/10000 [02:10<00:00, 91.17 permutations/s]
Permutation test: 100%|█████████▉| 9978/10000 [02:10<00:00, 90.52 permutations/s]
Permutation test: 100%|█████████▉| 9990/10000 [02:10<00:00, 97.86 permutations/s]
Permutation test: 100%|██████████| 10000/10000 [02:11<00:00, 93.88 permutations/s]
Permutation test: 100%|██████████| 10000/10000 [02:11<00:00, 76.28 permutations/s]

A quick plot suggests an early effect related to n_chars around 130 ms, and a later effect of cloze around 400 ms:

p = plot.TopoButterfly(lm, t=0.130, axh=2, w=6)
sensor lm

Detailed plots of the two effects show that the cluster is quite variable due to noise in the data.

p = plot.TopoArray(lm.masked_parameter_map('n_chars'), t=[0.110, 0.130, 0.150], title='N Chars')
p = plot.TopoArray(lm.masked_parameter_map('cloze'), t=[0.380, 0.400, 0.420], title='Cloze')
  • N Chars
  • Cloze

To access some of the test results we need to know the index of different effects:

('intercept', 'n_chars', 'cloze')

Create a plot that shows the spatial cluster extent across time.

EFFECTS = [
    ('n_chars', (0.110, 0.150)),
    ('cloze', (0.380, 0.420)),
]

t_maps = []
for effect, time in EFFECTS:
    # t-maps are retrieved by effect name
    t = lm.t(effect).mean(time=time)
    # p-maps are stored in a list, so we need to know the index of te effect
    index = lm.effects.index(effect)
    # We are interested in the maximal spatial cluster extent, i.e., any sensor that is part of the cluster at any time
    p = lm.p[index].min(time=time)
    # Create a masked average t map
    t_av = t.mask(p > 0.05)
    t_maps.append(t_av)

p = plot.Topomap(t_maps, columns=2)
n_chars, cloze

Total running time of the script: (2 minutes 15.393 seconds)

Gallery generated by Sphinx-Gallery