Multiple regression

Multiple regression designs apply to at least two scenarios.

  • Analyzing a single subject’s data when trials are associated with one or multiple continuous variables.

  • Analyzing group data when subjects are associated with one or multiple individual difference variables.

Here the analysis is illustrated for a simulated dataset from a single subject. Group analysis works analogously, except that each case in the datatset would represent a different subject rather than a different trial.

For such group analysis, it is necessary to reduce each subject’s data to a single case first because multiple regression assumes a fixed effects model. Such designs are described under Two-stage test.

Simulated data

# sphinx_gallery_thumbnail_number = 2
from eelbrain import *


data = datasets.simulate_erp(snr=0.5)
data.head()
# cloze predictability n_chars
0 0.026139 low 4
1 0.99529 high 5
2 0.93062 high 3
3 0.82404 high 7
4 0.17041 low 4
5 0.18508 low 4
6 0.23345 low 4
7 0.80784 high 3
8 0.24979 low 7
9 0.26753 low 4
NDVars: eeg


The data represents 80 trials from a simulated word reading paradigm, where each word is associated with a word length (n_chars) and predictability (cloze).

p = plot.Scatter('cloze', 'n_chars', data=data, h=3)
sensor lm

Plot the average of each level on n_chars to illustrate the linear increase of the response around 130 ms with n_char.

p = plot.TopoButterfly('eeg', 'n_chars', data=data, t=.130, axh=2, w=6)
sensor lm

Multiple regression

Fit a multiple regression model. Estimate $p$-values using a cluster-based permuatation test, using a cluster-forming threshold of uncorrected $p$=.05 and 10,000 permutations (the default).

lm = testnd.LM('eeg', 'n_chars + cloze', data=data, tstart=0.050, tstop=0.500, pmin=0.05)
Permutation test:   0%|          | 0/10000 [00:00<?, ? permutations/s]
Permutation test:   0%|          | 9/10000 [00:00<01:53, 87.70 permutations/s]
Permutation test:   0%|          | 18/10000 [00:00<01:56, 85.77 permutations/s]
Permutation test:   0%|          | 27/10000 [00:00<02:27, 67.39 permutations/s]
Permutation test:   0%|          | 35/10000 [00:00<02:39, 62.44 permutations/s]
Permutation test:   0%|          | 42/10000 [00:00<02:45, 60.22 permutations/s]
Permutation test:   0%|          | 49/10000 [00:00<02:45, 60.13 permutations/s]
Permutation test:   1%|          | 56/10000 [00:00<02:47, 59.34 permutations/s]
Permutation test:   1%|          | 62/10000 [00:01<02:56, 56.44 permutations/s]
Permutation test:   1%|          | 69/10000 [00:01<02:46, 59.48 permutations/s]
Permutation test:   1%|          | 76/10000 [00:01<02:51, 57.92 permutations/s]
Permutation test:   1%|          | 83/10000 [00:01<02:52, 57.44 permutations/s]
Permutation test:   1%|          | 90/10000 [00:01<02:55, 56.44 permutations/s]
Permutation test:   1%|          | 98/10000 [00:01<02:49, 58.43 permutations/s]
Permutation test:   1%|          | 105/10000 [00:01<02:52, 57.28 permutations/s]
Permutation test:   1%|          | 111/10000 [00:01<02:51, 57.58 permutations/s]
Permutation test:   1%|          | 117/10000 [00:01<02:53, 56.82 permutations/s]
Permutation test:   1%|          | 123/10000 [00:02<02:53, 57.07 permutations/s]
Permutation test:   1%|▏         | 130/10000 [00:02<02:54, 56.66 permutations/s]
Permutation test:   1%|▏         | 137/10000 [00:02<02:50, 57.98 permutations/s]
Permutation test:   1%|▏         | 143/10000 [00:02<02:52, 57.25 permutations/s]
Permutation test:   1%|▏         | 149/10000 [00:02<02:55, 56.21 permutations/s]
Permutation test:   2%|▏         | 156/10000 [00:02<02:51, 57.42 permutations/s]
Permutation test:   2%|▏         | 163/10000 [00:02<02:48, 58.41 permutations/s]
Permutation test:   2%|▏         | 169/10000 [00:02<02:52, 56.83 permutations/s]
Permutation test:   2%|▏         | 176/10000 [00:02<02:55, 56.01 permutations/s]
Permutation test:   2%|▏         | 182/10000 [00:03<02:52, 57.01 permutations/s]
Permutation test:   2%|▏         | 188/10000 [00:03<02:54, 56.30 permutations/s]
Permutation test:   2%|▏         | 194/10000 [00:03<02:53, 56.68 permutations/s]
Permutation test:   2%|▏         | 200/10000 [00:03<02:53, 56.33 permutations/s]
Permutation test:   2%|▏         | 207/10000 [00:03<02:53, 56.40 permutations/s]
Permutation test:   2%|▏         | 213/10000 [00:03<02:52, 56.75 permutations/s]
Permutation test:   2%|▏         | 219/10000 [00:03<03:00, 54.11 permutations/s]
Permutation test:   2%|▏         | 226/10000 [00:03<02:47, 58.35 permutations/s]
Permutation test:   2%|▏         | 233/10000 [00:03<02:42, 60.28 permutations/s]
Permutation test:   2%|▏         | 240/10000 [00:04<02:50, 57.11 permutations/s]
Permutation test:   2%|▏         | 246/10000 [00:04<02:59, 54.21 permutations/s]
Permutation test:   3%|▎         | 252/10000 [00:04<02:58, 54.72 permutations/s]
Permutation test:   3%|▎         | 258/10000 [00:04<02:58, 54.63 permutations/s]
Permutation test:   3%|▎         | 264/10000 [00:04<03:01, 53.63 permutations/s]
Permutation test:   3%|▎         | 270/10000 [00:04<02:59, 54.22 permutations/s]
Permutation test:   3%|▎         | 276/10000 [00:04<02:55, 55.53 permutations/s]
Permutation test:   3%|▎         | 282/10000 [00:04<02:52, 56.44 permutations/s]
Permutation test:   3%|▎         | 288/10000 [00:05<02:58, 54.29 permutations/s]
Permutation test:   3%|▎         | 295/10000 [00:05<02:58, 54.48 permutations/s]
Permutation test:   3%|▎         | 302/10000 [00:05<02:57, 54.53 permutations/s]
Permutation test:   3%|▎         | 309/10000 [00:05<02:56, 55.06 permutations/s]
Permutation test:   3%|▎         | 316/10000 [00:05<02:52, 56.05 permutations/s]
Permutation test:   3%|▎         | 323/10000 [00:05<02:55, 55.10 permutations/s]
Permutation test:   3%|▎         | 329/10000 [00:05<02:56, 54.72 permutations/s]
Permutation test:   3%|▎         | 336/10000 [00:05<02:53, 55.81 permutations/s]
Permutation test:   3%|▎         | 342/10000 [00:05<02:55, 55.17 permutations/s]
Permutation test:   3%|▎         | 349/10000 [00:06<02:54, 55.40 permutations/s]
Permutation test:   4%|▎         | 356/10000 [00:06<02:54, 55.32 permutations/s]
Permutation test:   4%|▎         | 362/10000 [00:06<02:52, 55.98 permutations/s]
Permutation test:   4%|▎         | 369/10000 [00:06<02:48, 57.26 permutations/s]
Permutation test:   4%|▍         | 375/10000 [00:06<02:49, 56.74 permutations/s]
Permutation test:   4%|▍         | 382/10000 [00:06<02:46, 57.87 permutations/s]
Permutation test:   4%|▍         | 390/10000 [00:06<02:38, 60.62 permutations/s]
Permutation test:   4%|▍         | 397/10000 [00:06<02:46, 57.57 permutations/s]
Permutation test:   4%|▍         | 403/10000 [00:07<02:44, 58.19 permutations/s]
Permutation test:   4%|▍         | 409/10000 [00:07<02:46, 57.46 permutations/s]
Permutation test:   4%|▍         | 415/10000 [00:07<02:50, 56.28 permutations/s]
Permutation test:   4%|▍         | 421/10000 [00:07<02:52, 55.48 permutations/s]
Permutation test:   4%|▍         | 427/10000 [00:07<02:50, 56.10 permutations/s]
Permutation test:   4%|▍         | 433/10000 [00:07<02:58, 53.56 permutations/s]
Permutation test:   4%|▍         | 439/10000 [00:07<03:00, 53.04 permutations/s]
Permutation test:   4%|▍         | 446/10000 [00:07<03:00, 53.07 permutations/s]
Permutation test:   5%|▍         | 452/10000 [00:07<02:59, 53.18 permutations/s]
Permutation test:   5%|▍         | 458/10000 [00:08<03:01, 52.69 permutations/s]
Permutation test:   5%|▍         | 464/10000 [00:08<03:01, 52.42 permutations/s]
Permutation test:   5%|▍         | 471/10000 [00:08<02:59, 53.14 permutations/s]
Permutation test:   5%|▍         | 478/10000 [00:08<02:57, 53.62 permutations/s]
Permutation test:   5%|▍         | 485/10000 [00:08<02:49, 56.17 permutations/s]
Permutation test:   5%|▍         | 492/10000 [00:08<02:41, 58.89 permutations/s]
Permutation test:   5%|▍         | 498/10000 [00:08<02:42, 58.47 permutations/s]
Permutation test:   5%|▌         | 504/10000 [00:08<02:45, 57.40 permutations/s]
Permutation test:   5%|▌         | 510/10000 [00:08<02:46, 56.85 permutations/s]
Permutation test:   5%|▌         | 516/10000 [00:09<02:46, 57.09 permutations/s]
Permutation test:   5%|▌         | 522/10000 [00:09<02:49, 56.01 permutations/s]
Permutation test:   5%|▌         | 528/10000 [00:09<02:49, 55.84 permutations/s]
Permutation test:   5%|▌         | 534/10000 [00:09<02:47, 56.43 permutations/s]
Permutation test:   5%|▌         | 540/10000 [00:09<02:44, 57.35 permutations/s]
Permutation test:   5%|▌         | 547/10000 [00:09<02:47, 56.47 permutations/s]
Permutation test:   6%|▌         | 553/10000 [00:09<02:49, 55.66 permutations/s]
Permutation test:   6%|▌         | 560/10000 [00:09<02:48, 55.87 permutations/s]
Permutation test:   6%|▌         | 567/10000 [00:09<02:38, 59.41 permutations/s]
Permutation test:   6%|▌         | 573/10000 [00:10<02:44, 57.33 permutations/s]
Permutation test:   6%|▌         | 579/10000 [00:10<02:46, 56.55 permutations/s]
Permutation test:   6%|▌         | 585/10000 [00:10<02:46, 56.51 permutations/s]
Permutation test:   6%|▌         | 591/10000 [00:10<02:49, 55.60 permutations/s]
Permutation test:   6%|▌         | 597/10000 [00:10<02:47, 56.23 permutations/s]
Permutation test:   6%|▌         | 603/10000 [00:10<02:47, 55.97 permutations/s]
Permutation test:   6%|▌         | 609/10000 [00:10<02:44, 57.05 permutations/s]
Permutation test:   6%|▌         | 615/10000 [00:10<02:47, 56.04 permutations/s]
Permutation test:   6%|▌         | 621/10000 [00:10<02:53, 54.13 permutations/s]
Permutation test:   6%|▋         | 627/10000 [00:11<02:58, 52.64 permutations/s]
Permutation test:   6%|▋         | 635/10000 [00:11<02:46, 56.25 permutations/s]
Permutation test:   6%|▋         | 642/10000 [00:11<02:44, 56.93 permutations/s]
Permutation test:   6%|▋         | 648/10000 [00:11<02:43, 57.14 permutations/s]
Permutation test:   7%|▋         | 654/10000 [00:11<02:45, 56.40 permutations/s]
Permutation test:   7%|▋         | 660/10000 [00:11<02:48, 55.38 permutations/s]
Permutation test:   7%|▋         | 666/10000 [00:11<02:52, 54.06 permutations/s]
Permutation test:   7%|▋         | 672/10000 [00:11<02:49, 55.18 permutations/s]
Permutation test:   7%|▋         | 678/10000 [00:11<02:51, 54.33 permutations/s]
Permutation test:   7%|▋         | 685/10000 [00:12<02:50, 54.52 permutations/s]
Permutation test:   7%|▋         | 691/10000 [00:12<03:00, 51.51 permutations/s]
Permutation test:   7%|▋         | 698/10000 [00:12<02:57, 52.50 permutations/s]
Permutation test:   7%|▋         | 705/10000 [00:12<02:51, 54.22 permutations/s]
Permutation test:   7%|▋         | 712/10000 [00:12<02:49, 54.95 permutations/s]
Permutation test:   7%|▋         | 719/10000 [00:12<02:44, 56.50 permutations/s]
Permutation test:   7%|▋         | 725/10000 [00:12<02:43, 56.64 permutations/s]
Permutation test:   7%|▋         | 732/10000 [00:12<02:38, 58.49 permutations/s]
Permutation test:   7%|▋         | 738/10000 [00:13<02:38, 58.56 permutations/s]
Permutation test:   7%|▋         | 744/10000 [00:13<02:39, 58.07 permutations/s]
Permutation test:   8%|▊         | 750/10000 [00:13<02:38, 58.45 permutations/s]
Permutation test:   8%|▊         | 756/10000 [00:13<02:42, 57.06 permutations/s]
Permutation test:   8%|▊         | 762/10000 [00:13<02:43, 56.47 permutations/s]
Permutation test:   8%|▊         | 768/10000 [00:13<02:44, 56.04 permutations/s]
Permutation test:   8%|▊         | 774/10000 [00:13<02:49, 54.33 permutations/s]
Permutation test:   8%|▊         | 780/10000 [00:13<02:50, 53.99 permutations/s]
Permutation test:   8%|▊         | 786/10000 [00:13<02:48, 54.63 permutations/s]
Permutation test:   8%|▊         | 792/10000 [00:14<02:44, 55.83 permutations/s]
Permutation test:   8%|▊         | 798/10000 [00:14<02:44, 55.82 permutations/s]
Permutation test:   8%|▊         | 804/10000 [00:14<02:46, 55.29 permutations/s]
Permutation test:   8%|▊         | 811/10000 [00:14<02:46, 55.11 permutations/s]
Permutation test:   8%|▊         | 818/10000 [00:14<02:47, 54.83 permutations/s]
Permutation test:   8%|▊         | 824/10000 [00:14<02:44, 55.76 permutations/s]
Permutation test:   8%|▊         | 831/10000 [00:14<02:45, 55.43 permutations/s]
Permutation test:   8%|▊         | 837/10000 [00:14<02:45, 55.43 permutations/s]
Permutation test:   8%|▊         | 843/10000 [00:14<02:42, 56.33 permutations/s]
Permutation test:   8%|▊         | 849/10000 [00:15<02:51, 53.50 permutations/s]
Permutation test:   9%|▊         | 856/10000 [00:15<02:47, 54.48 permutations/s]
Permutation test:   9%|▊         | 862/10000 [00:15<02:45, 55.37 permutations/s]
Permutation test:   9%|▊         | 869/10000 [00:15<02:47, 54.57 permutations/s]
Permutation test:   9%|▉         | 875/10000 [00:15<02:48, 54.06 permutations/s]
Permutation test:   9%|▉         | 881/10000 [00:15<02:45, 55.00 permutations/s]
Permutation test:   9%|▉         | 887/10000 [00:15<02:49, 53.74 permutations/s]
Permutation test:   9%|▉         | 893/10000 [00:15<02:49, 53.66 permutations/s]
Permutation test:   9%|▉         | 900/10000 [00:15<02:38, 57.53 permutations/s]
Permutation test:   9%|▉         | 906/10000 [00:16<02:38, 57.55 permutations/s]
Permutation test:   9%|▉         | 912/10000 [00:16<02:37, 57.60 permutations/s]
Permutation test:   9%|▉         | 919/10000 [00:16<02:38, 57.20 permutations/s]
Permutation test:   9%|▉         | 925/10000 [00:16<02:36, 57.94 permutations/s]
Permutation test:   9%|▉         | 931/10000 [00:16<02:35, 58.23 permutations/s]
Permutation test:   9%|▉         | 937/10000 [00:16<02:39, 56.82 permutations/s]
Permutation test:   9%|▉         | 943/10000 [00:16<02:47, 53.97 permutations/s]
Permutation test:   9%|▉         | 949/10000 [00:16<02:48, 53.66 permutations/s]
Permutation test:  10%|▉         | 955/10000 [00:16<02:43, 55.21 permutations/s]
Permutation test:  10%|▉         | 961/10000 [00:17<02:48, 53.51 permutations/s]
Permutation test:  10%|▉         | 968/10000 [00:17<02:48, 53.73 permutations/s]
Permutation test:  10%|▉         | 975/10000 [00:17<02:40, 56.07 permutations/s]
Permutation test:  10%|▉         | 981/10000 [00:17<02:41, 55.95 permutations/s]
Permutation test:  10%|▉         | 988/10000 [00:17<02:39, 56.63 permutations/s]
Permutation test:  10%|▉         | 995/10000 [00:17<02:31, 59.63 permutations/s]
Permutation test:  10%|█         | 1001/10000 [00:17<02:39, 56.48 permutations/s]
Permutation test:  10%|█         | 1007/10000 [00:17<02:37, 56.94 permutations/s]
Permutation test:  10%|█         | 1014/10000 [00:17<02:30, 59.86 permutations/s]
Permutation test:  10%|█         | 1021/10000 [00:18<02:32, 58.76 permutations/s]
Permutation test:  10%|█         | 1027/10000 [00:18<02:35, 57.74 permutations/s]
Permutation test:  10%|█         | 1033/10000 [00:18<02:40, 55.87 permutations/s]
Permutation test:  10%|█         | 1040/10000 [00:18<02:40, 55.88 permutations/s]
Permutation test:  10%|█         | 1047/10000 [00:18<02:42, 55.21 permutations/s]
Permutation test:  11%|█         | 1053/10000 [00:18<02:43, 54.81 permutations/s]
Permutation test:  11%|█         | 1059/10000 [00:18<02:42, 54.98 permutations/s]
Permutation test:  11%|█         | 1066/10000 [00:18<02:42, 54.89 permutations/s]
Permutation test:  11%|█         | 1072/10000 [00:19<02:40, 55.68 permutations/s]
Permutation test:  11%|█         | 1080/10000 [00:19<02:27, 60.33 permutations/s]
Permutation test:  11%|█         | 1087/10000 [00:19<02:32, 58.50 permutations/s]
Permutation test:  11%|█         | 1093/10000 [00:19<02:39, 55.89 permutations/s]
Permutation test:  11%|█         | 1099/10000 [00:19<02:37, 56.39 permutations/s]
Permutation test:  11%|█         | 1106/10000 [00:19<02:38, 56.24 permutations/s]
Permutation test:  11%|█         | 1112/10000 [00:19<02:39, 55.87 permutations/s]
Permutation test:  11%|█         | 1118/10000 [00:19<02:37, 56.56 permutations/s]
Permutation test:  11%|█         | 1124/10000 [00:19<02:37, 56.48 permutations/s]
Permutation test:  11%|█▏        | 1130/10000 [00:20<02:43, 54.36 permutations/s]
Permutation test:  11%|█▏        | 1136/10000 [00:20<02:43, 54.10 permutations/s]
Permutation test:  11%|█▏        | 1143/10000 [00:20<02:39, 55.47 permutations/s]
Permutation test:  12%|█▏        | 1150/10000 [00:20<02:38, 55.78 permutations/s]
Permutation test:  12%|█▏        | 1156/10000 [00:20<02:39, 55.45 permutations/s]
Permutation test:  12%|█▏        | 1162/10000 [00:20<02:48, 52.36 permutations/s]
Permutation test:  12%|█▏        | 1169/10000 [00:20<02:39, 55.29 permutations/s]
Permutation test:  12%|█▏        | 1176/10000 [00:20<02:38, 55.68 permutations/s]
Permutation test:  12%|█▏        | 1182/10000 [00:21<02:38, 55.64 permutations/s]
Permutation test:  12%|█▏        | 1189/10000 [00:21<02:39, 55.34 permutations/s]
Permutation test:  12%|█▏        | 1196/10000 [00:21<02:38, 55.70 permutations/s]
Permutation test:  12%|█▏        | 1202/10000 [00:21<02:36, 56.23 permutations/s]
Permutation test:  12%|█▏        | 1208/10000 [00:21<02:42, 54.24 permutations/s]
Permutation test:  12%|█▏        | 1215/10000 [00:21<02:36, 56.09 permutations/s]
Permutation test:  12%|█▏        | 1222/10000 [00:21<02:32, 57.39 permutations/s]
Permutation test:  12%|█▏        | 1228/10000 [00:21<02:34, 56.67 permutations/s]
Permutation test:  12%|█▏        | 1235/10000 [00:21<02:30, 58.32 permutations/s]
Permutation test:  12%|█▏        | 1247/10000 [00:22<02:02, 71.59 permutations/s]
Permutation test:  13%|█▎        | 1260/10000 [00:22<01:41, 85.96 permutations/s]
Permutation test:  13%|█▎        | 1270/10000 [00:22<01:40, 86.90 permutations/s]
Permutation test:  13%|█▎        | 1285/10000 [00:22<01:23, 103.76 permutations/s]
Permutation test:  13%|█▎        | 1298/10000 [00:22<01:19, 108.95 permutations/s]
Permutation test:  13%|█▎        | 1313/10000 [00:22<01:13, 118.95 permutations/s]
Permutation test:  13%|█▎        | 1326/10000 [00:22<01:17, 112.10 permutations/s]
Permutation test:  13%|█▎        | 1338/10000 [00:22<01:24, 103.01 permutations/s]
Permutation test:  13%|█▎        | 1349/10000 [00:22<01:28, 97.69 permutations/s]
Permutation test:  14%|█▎        | 1361/10000 [00:23<01:23, 103.31 permutations/s]
Permutation test:  14%|█▎        | 1373/10000 [00:23<01:23, 103.49 permutations/s]
Permutation test:  14%|█▍        | 1389/10000 [00:23<01:13, 117.26 permutations/s]
Permutation test:  14%|█▍        | 1401/10000 [00:23<01:14, 115.69 permutations/s]
Permutation test:  14%|█▍        | 1413/10000 [00:23<01:16, 112.85 permutations/s]
Permutation test:  14%|█▍        | 1426/10000 [00:23<01:14, 114.74 permutations/s]
Permutation test:  14%|█▍        | 1440/10000 [00:23<01:11, 119.51 permutations/s]
Permutation test:  15%|█▍        | 1453/10000 [00:23<01:15, 113.52 permutations/s]
Permutation test:  15%|█▍        | 1467/10000 [00:23<01:12, 118.31 permutations/s]
Permutation test:  15%|█▍        | 1479/10000 [00:24<01:13, 116.27 permutations/s]
Permutation test:  15%|█▍        | 1491/10000 [00:24<01:13, 115.79 permutations/s]
Permutation test:  15%|█▌        | 1504/10000 [00:24<01:11, 118.46 permutations/s]
Permutation test:  15%|█▌        | 1516/10000 [00:24<01:13, 114.89 permutations/s]
Permutation test:  15%|█▌        | 1530/10000 [00:24<01:10, 119.33 permutations/s]
Permutation test:  15%|█▌        | 1545/10000 [00:24<01:07, 125.15 permutations/s]
Permutation test:  16%|█▌        | 1558/10000 [00:24<01:17, 109.34 permutations/s]
Permutation test:  16%|█▌        | 1570/10000 [00:24<01:18, 107.82 permutations/s]
Permutation test:  16%|█▌        | 1582/10000 [00:25<01:21, 103.64 permutations/s]
Permutation test:  16%|█▌        | 1594/10000 [00:25<01:18, 107.72 permutations/s]
Permutation test:  16%|█▌        | 1605/10000 [00:25<01:20, 103.77 permutations/s]
Permutation test:  16%|█▌        | 1616/10000 [00:25<01:21, 102.94 permutations/s]
Permutation test:  16%|█▋        | 1632/10000 [00:25<01:11, 117.14 permutations/s]
Permutation test:  16%|█▋        | 1647/10000 [00:25<01:07, 123.65 permutations/s]
Permutation test:  17%|█▋        | 1662/10000 [00:25<01:07, 122.98 permutations/s]
Permutation test:  17%|█▋        | 1676/10000 [00:25<01:05, 127.42 permutations/s]
Permutation test:  17%|█▋        | 1689/10000 [00:25<01:07, 122.63 permutations/s]
Permutation test:  17%|█▋        | 1702/10000 [00:26<01:11, 115.73 permutations/s]
Permutation test:  17%|█▋        | 1716/10000 [00:26<01:09, 118.57 permutations/s]
Permutation test:  17%|█▋        | 1729/10000 [00:26<01:08, 121.51 permutations/s]
Permutation test:  17%|█▋        | 1742/10000 [00:26<01:11, 114.89 permutations/s]
Permutation test:  18%|█▊        | 1754/10000 [00:26<01:23, 99.10 permutations/s]
Permutation test:  18%|█▊        | 1765/10000 [00:26<01:21, 101.04 permutations/s]
Permutation test:  18%|█▊        | 1778/10000 [00:26<01:15, 108.19 permutations/s]
Permutation test:  18%|█▊        | 1790/10000 [00:26<01:19, 103.52 permutations/s]
Permutation test:  18%|█▊        | 1804/10000 [00:26<01:12, 112.66 permutations/s]
Permutation test:  18%|█▊        | 1817/10000 [00:27<01:10, 116.68 permutations/s]
Permutation test:  18%|█▊        | 1829/10000 [00:27<01:16, 106.98 permutations/s]
Permutation test:  18%|█▊        | 1841/10000 [00:27<01:16, 107.22 permutations/s]
Permutation test:  19%|█▊        | 1852/10000 [00:27<01:15, 107.80 permutations/s]
Permutation test:  19%|█▊        | 1865/10000 [00:27<01:12, 112.71 permutations/s]
Permutation test:  19%|█▉        | 1877/10000 [00:27<01:16, 105.65 permutations/s]
Permutation test:  19%|█▉        | 1889/10000 [00:27<01:14, 109.13 permutations/s]
Permutation test:  19%|█▉        | 1901/10000 [00:27<01:16, 105.34 permutations/s]
Permutation test:  19%|█▉        | 1912/10000 [00:27<01:18, 102.79 permutations/s]
Permutation test:  19%|█▉        | 1924/10000 [00:28<01:15, 106.50 permutations/s]
Permutation test:  19%|█▉        | 1935/10000 [00:28<01:16, 105.37 permutations/s]
Permutation test:  19%|█▉        | 1949/10000 [00:28<01:10, 113.63 permutations/s]
Permutation test:  20%|█▉        | 1961/10000 [00:28<01:15, 107.18 permutations/s]
Permutation test:  20%|█▉        | 1972/10000 [00:28<01:14, 107.88 permutations/s]
Permutation test:  20%|█▉        | 1984/10000 [00:28<01:12, 109.87 permutations/s]
Permutation test:  20%|█▉        | 1996/10000 [00:28<01:10, 112.74 permutations/s]
Permutation test:  20%|██        | 2008/10000 [00:28<01:14, 107.41 permutations/s]
Permutation test:  20%|██        | 2020/10000 [00:28<01:12, 109.91 permutations/s]
Permutation test:  20%|██        | 2032/10000 [00:29<01:17, 102.38 permutations/s]
Permutation test:  20%|██        | 2045/10000 [00:29<01:13, 108.91 permutations/s]
Permutation test:  21%|██        | 2059/10000 [00:29<01:08, 116.48 permutations/s]
Permutation test:  21%|██        | 2072/10000 [00:29<01:06, 119.35 permutations/s]
Permutation test:  21%|██        | 2085/10000 [00:29<01:04, 122.37 permutations/s]
Permutation test:  21%|██        | 2098/10000 [00:29<01:09, 113.24 permutations/s]
Permutation test:  21%|██        | 2111/10000 [00:29<01:07, 117.40 permutations/s]
Permutation test:  21%|██        | 2124/10000 [00:29<01:05, 120.86 permutations/s]
Permutation test:  21%|██▏       | 2137/10000 [00:29<01:06, 117.52 permutations/s]
Permutation test:  21%|██▏       | 2149/10000 [00:30<01:08, 115.22 permutations/s]
Permutation test:  22%|██▏       | 2162/10000 [00:30<01:06, 117.77 permutations/s]
Permutation test:  22%|██▏       | 2175/10000 [00:30<01:05, 119.89 permutations/s]
Permutation test:  22%|██▏       | 2188/10000 [00:30<01:07, 116.15 permutations/s]
Permutation test:  22%|██▏       | 2200/10000 [00:30<01:08, 114.61 permutations/s]
Permutation test:  22%|██▏       | 2212/10000 [00:30<01:09, 112.37 permutations/s]
Permutation test:  22%|██▏       | 2227/10000 [00:30<01:04, 120.21 permutations/s]
Permutation test:  22%|██▏       | 2240/10000 [00:30<01:03, 121.59 permutations/s]
Permutation test:  23%|██▎       | 2253/10000 [00:30<01:04, 119.91 permutations/s]
Permutation test:  23%|██▎       | 2266/10000 [00:31<01:05, 118.91 permutations/s]
Permutation test:  23%|██▎       | 2279/10000 [00:31<01:04, 120.48 permutations/s]
Permutation test:  23%|██▎       | 2292/10000 [00:31<01:05, 117.95 permutations/s]
Permutation test:  23%|██▎       | 2305/10000 [00:31<01:06, 115.65 permutations/s]
Permutation test:  23%|██▎       | 2320/10000 [00:31<01:01, 124.13 permutations/s]
Permutation test:  23%|██▎       | 2333/10000 [00:31<01:03, 121.65 permutations/s]
Permutation test:  23%|██▎       | 2346/10000 [00:31<01:03, 119.98 permutations/s]
Permutation test:  24%|██▎       | 2359/10000 [00:31<01:09, 109.62 permutations/s]
Permutation test:  24%|██▎       | 2371/10000 [00:31<01:08, 110.93 permutations/s]
Permutation test:  24%|██▍       | 2385/10000 [00:32<01:08, 111.69 permutations/s]
Permutation test:  24%|██▍       | 2397/10000 [00:32<01:07, 112.53 permutations/s]
Permutation test:  24%|██▍       | 2409/10000 [00:32<01:07, 112.14 permutations/s]
Permutation test:  24%|██▍       | 2421/10000 [00:32<01:06, 113.36 permutations/s]
Permutation test:  24%|██▍       | 2434/10000 [00:32<01:04, 117.16 permutations/s]
Permutation test:  24%|██▍       | 2447/10000 [00:32<01:03, 118.69 permutations/s]
Permutation test:  25%|██▍       | 2459/10000 [00:32<01:05, 115.11 permutations/s]
Permutation test:  25%|██▍       | 2471/10000 [00:32<01:09, 107.95 permutations/s]
Permutation test:  25%|██▍       | 2484/10000 [00:32<01:09, 108.24 permutations/s]
Permutation test:  25%|██▍       | 2495/10000 [00:33<01:10, 106.37 permutations/s]
Permutation test:  25%|██▌       | 2508/10000 [00:33<01:06, 112.72 permutations/s]
Permutation test:  25%|██▌       | 2520/10000 [00:33<01:05, 114.15 permutations/s]
Permutation test:  25%|██▌       | 2533/10000 [00:33<01:06, 111.79 permutations/s]
Permutation test:  25%|██▌       | 2545/10000 [00:33<01:07, 110.08 permutations/s]
Permutation test:  26%|██▌       | 2557/10000 [00:33<01:08, 108.14 permutations/s]
Permutation test:  26%|██▌       | 2568/10000 [00:33<01:09, 106.36 permutations/s]
Permutation test:  26%|██▌       | 2579/10000 [00:33<01:11, 103.90 permutations/s]
Permutation test:  26%|██▌       | 2590/10000 [00:33<01:10, 104.45 permutations/s]
Permutation test:  26%|██▌       | 2602/10000 [00:34<01:08, 107.61 permutations/s]
Permutation test:  26%|██▌       | 2613/10000 [00:34<01:09, 105.88 permutations/s]
Permutation test:  26%|██▋       | 2625/10000 [00:34<01:07, 109.89 permutations/s]
Permutation test:  26%|██▋       | 2637/10000 [00:34<01:12, 102.19 permutations/s]
Permutation test:  26%|██▋       | 2648/10000 [00:34<01:12, 101.21 permutations/s]
Permutation test:  27%|██▋       | 2659/10000 [00:34<01:10, 103.41 permutations/s]
Permutation test:  27%|██▋       | 2670/10000 [00:34<01:14, 98.81 permutations/s]
Permutation test:  27%|██▋       | 2684/10000 [00:34<01:07, 108.66 permutations/s]
Permutation test:  27%|██▋       | 2697/10000 [00:34<01:05, 112.10 permutations/s]
Permutation test:  27%|██▋       | 2709/10000 [00:35<01:04, 113.06 permutations/s]
Permutation test:  27%|██▋       | 2722/10000 [00:35<01:02, 116.53 permutations/s]
Permutation test:  27%|██▋       | 2734/10000 [00:35<01:02, 116.19 permutations/s]
Permutation test:  27%|██▋       | 2748/10000 [00:35<01:00, 120.25 permutations/s]
Permutation test:  28%|██▊       | 2761/10000 [00:35<01:02, 116.42 permutations/s]
Permutation test:  28%|██▊       | 2773/10000 [00:35<01:04, 111.35 permutations/s]
Permutation test:  28%|██▊       | 2785/10000 [00:35<01:07, 106.57 permutations/s]
Permutation test:  28%|██▊       | 2798/10000 [00:35<01:04, 111.62 permutations/s]
Permutation test:  28%|██▊       | 2811/10000 [00:35<01:04, 112.19 permutations/s]
Permutation test:  28%|██▊       | 2823/10000 [00:36<01:05, 108.78 permutations/s]
Permutation test:  28%|██▊       | 2834/10000 [00:36<01:09, 102.43 permutations/s]
Permutation test:  28%|██▊       | 2845/10000 [00:36<01:19, 90.40 permutations/s]
Permutation test:  29%|██▊       | 2855/10000 [00:36<01:17, 91.84 permutations/s]
Permutation test:  29%|██▊       | 2865/10000 [00:36<01:25, 83.56 permutations/s]
Permutation test:  29%|██▉       | 2875/10000 [00:36<01:22, 85.94 permutations/s]
Permutation test:  29%|██▉       | 2886/10000 [00:36<01:17, 91.25 permutations/s]
Permutation test:  29%|██▉       | 2896/10000 [00:36<01:21, 87.04 permutations/s]
Permutation test:  29%|██▉       | 2909/10000 [00:37<01:15, 93.47 permutations/s]
Permutation test:  29%|██▉       | 2919/10000 [00:37<01:16, 92.98 permutations/s]
Permutation test:  29%|██▉       | 2929/10000 [00:37<01:20, 87.64 permutations/s]
Permutation test:  29%|██▉       | 2938/10000 [00:37<01:21, 87.10 permutations/s]
Permutation test:  29%|██▉       | 2947/10000 [00:37<01:22, 85.75 permutations/s]
Permutation test:  30%|██▉       | 2956/10000 [00:37<01:25, 82.51 permutations/s]
Permutation test:  30%|██▉       | 2965/10000 [00:37<01:23, 83.96 permutations/s]
Permutation test:  30%|██▉       | 2977/10000 [00:37<01:15, 92.42 permutations/s]
Permutation test:  30%|██▉       | 2988/10000 [00:37<01:14, 93.61 permutations/s]
Permutation test:  30%|██▉       | 2998/10000 [00:38<01:16, 91.87 permutations/s]
Permutation test:  30%|███       | 3008/10000 [00:38<01:15, 92.08 permutations/s]
Permutation test:  30%|███       | 3018/10000 [00:38<01:27, 79.60 permutations/s]
Permutation test:  30%|███       | 3027/10000 [00:38<01:27, 79.76 permutations/s]
Permutation test:  30%|███       | 3036/10000 [00:38<01:26, 80.84 permutations/s]
Permutation test:  30%|███       | 3045/10000 [00:38<01:28, 78.86 permutations/s]
Permutation test:  31%|███       | 3054/10000 [00:38<01:27, 79.82 permutations/s]
Permutation test:  31%|███       | 3067/10000 [00:38<01:17, 89.06 permutations/s]
Permutation test:  31%|███       | 3077/10000 [00:39<01:15, 91.99 permutations/s]
Permutation test:  31%|███       | 3087/10000 [00:39<01:15, 92.01 permutations/s]
Permutation test:  31%|███       | 3097/10000 [00:39<01:17, 89.37 permutations/s]
Permutation test:  31%|███       | 3106/10000 [00:39<01:18, 87.50 permutations/s]
Permutation test:  31%|███       | 3117/10000 [00:39<01:14, 92.90 permutations/s]
Permutation test:  31%|███▏      | 3127/10000 [00:39<01:17, 88.96 permutations/s]
Permutation test:  31%|███▏      | 3138/10000 [00:39<01:12, 94.17 permutations/s]
Permutation test:  31%|███▏      | 3148/10000 [00:39<01:13, 93.82 permutations/s]
Permutation test:  32%|███▏      | 3158/10000 [00:39<01:13, 93.51 permutations/s]
Permutation test:  32%|███▏      | 3173/10000 [00:40<01:02, 109.26 permutations/s]
Permutation test:  32%|███▏      | 3185/10000 [00:40<01:11, 95.15 permutations/s]
Permutation test:  32%|███▏      | 3195/10000 [00:40<01:16, 89.20 permutations/s]
Permutation test:  32%|███▏      | 3205/10000 [00:40<01:13, 91.94 permutations/s]
Permutation test:  32%|███▏      | 3215/10000 [00:40<01:17, 87.56 permutations/s]
Permutation test:  32%|███▏      | 3227/10000 [00:40<01:10, 95.81 permutations/s]
Permutation test:  32%|███▏      | 3239/10000 [00:40<01:06, 102.36 permutations/s]
Permutation test:  33%|███▎      | 3251/10000 [00:40<01:04, 104.98 permutations/s]
Permutation test:  33%|███▎      | 3262/10000 [00:40<01:06, 101.56 permutations/s]
Permutation test:  33%|███▎      | 3273/10000 [00:41<01:16, 88.11 permutations/s]
Permutation test:  33%|███▎      | 3283/10000 [00:41<01:19, 84.90 permutations/s]
Permutation test:  33%|███▎      | 3295/10000 [00:41<01:11, 93.19 permutations/s]
Permutation test:  33%|███▎      | 3307/10000 [00:41<01:08, 97.62 permutations/s]
Permutation test:  33%|███▎      | 3318/10000 [00:41<01:06, 100.74 permutations/s]
Permutation test:  33%|███▎      | 3329/10000 [00:41<01:10, 94.85 permutations/s]
Permutation test:  33%|███▎      | 3341/10000 [00:41<01:09, 95.70 permutations/s]
Permutation test:  34%|███▎      | 3354/10000 [00:41<01:04, 103.43 permutations/s]
Permutation test:  34%|███▎      | 3365/10000 [00:42<01:06, 99.91 permutations/s]
Permutation test:  34%|███▍      | 3376/10000 [00:42<01:14, 88.88 permutations/s]
Permutation test:  34%|███▍      | 3386/10000 [00:42<01:15, 87.72 permutations/s]
Permutation test:  34%|███▍      | 3396/10000 [00:42<01:17, 85.55 permutations/s]
Permutation test:  34%|███▍      | 3407/10000 [00:42<01:12, 91.55 permutations/s]
Permutation test:  34%|███▍      | 3417/10000 [00:42<01:11, 92.13 permutations/s]
Permutation test:  34%|███▍      | 3427/10000 [00:42<01:14, 88.29 permutations/s]
Permutation test:  34%|███▍      | 3441/10000 [00:42<01:04, 101.02 permutations/s]
Permutation test:  35%|███▍      | 3452/10000 [00:43<01:13, 89.04 permutations/s]
Permutation test:  35%|███▍      | 3462/10000 [00:43<01:16, 85.90 permutations/s]
Permutation test:  35%|███▍      | 3472/10000 [00:43<01:15, 86.65 permutations/s]
Permutation test:  35%|███▍      | 3481/10000 [00:43<01:16, 85.71 permutations/s]
Permutation test:  35%|███▍      | 3490/10000 [00:43<01:18, 82.97 permutations/s]
Permutation test:  35%|███▍      | 3499/10000 [00:43<01:18, 82.97 permutations/s]
Permutation test:  35%|███▌      | 3509/10000 [00:43<01:15, 85.84 permutations/s]
Permutation test:  35%|███▌      | 3518/10000 [00:43<01:18, 82.69 permutations/s]
Permutation test:  35%|███▌      | 3532/10000 [00:43<01:06, 97.06 permutations/s]
Permutation test:  35%|███▌      | 3542/10000 [00:44<01:06, 96.65 permutations/s]
Permutation test:  36%|███▌      | 3552/10000 [00:44<01:12, 89.00 permutations/s]
Permutation test:  36%|███▌      | 3563/10000 [00:44<01:10, 91.85 permutations/s]
Permutation test:  36%|███▌      | 3573/10000 [00:44<01:13, 87.15 permutations/s]
Permutation test:  36%|███▌      | 3585/10000 [00:44<01:07, 95.05 permutations/s]
Permutation test:  36%|███▌      | 3595/10000 [00:44<01:11, 90.11 permutations/s]
Permutation test:  36%|███▌      | 3605/10000 [00:44<01:11, 90.07 permutations/s]
Permutation test:  36%|███▌      | 3615/10000 [00:44<01:11, 89.85 permutations/s]
Permutation test:  36%|███▋      | 3625/10000 [00:44<01:10, 89.86 permutations/s]
Permutation test:  36%|███▋      | 3635/10000 [00:45<01:12, 87.37 permutations/s]
Permutation test:  36%|███▋      | 3644/10000 [00:45<01:23, 75.68 permutations/s]
Permutation test:  37%|███▋      | 3652/10000 [00:45<01:23, 76.17 permutations/s]
Permutation test:  37%|███▋      | 3663/10000 [00:45<01:18, 81.06 permutations/s]
Permutation test:  37%|███▋      | 3676/10000 [00:45<01:08, 92.97 permutations/s]
Permutation test:  37%|███▋      | 3686/10000 [00:45<01:06, 94.82 permutations/s]
Permutation test:  37%|███▋      | 3698/10000 [00:45<01:04, 97.22 permutations/s]
Permutation test:  37%|███▋      | 3709/10000 [00:45<01:03, 98.74 permutations/s]
Permutation test:  37%|███▋      | 3721/10000 [00:46<01:00, 103.57 permutations/s]
Permutation test:  37%|███▋      | 3733/10000 [00:46<00:58, 106.90 permutations/s]
Permutation test:  37%|███▋      | 3744/10000 [00:46<01:09, 90.31 permutations/s]
Permutation test:  38%|███▊      | 3754/10000 [00:46<01:10, 87.98 permutations/s]
Permutation test:  38%|███▊      | 3764/10000 [00:46<01:13, 84.54 permutations/s]
Permutation test:  38%|███▊      | 3773/10000 [00:46<01:16, 81.65 permutations/s]
Permutation test:  38%|███▊      | 3782/10000 [00:46<01:19, 78.37 permutations/s]
Permutation test:  38%|███▊      | 3794/10000 [00:46<01:10, 87.64 permutations/s]
Permutation test:  38%|███▊      | 3803/10000 [00:47<01:15, 82.19 permutations/s]
Permutation test:  38%|███▊      | 3812/10000 [00:47<01:19, 78.08 permutations/s]
Permutation test:  38%|███▊      | 3820/10000 [00:47<01:19, 77.43 permutations/s]
Permutation test:  38%|███▊      | 3828/10000 [00:47<01:20, 76.20 permutations/s]
Permutation test:  38%|███▊      | 3838/10000 [00:47<01:15, 81.43 permutations/s]
Permutation test:  38%|███▊      | 3847/10000 [00:47<01:16, 80.20 permutations/s]
Permutation test:  39%|███▊      | 3859/10000 [00:47<01:09, 88.23 permutations/s]
Permutation test:  39%|███▊      | 3869/10000 [00:47<01:09, 88.69 permutations/s]
Permutation test:  39%|███▉      | 3880/10000 [00:47<01:06, 91.42 permutations/s]
Permutation test:  39%|███▉      | 3895/10000 [00:48<00:59, 101.96 permutations/s]
Permutation test:  39%|███▉      | 3906/10000 [00:48<01:01, 98.46 permutations/s]
Permutation test:  39%|███▉      | 3916/10000 [00:48<01:05, 93.09 permutations/s]
Permutation test:  39%|███▉      | 3928/10000 [00:48<01:04, 93.45 permutations/s]
Permutation test:  39%|███▉      | 3938/10000 [00:48<01:07, 89.59 permutations/s]
Permutation test:  39%|███▉      | 3948/10000 [00:48<01:07, 89.40 permutations/s]
Permutation test:  40%|███▉      | 3959/10000 [00:48<01:05, 92.59 permutations/s]
Permutation test:  40%|███▉      | 3975/10000 [00:48<00:55, 108.72 permutations/s]
Permutation test:  40%|███▉      | 3986/10000 [00:49<00:58, 103.11 permutations/s]
Permutation test:  40%|███▉      | 3997/10000 [00:49<01:01, 97.09 permutations/s]
Permutation test:  40%|████      | 4008/10000 [00:49<01:00, 98.33 permutations/s]
Permutation test:  40%|████      | 4019/10000 [00:49<00:59, 99.96 permutations/s]
Permutation test:  40%|████      | 4030/10000 [00:49<01:05, 91.12 permutations/s]
Permutation test:  40%|████      | 4040/10000 [00:49<01:09, 86.35 permutations/s]
Permutation test:  40%|████      | 4050/10000 [00:49<01:08, 86.28 permutations/s]
Permutation test:  41%|████      | 4059/10000 [00:49<01:08, 86.83 permutations/s]
Permutation test:  41%|████      | 4071/10000 [00:49<01:04, 92.24 permutations/s]
Permutation test:  41%|████      | 4083/10000 [00:50<01:04, 91.79 permutations/s]
Permutation test:  41%|████      | 4093/10000 [00:50<01:04, 91.06 permutations/s]
Permutation test:  41%|████      | 4103/10000 [00:50<01:09, 85.46 permutations/s]
Permutation test:  41%|████      | 4114/10000 [00:50<01:04, 91.18 permutations/s]
Permutation test:  41%|████      | 4124/10000 [00:50<01:06, 89.02 permutations/s]
Permutation test:  41%|████▏     | 4136/10000 [00:50<01:02, 93.47 permutations/s]
Permutation test:  41%|████▏     | 4149/10000 [00:50<00:57, 101.11 permutations/s]
Permutation test:  42%|████▏     | 4160/10000 [00:50<00:58, 100.07 permutations/s]
Permutation test:  42%|████▏     | 4171/10000 [00:51<01:01, 94.39 permutations/s]
Permutation test:  42%|████▏     | 4181/10000 [00:51<01:04, 89.60 permutations/s]
Permutation test:  42%|████▏     | 4194/10000 [00:51<00:59, 97.81 permutations/s]
Permutation test:  42%|████▏     | 4206/10000 [00:51<00:56, 102.37 permutations/s]
Permutation test:  42%|████▏     | 4217/10000 [00:51<00:59, 97.34 permutations/s]
Permutation test:  42%|████▏     | 4227/10000 [00:51<00:59, 96.82 permutations/s]
Permutation test:  42%|████▏     | 4237/10000 [00:51<01:07, 85.64 permutations/s]
Permutation test:  42%|████▏     | 4246/10000 [00:51<01:12, 79.67 permutations/s]
Permutation test:  43%|████▎     | 4256/10000 [00:51<01:09, 82.99 permutations/s]
Permutation test:  43%|████▎     | 4265/10000 [00:52<01:14, 77.27 permutations/s]
Permutation test:  43%|████▎     | 4273/10000 [00:52<01:14, 77.17 permutations/s]
Permutation test:  43%|████▎     | 4281/10000 [00:52<01:13, 77.30 permutations/s]
Permutation test:  43%|████▎     | 4289/10000 [00:52<01:13, 77.30 permutations/s]
Permutation test:  43%|████▎     | 4299/10000 [00:52<01:09, 82.53 permutations/s]
Permutation test:  43%|████▎     | 4310/10000 [00:52<01:03, 89.32 permutations/s]
Permutation test:  43%|████▎     | 4320/10000 [00:52<01:06, 85.63 permutations/s]
Permutation test:  43%|████▎     | 4329/10000 [00:52<01:06, 85.68 permutations/s]
Permutation test:  43%|████▎     | 4338/10000 [00:53<01:09, 81.55 permutations/s]
Permutation test:  43%|████▎     | 4347/10000 [00:53<01:07, 83.84 permutations/s]
Permutation test:  44%|████▎     | 4356/10000 [00:53<01:08, 82.79 permutations/s]
Permutation test:  44%|████▎     | 4366/10000 [00:53<01:05, 86.64 permutations/s]
Permutation test:  44%|████▍     | 4375/10000 [00:53<01:06, 84.38 permutations/s]
Permutation test:  44%|████▍     | 4384/10000 [00:53<01:06, 84.40 permutations/s]
Permutation test:  44%|████▍     | 4395/10000 [00:53<01:01, 90.59 permutations/s]
Permutation test:  44%|████▍     | 4405/10000 [00:53<01:02, 89.93 permutations/s]
Permutation test:  44%|████▍     | 4415/10000 [00:53<01:05, 85.44 permutations/s]
Permutation test:  44%|████▍     | 4427/10000 [00:53<00:59, 94.11 permutations/s]
Permutation test:  44%|████▍     | 4437/10000 [00:54<01:05, 85.09 permutations/s]
Permutation test:  44%|████▍     | 4446/10000 [00:54<01:07, 82.81 permutations/s]
Permutation test:  45%|████▍     | 4455/10000 [00:54<01:10, 78.99 permutations/s]
Permutation test:  45%|████▍     | 4464/10000 [00:54<01:08, 80.87 permutations/s]
Permutation test:  45%|████▍     | 4479/10000 [00:54<00:56, 97.72 permutations/s]
Permutation test:  45%|████▍     | 4490/10000 [00:54<00:55, 100.03 permutations/s]
Permutation test:  45%|████▌     | 4501/10000 [00:54<00:55, 98.25 permutations/s]
Permutation test:  45%|████▌     | 4512/10000 [00:54<00:58, 94.11 permutations/s]
Permutation test:  45%|████▌     | 4522/10000 [00:55<01:00, 89.91 permutations/s]
Permutation test:  45%|████▌     | 4532/10000 [00:55<01:02, 87.93 permutations/s]
Permutation test:  45%|████▌     | 4541/10000 [00:55<01:04, 84.05 permutations/s]
Permutation test:  46%|████▌     | 4550/10000 [00:55<01:04, 84.38 permutations/s]
Permutation test:  46%|████▌     | 4560/10000 [00:55<01:02, 86.67 permutations/s]
Permutation test:  46%|████▌     | 4569/10000 [00:55<01:03, 86.07 permutations/s]
Permutation test:  46%|████▌     | 4578/10000 [00:55<01:03, 85.09 permutations/s]
Permutation test:  46%|████▌     | 4587/10000 [00:55<01:05, 82.92 permutations/s]
Permutation test:  46%|████▌     | 4601/10000 [00:55<00:54, 98.23 permutations/s]
Permutation test:  46%|████▌     | 4613/10000 [00:56<00:53, 101.38 permutations/s]
Permutation test:  46%|████▌     | 4624/10000 [00:56<00:58, 91.74 permutations/s]
Permutation test:  46%|████▋     | 4634/10000 [00:56<00:57, 93.29 permutations/s]
Permutation test:  46%|████▋     | 4647/10000 [00:56<00:56, 94.45 permutations/s]
Permutation test:  47%|████▋     | 4657/10000 [00:56<00:57, 93.33 permutations/s]
Permutation test:  47%|████▋     | 4667/10000 [00:56<01:01, 87.36 permutations/s]
Permutation test:  47%|████▋     | 4676/10000 [00:56<01:02, 85.50 permutations/s]
Permutation test:  47%|████▋     | 4685/10000 [00:56<01:01, 86.52 permutations/s]
Permutation test:  47%|████▋     | 4694/10000 [00:57<01:02, 84.56 permutations/s]
Permutation test:  47%|████▋     | 4703/10000 [00:57<01:03, 83.32 permutations/s]
Permutation test:  47%|████▋     | 4712/10000 [00:57<01:08, 77.30 permutations/s]
Permutation test:  47%|████▋     | 4722/10000 [00:57<01:07, 78.64 permutations/s]
Permutation test:  47%|████▋     | 4730/10000 [00:57<01:08, 77.03 permutations/s]
Permutation test:  47%|████▋     | 4739/10000 [00:57<01:06, 79.15 permutations/s]
Permutation test:  47%|████▋     | 4748/10000 [00:57<01:08, 77.14 permutations/s]
Permutation test:  48%|████▊     | 4757/10000 [00:57<01:09, 75.02 permutations/s]
Permutation test:  48%|████▊     | 4768/10000 [00:57<01:02, 83.06 permutations/s]
Permutation test:  48%|████▊     | 4777/10000 [00:58<01:04, 81.56 permutations/s]
Permutation test:  48%|████▊     | 4786/10000 [00:58<01:09, 74.61 permutations/s]
Permutation test:  48%|████▊     | 4794/10000 [00:58<01:12, 71.82 permutations/s]
Permutation test:  48%|████▊     | 4804/10000 [00:58<01:05, 78.79 permutations/s]
Permutation test:  48%|████▊     | 4813/10000 [00:58<01:07, 77.17 permutations/s]
Permutation test:  48%|████▊     | 4825/10000 [00:58<00:59, 87.48 permutations/s]
Permutation test:  48%|████▊     | 4834/10000 [00:58<00:59, 86.21 permutations/s]
Permutation test:  48%|████▊     | 4848/10000 [00:58<00:52, 98.46 permutations/s]
Permutation test:  49%|████▊     | 4859/10000 [00:58<00:50, 101.24 permutations/s]
Permutation test:  49%|████▊     | 4871/10000 [00:59<00:48, 105.09 permutations/s]
Permutation test:  49%|████▉     | 4882/10000 [00:59<01:01, 83.78 permutations/s]
Permutation test:  49%|████▉     | 4892/10000 [00:59<00:58, 86.72 permutations/s]
Permutation test:  49%|████▉     | 4902/10000 [00:59<00:57, 89.32 permutations/s]
Permutation test:  49%|████▉     | 4919/10000 [00:59<00:49, 101.97 permutations/s]
Permutation test:  49%|████▉     | 4930/10000 [00:59<00:51, 97.70 permutations/s]
Permutation test:  49%|████▉     | 4942/10000 [00:59<00:49, 102.91 permutations/s]
Permutation test:  50%|████▉     | 4953/10000 [00:59<00:49, 101.28 permutations/s]
Permutation test:  50%|████▉     | 4965/10000 [01:00<00:47, 106.03 permutations/s]
Permutation test:  50%|████▉     | 4976/10000 [01:00<00:53, 93.11 permutations/s]
Permutation test:  50%|████▉     | 4986/10000 [01:00<00:59, 84.90 permutations/s]
Permutation test:  50%|████▉     | 4995/10000 [01:00<00:58, 85.65 permutations/s]
Permutation test:  50%|█████     | 5005/10000 [01:00<00:56, 89.01 permutations/s]
Permutation test:  50%|█████     | 5015/10000 [01:00<00:54, 91.26 permutations/s]
Permutation test:  50%|█████     | 5025/10000 [01:00<00:55, 90.41 permutations/s]
Permutation test:  50%|█████     | 5035/10000 [01:00<00:57, 85.73 permutations/s]
Permutation test:  50%|█████     | 5044/10000 [01:01<00:57, 86.62 permutations/s]
Permutation test:  51%|█████     | 5053/10000 [01:01<01:03, 78.45 permutations/s]
Permutation test:  51%|█████     | 5063/10000 [01:01<00:59, 83.39 permutations/s]
Permutation test:  51%|█████     | 5074/10000 [01:01<00:55, 88.27 permutations/s]
Permutation test:  51%|█████     | 5083/10000 [01:01<00:59, 82.45 permutations/s]
Permutation test:  51%|█████     | 5094/10000 [01:01<00:58, 84.53 permutations/s]
Permutation test:  51%|█████     | 5104/10000 [01:01<00:57, 85.02 permutations/s]
Permutation test:  51%|█████     | 5113/10000 [01:01<00:56, 86.14 permutations/s]
Permutation test:  51%|█████▏    | 5125/10000 [01:01<00:51, 94.70 permutations/s]
Permutation test:  51%|█████▏    | 5137/10000 [01:02<00:48, 101.20 permutations/s]
Permutation test:  51%|█████▏    | 5148/10000 [01:02<00:50, 96.05 permutations/s]
Permutation test:  52%|█████▏    | 5158/10000 [01:02<00:52, 93.07 permutations/s]
Permutation test:  52%|█████▏    | 5168/10000 [01:02<00:58, 83.07 permutations/s]
Permutation test:  52%|█████▏    | 5178/10000 [01:02<00:55, 86.91 permutations/s]
Permutation test:  52%|█████▏    | 5187/10000 [01:02<00:59, 80.99 permutations/s]
Permutation test:  52%|█████▏    | 5196/10000 [01:02<00:59, 81.42 permutations/s]
Permutation test:  52%|█████▏    | 5205/10000 [01:02<01:02, 76.50 permutations/s]
Permutation test:  52%|█████▏    | 5214/10000 [01:03<01:02, 76.04 permutations/s]
Permutation test:  52%|█████▏    | 5224/10000 [01:03<00:58, 81.92 permutations/s]
Permutation test:  52%|█████▏    | 5236/10000 [01:03<00:55, 86.58 permutations/s]
Permutation test:  52%|█████▏    | 5245/10000 [01:03<00:56, 83.55 permutations/s]
Permutation test:  53%|█████▎    | 5254/10000 [01:03<01:01, 77.07 permutations/s]
Permutation test:  53%|█████▎    | 5264/10000 [01:03<00:57, 81.85 permutations/s]
Permutation test:  53%|█████▎    | 5273/10000 [01:03<00:58, 80.75 permutations/s]
Permutation test:  53%|█████▎    | 5282/10000 [01:03<00:56, 82.82 permutations/s]
Permutation test:  53%|█████▎    | 5292/10000 [01:03<00:54, 85.86 permutations/s]
Permutation test:  53%|█████▎    | 5306/10000 [01:04<00:47, 99.84 permutations/s]
Permutation test:  53%|█████▎    | 5317/10000 [01:04<00:50, 93.43 permutations/s]
Permutation test:  53%|█████▎    | 5328/10000 [01:04<00:48, 96.38 permutations/s]
Permutation test:  53%|█████▎    | 5338/10000 [01:04<00:53, 87.27 permutations/s]
Permutation test:  53%|█████▎    | 5347/10000 [01:04<00:54, 85.80 permutations/s]
Permutation test:  54%|█████▎    | 5356/10000 [01:04<00:53, 86.00 permutations/s]
Permutation test:  54%|█████▎    | 5367/10000 [01:04<00:51, 90.58 permutations/s]
Permutation test:  54%|█████▍    | 5377/10000 [01:04<00:54, 84.47 permutations/s]
Permutation test:  54%|█████▍    | 5386/10000 [01:05<00:55, 83.01 permutations/s]
Permutation test:  54%|█████▍    | 5395/10000 [01:05<00:55, 82.51 permutations/s]
Permutation test:  54%|█████▍    | 5404/10000 [01:05<00:55, 83.44 permutations/s]
Permutation test:  54%|█████▍    | 5413/10000 [01:05<00:56, 80.65 permutations/s]
Permutation test:  54%|█████▍    | 5423/10000 [01:05<00:55, 82.18 permutations/s]
Permutation test:  54%|█████▍    | 5432/10000 [01:05<00:54, 84.03 permutations/s]
Permutation test:  54%|█████▍    | 5444/10000 [01:05<00:51, 87.97 permutations/s]
Permutation test:  55%|█████▍    | 5453/10000 [01:05<00:53, 84.31 permutations/s]
Permutation test:  55%|█████▍    | 5464/10000 [01:05<00:49, 91.16 permutations/s]
Permutation test:  55%|█████▍    | 5476/10000 [01:06<00:46, 96.53 permutations/s]
Permutation test:  55%|█████▍    | 5489/10000 [01:06<00:45, 99.79 permutations/s]
Permutation test:  55%|█████▌    | 5501/10000 [01:06<00:43, 102.26 permutations/s]
Permutation test:  55%|█████▌    | 5514/10000 [01:06<00:40, 109.54 permutations/s]
Permutation test:  55%|█████▌    | 5526/10000 [01:06<00:39, 112.15 permutations/s]
Permutation test:  55%|█████▌    | 5541/10000 [01:06<00:37, 118.53 permutations/s]
Permutation test:  56%|█████▌    | 5553/10000 [01:06<00:41, 107.80 permutations/s]
Permutation test:  56%|█████▌    | 5565/10000 [01:06<00:40, 110.86 permutations/s]
Permutation test:  56%|█████▌    | 5577/10000 [01:06<00:40, 110.14 permutations/s]
Permutation test:  56%|█████▌    | 5589/10000 [01:07<00:44, 99.35 permutations/s]
Permutation test:  56%|█████▌    | 5600/10000 [01:07<00:48, 90.49 permutations/s]
Permutation test:  56%|█████▌    | 5610/10000 [01:07<00:49, 89.07 permutations/s]
Permutation test:  56%|█████▋    | 5626/10000 [01:07<00:41, 105.73 permutations/s]
Permutation test:  56%|█████▋    | 5637/10000 [01:07<00:42, 103.58 permutations/s]
Permutation test:  56%|█████▋    | 5649/10000 [01:07<00:41, 105.84 permutations/s]
Permutation test:  57%|█████▋    | 5660/10000 [01:07<00:41, 104.56 permutations/s]
Permutation test:  57%|█████▋    | 5674/10000 [01:07<00:38, 112.54 permutations/s]
Permutation test:  57%|█████▋    | 5686/10000 [01:07<00:38, 112.00 permutations/s]
Permutation test:  57%|█████▋    | 5698/10000 [01:08<00:40, 106.17 permutations/s]
Permutation test:  57%|█████▋    | 5709/10000 [01:08<00:41, 103.08 permutations/s]
Permutation test:  57%|█████▋    | 5721/10000 [01:08<00:40, 106.73 permutations/s]
Permutation test:  57%|█████▋    | 5733/10000 [01:08<00:39, 108.98 permutations/s]
Permutation test:  57%|█████▋    | 5745/10000 [01:08<00:37, 112.01 permutations/s]
Permutation test:  58%|█████▊    | 5757/10000 [01:08<00:39, 107.08 permutations/s]
Permutation test:  58%|█████▊    | 5769/10000 [01:08<00:38, 109.12 permutations/s]
Permutation test:  58%|█████▊    | 5780/10000 [01:08<00:42, 98.91 permutations/s]
Permutation test:  58%|█████▊    | 5793/10000 [01:09<00:39, 105.63 permutations/s]
Permutation test:  58%|█████▊    | 5807/10000 [01:09<00:38, 108.10 permutations/s]
Permutation test:  58%|█████▊    | 5821/10000 [01:09<00:36, 115.23 permutations/s]
Permutation test:  58%|█████▊    | 5833/10000 [01:09<00:36, 113.01 permutations/s]
Permutation test:  58%|█████▊    | 5845/10000 [01:09<00:38, 106.68 permutations/s]
Permutation test:  59%|█████▊    | 5857/10000 [01:09<00:38, 108.92 permutations/s]
Permutation test:  59%|█████▊    | 5869/10000 [01:09<00:37, 110.93 permutations/s]
Permutation test:  59%|█████▉    | 5881/10000 [01:09<00:36, 113.29 permutations/s]
Permutation test:  59%|█████▉    | 5895/10000 [01:09<00:34, 118.26 permutations/s]
Permutation test:  59%|█████▉    | 5907/10000 [01:10<00:37, 110.32 permutations/s]
Permutation test:  59%|█████▉    | 5919/10000 [01:10<00:38, 106.73 permutations/s]
Permutation test:  59%|█████▉    | 5930/10000 [01:10<00:38, 106.48 permutations/s]
Permutation test:  59%|█████▉    | 5941/10000 [01:10<00:39, 104.01 permutations/s]
Permutation test:  60%|█████▉    | 5953/10000 [01:10<00:37, 107.63 permutations/s]
Permutation test:  60%|█████▉    | 5965/10000 [01:10<00:36, 109.63 permutations/s]
Permutation test:  60%|█████▉    | 5980/10000 [01:10<00:33, 120.92 permutations/s]
Permutation test:  60%|█████▉    | 5993/10000 [01:10<00:34, 115.54 permutations/s]
Permutation test:  60%|██████    | 6007/10000 [01:10<00:33, 120.97 permutations/s]
Permutation test:  60%|██████    | 6020/10000 [01:11<00:33, 119.49 permutations/s]
Permutation test:  60%|██████    | 6036/10000 [01:11<00:30, 129.41 permutations/s]
Permutation test:  60%|██████    | 6050/10000 [01:11<00:31, 125.30 permutations/s]
Permutation test:  61%|██████    | 6064/10000 [01:11<00:30, 128.20 permutations/s]
Permutation test:  61%|██████    | 6077/10000 [01:11<00:32, 120.49 permutations/s]
Permutation test:  61%|██████    | 6090/10000 [01:11<00:33, 115.35 permutations/s]
Permutation test:  61%|██████    | 6102/10000 [01:11<00:34, 112.02 permutations/s]
Permutation test:  61%|██████    | 6116/10000 [01:11<00:32, 118.04 permutations/s]
Permutation test:  61%|██████▏   | 6128/10000 [01:11<00:32, 117.44 permutations/s]
Permutation test:  61%|██████▏   | 6140/10000 [01:12<00:35, 109.43 permutations/s]
Permutation test:  62%|██████▏   | 6154/10000 [01:12<00:33, 115.21 permutations/s]
Permutation test:  62%|██████▏   | 6166/10000 [01:12<00:33, 112.79 permutations/s]
Permutation test:  62%|██████▏   | 6178/10000 [01:12<00:33, 113.55 permutations/s]
Permutation test:  62%|██████▏   | 6191/10000 [01:12<00:32, 116.83 permutations/s]
Permutation test:  62%|██████▏   | 6205/10000 [01:12<00:30, 123.34 permutations/s]
Permutation test:  62%|██████▏   | 6218/10000 [01:12<00:31, 119.81 permutations/s]
Permutation test:  62%|██████▏   | 6231/10000 [01:12<00:32, 117.38 permutations/s]
Permutation test:  62%|██████▏   | 6246/10000 [01:12<00:29, 126.46 permutations/s]
Permutation test:  63%|██████▎   | 6260/10000 [01:12<00:29, 128.85 permutations/s]
Permutation test:  63%|██████▎   | 6273/10000 [01:13<00:29, 127.02 permutations/s]
Permutation test:  63%|██████▎   | 6286/10000 [01:13<00:30, 123.19 permutations/s]
Permutation test:  63%|██████▎   | 6299/10000 [01:13<00:30, 120.96 permutations/s]
Permutation test:  63%|██████▎   | 6312/10000 [01:13<00:31, 115.56 permutations/s]
Permutation test:  63%|██████▎   | 6326/10000 [01:13<00:30, 122.16 permutations/s]
Permutation test:  63%|██████▎   | 6339/10000 [01:13<00:30, 121.63 permutations/s]
Permutation test:  64%|██████▎   | 6352/10000 [01:13<00:30, 119.10 permutations/s]
Permutation test:  64%|██████▎   | 6364/10000 [01:13<00:32, 112.78 permutations/s]
Permutation test:  64%|██████▍   | 6376/10000 [01:14<00:33, 107.65 permutations/s]
Permutation test:  64%|██████▍   | 6387/10000 [01:14<00:35, 101.83 permutations/s]
Permutation test:  64%|██████▍   | 6400/10000 [01:14<00:33, 107.92 permutations/s]
Permutation test:  64%|██████▍   | 6414/10000 [01:14<00:31, 115.40 permutations/s]
Permutation test:  64%|██████▍   | 6426/10000 [01:14<00:32, 109.38 permutations/s]
Permutation test:  64%|██████▍   | 6438/10000 [01:14<00:33, 107.58 permutations/s]
Permutation test:  65%|██████▍   | 6451/10000 [01:14<00:31, 111.20 permutations/s]
Permutation test:  65%|██████▍   | 6464/10000 [01:14<00:30, 115.16 permutations/s]
Permutation test:  65%|██████▍   | 6476/10000 [01:14<00:31, 110.93 permutations/s]
Permutation test:  65%|██████▍   | 6488/10000 [01:15<00:31, 111.20 permutations/s]
Permutation test:  65%|██████▌   | 6501/10000 [01:15<00:30, 115.47 permutations/s]
Permutation test:  65%|██████▌   | 6514/10000 [01:15<00:29, 118.33 permutations/s]
Permutation test:  65%|██████▌   | 6526/10000 [01:15<00:30, 113.87 permutations/s]
Permutation test:  65%|██████▌   | 6538/10000 [01:15<00:34, 99.84 permutations/s]
Permutation test:  66%|██████▌   | 6552/10000 [01:15<00:31, 108.98 permutations/s]
Permutation test:  66%|██████▌   | 6566/10000 [01:15<00:29, 115.28 permutations/s]
Permutation test:  66%|██████▌   | 6579/10000 [01:15<00:28, 118.66 permutations/s]
Permutation test:  66%|██████▌   | 6592/10000 [01:15<00:30, 112.98 permutations/s]
Permutation test:  66%|██████▌   | 6605/10000 [01:16<00:28, 117.37 permutations/s]
Permutation test:  66%|██████▌   | 6619/10000 [01:16<00:27, 121.20 permutations/s]
Permutation test:  66%|██████▋   | 6632/10000 [01:16<00:27, 122.28 permutations/s]
Permutation test:  66%|██████▋   | 6645/10000 [01:16<00:29, 115.28 permutations/s]
Permutation test:  67%|██████▋   | 6657/10000 [01:16<00:28, 115.35 permutations/s]
Permutation test:  67%|██████▋   | 6672/10000 [01:16<00:26, 124.11 permutations/s]
Permutation test:  67%|██████▋   | 6686/10000 [01:16<00:26, 123.28 permutations/s]
Permutation test:  67%|██████▋   | 6699/10000 [01:16<00:26, 124.12 permutations/s]
Permutation test:  67%|██████▋   | 6712/10000 [01:16<00:26, 121.98 permutations/s]
Permutation test:  67%|██████▋   | 6725/10000 [01:17<00:27, 120.12 permutations/s]
Permutation test:  67%|██████▋   | 6738/10000 [01:17<00:26, 122.63 permutations/s]
Permutation test:  68%|██████▊   | 6751/10000 [01:17<00:26, 122.53 permutations/s]
Permutation test:  68%|██████▊   | 6765/10000 [01:17<00:25, 125.74 permutations/s]
Permutation test:  68%|██████▊   | 6779/10000 [01:17<00:26, 122.97 permutations/s]
Permutation test:  68%|██████▊   | 6793/10000 [01:17<00:25, 126.16 permutations/s]
Permutation test:  68%|██████▊   | 6807/10000 [01:17<00:24, 129.35 permutations/s]
Permutation test:  68%|██████▊   | 6820/10000 [01:17<00:25, 123.14 permutations/s]
Permutation test:  68%|██████▊   | 6836/10000 [01:17<00:25, 125.37 permutations/s]
Permutation test:  68%|██████▊   | 6849/10000 [01:18<00:26, 119.93 permutations/s]
Permutation test:  69%|██████▊   | 6862/10000 [01:18<00:28, 110.72 permutations/s]
Permutation test:  69%|██████▊   | 6874/10000 [01:18<00:27, 112.23 permutations/s]
Permutation test:  69%|██████▉   | 6888/10000 [01:18<00:26, 117.85 permutations/s]
Permutation test:  69%|██████▉   | 6901/10000 [01:18<00:25, 120.35 permutations/s]
Permutation test:  69%|██████▉   | 6914/10000 [01:18<00:25, 120.35 permutations/s]
Permutation test:  69%|██████▉   | 6927/10000 [01:18<00:28, 106.07 permutations/s]
Permutation test:  69%|██████▉   | 6939/10000 [01:18<00:28, 107.38 permutations/s]
Permutation test:  70%|██████▉   | 6953/10000 [01:18<00:26, 113.79 permutations/s]
Permutation test:  70%|██████▉   | 6965/10000 [01:19<00:28, 107.40 permutations/s]
Permutation test:  70%|██████▉   | 6979/10000 [01:19<00:26, 115.63 permutations/s]
Permutation test:  70%|██████▉   | 6992/10000 [01:19<00:25, 118.93 permutations/s]
Permutation test:  70%|███████   | 7005/10000 [01:19<00:26, 115.06 permutations/s]
Permutation test:  70%|███████   | 7017/10000 [01:19<00:25, 115.17 permutations/s]
Permutation test:  70%|███████   | 7030/10000 [01:19<00:25, 117.97 permutations/s]
Permutation test:  70%|███████   | 7042/10000 [01:19<00:25, 113.89 permutations/s]
Permutation test:  71%|███████   | 7054/10000 [01:19<00:25, 115.02 permutations/s]
Permutation test:  71%|███████   | 7068/10000 [01:19<00:24, 122.11 permutations/s]
Permutation test:  71%|███████   | 7085/10000 [01:20<00:22, 128.76 permutations/s]
Permutation test:  71%|███████   | 7099/10000 [01:20<00:22, 130.63 permutations/s]
Permutation test:  71%|███████   | 7113/10000 [01:20<00:22, 127.20 permutations/s]
Permutation test:  71%|███████▏  | 7126/10000 [01:20<00:22, 126.57 permutations/s]
Permutation test:  71%|███████▏  | 7139/10000 [01:20<00:24, 118.17 permutations/s]
Permutation test:  72%|███████▏  | 7151/10000 [01:20<00:24, 114.92 permutations/s]
Permutation test:  72%|███████▏  | 7164/10000 [01:20<00:24, 117.90 permutations/s]
Permutation test:  72%|███████▏  | 7176/10000 [01:20<00:24, 116.90 permutations/s]
Permutation test:  72%|███████▏  | 7188/10000 [01:20<00:24, 114.05 permutations/s]
Permutation test:  72%|███████▏  | 7201/10000 [01:21<00:23, 117.20 permutations/s]
Permutation test:  72%|███████▏  | 7213/10000 [01:21<00:24, 112.87 permutations/s]
Permutation test:  72%|███████▏  | 7225/10000 [01:21<00:26, 105.47 permutations/s]
Permutation test:  72%|███████▏  | 7237/10000 [01:21<00:25, 109.32 permutations/s]
Permutation test:  72%|███████▏  | 7249/10000 [01:21<00:24, 110.07 permutations/s]
Permutation test:  73%|███████▎  | 7262/10000 [01:21<00:24, 113.26 permutations/s]
Permutation test:  73%|███████▎  | 7275/10000 [01:21<00:23, 117.44 permutations/s]
Permutation test:  73%|███████▎  | 7288/10000 [01:21<00:22, 119.64 permutations/s]
Permutation test:  73%|███████▎  | 7301/10000 [01:21<00:23, 113.95 permutations/s]
Permutation test:  73%|███████▎  | 7313/10000 [01:22<00:23, 115.27 permutations/s]
Permutation test:  73%|███████▎  | 7325/10000 [01:22<00:23, 111.57 permutations/s]
Permutation test:  73%|███████▎  | 7338/10000 [01:22<00:23, 115.41 permutations/s]
Permutation test:  74%|███████▎  | 7350/10000 [01:22<00:23, 112.89 permutations/s]
Permutation test:  74%|███████▎  | 7363/10000 [01:22<00:22, 116.40 permutations/s]
Permutation test:  74%|███████▍  | 7376/10000 [01:22<00:22, 117.88 permutations/s]
Permutation test:  74%|███████▍  | 7390/10000 [01:22<00:21, 122.45 permutations/s]
Permutation test:  74%|███████▍  | 7403/10000 [01:22<00:21, 118.60 permutations/s]
Permutation test:  74%|███████▍  | 7415/10000 [01:22<00:21, 117.84 permutations/s]
Permutation test:  74%|███████▍  | 7427/10000 [01:23<00:22, 112.90 permutations/s]
Permutation test:  74%|███████▍  | 7440/10000 [01:23<00:22, 115.85 permutations/s]
Permutation test:  75%|███████▍  | 7453/10000 [01:23<00:21, 118.56 permutations/s]
Permutation test:  75%|███████▍  | 7465/10000 [01:23<00:21, 117.60 permutations/s]
Permutation test:  75%|███████▍  | 7478/10000 [01:23<00:21, 116.01 permutations/s]
Permutation test:  75%|███████▍  | 7492/10000 [01:23<00:20, 121.25 permutations/s]
Permutation test:  75%|███████▌  | 7505/10000 [01:23<00:21, 117.26 permutations/s]
Permutation test:  75%|███████▌  | 7518/10000 [01:23<00:20, 119.29 permutations/s]
Permutation test:  75%|███████▌  | 7530/10000 [01:23<00:21, 114.46 permutations/s]
Permutation test:  75%|███████▌  | 7542/10000 [01:24<00:22, 110.15 permutations/s]
Permutation test:  76%|███████▌  | 7554/10000 [01:24<00:22, 106.62 permutations/s]
Permutation test:  76%|███████▌  | 7567/10000 [01:24<00:21, 111.72 permutations/s]
Permutation test:  76%|███████▌  | 7579/10000 [01:24<00:23, 103.69 permutations/s]
Permutation test:  76%|███████▌  | 7592/10000 [01:24<00:22, 109.43 permutations/s]
Permutation test:  76%|███████▌  | 7604/10000 [01:24<00:24, 99.82 permutations/s]
Permutation test:  76%|███████▌  | 7617/10000 [01:24<00:22, 107.25 permutations/s]
Permutation test:  76%|███████▋  | 7631/10000 [01:24<00:20, 113.80 permutations/s]
Permutation test:  76%|███████▋  | 7645/10000 [01:24<00:19, 119.18 permutations/s]
Permutation test:  77%|███████▋  | 7658/10000 [01:25<00:21, 111.11 permutations/s]
Permutation test:  77%|███████▋  | 7671/10000 [01:25<00:20, 114.89 permutations/s]
Permutation test:  77%|███████▋  | 7684/10000 [01:25<00:19, 117.73 permutations/s]
Permutation test:  77%|███████▋  | 7696/10000 [01:25<00:21, 108.83 permutations/s]
Permutation test:  77%|███████▋  | 7709/10000 [01:25<00:20, 113.12 permutations/s]
Permutation test:  77%|███████▋  | 7722/10000 [01:25<00:20, 112.95 permutations/s]
Permutation test:  77%|███████▋  | 7735/10000 [01:25<00:19, 115.10 permutations/s]
Permutation test:  77%|███████▋  | 7747/10000 [01:25<00:20, 110.84 permutations/s]
Permutation test:  78%|███████▊  | 7759/10000 [01:25<00:20, 111.86 permutations/s]
Permutation test:  78%|███████▊  | 7771/10000 [01:26<00:20, 107.98 permutations/s]
Permutation test:  78%|███████▊  | 7782/10000 [01:26<00:21, 104.87 permutations/s]
Permutation test:  78%|███████▊  | 7795/10000 [01:26<00:20, 110.05 permutations/s]
Permutation test:  78%|███████▊  | 7807/10000 [01:26<00:19, 112.03 permutations/s]
Permutation test:  78%|███████▊  | 7820/10000 [01:26<00:18, 115.81 permutations/s]
Permutation test:  78%|███████▊  | 7832/10000 [01:26<00:19, 109.53 permutations/s]
Permutation test:  78%|███████▊  | 7846/10000 [01:26<00:18, 116.34 permutations/s]
Permutation test:  79%|███████▊  | 7858/10000 [01:26<00:19, 109.16 permutations/s]
Permutation test:  79%|███████▊  | 7870/10000 [01:26<00:19, 112.05 permutations/s]
Permutation test:  79%|███████▉  | 7882/10000 [01:27<00:20, 105.05 permutations/s]
Permutation test:  79%|███████▉  | 7897/10000 [01:27<00:18, 115.69 permutations/s]
Permutation test:  79%|███████▉  | 7909/10000 [01:27<00:18, 113.02 permutations/s]
Permutation test:  79%|███████▉  | 7921/10000 [01:27<00:18, 110.21 permutations/s]
Permutation test:  79%|███████▉  | 7934/10000 [01:27<00:18, 114.38 permutations/s]
Permutation test:  79%|███████▉  | 7946/10000 [01:27<00:18, 110.65 permutations/s]
Permutation test:  80%|███████▉  | 7958/10000 [01:27<00:18, 112.33 permutations/s]
Permutation test:  80%|███████▉  | 7971/10000 [01:27<00:17, 117.24 permutations/s]
Permutation test:  80%|███████▉  | 7985/10000 [01:27<00:16, 120.98 permutations/s]
Permutation test:  80%|███████▉  | 7998/10000 [01:28<00:18, 108.87 permutations/s]
Permutation test:  80%|████████  | 8010/10000 [01:28<00:18, 106.78 permutations/s]
Permutation test:  80%|████████  | 8021/10000 [01:28<00:20, 96.40 permutations/s]
Permutation test:  80%|████████  | 8031/10000 [01:28<00:25, 78.04 permutations/s]
Permutation test:  80%|████████  | 8040/10000 [01:28<00:25, 76.39 permutations/s]
Permutation test:  80%|████████  | 8049/10000 [01:28<00:25, 77.69 permutations/s]
Permutation test:  81%|████████  | 8058/10000 [01:28<00:24, 79.00 permutations/s]
Permutation test:  81%|████████  | 8067/10000 [01:29<00:25, 75.04 permutations/s]
Permutation test:  81%|████████  | 8075/10000 [01:29<00:26, 72.64 permutations/s]
Permutation test:  81%|████████  | 8083/10000 [01:29<00:27, 68.52 permutations/s]
Permutation test:  81%|████████  | 8094/10000 [01:29<00:25, 74.79 permutations/s]
Permutation test:  81%|████████  | 8102/10000 [01:29<00:28, 67.16 permutations/s]
Permutation test:  81%|████████  | 8113/10000 [01:29<00:24, 77.19 permutations/s]
Permutation test:  81%|████████  | 8122/10000 [01:29<00:25, 74.71 permutations/s]
Permutation test:  81%|████████▏ | 8130/10000 [01:29<00:25, 74.52 permutations/s]
Permutation test:  81%|████████▏ | 8139/10000 [01:30<00:24, 76.81 permutations/s]
Permutation test:  81%|████████▏ | 8148/10000 [01:30<00:23, 79.28 permutations/s]
Permutation test:  82%|████████▏ | 8157/10000 [01:30<00:25, 70.93 permutations/s]
Permutation test:  82%|████████▏ | 8165/10000 [01:30<00:28, 64.11 permutations/s]
Permutation test:  82%|████████▏ | 8172/10000 [01:30<00:30, 59.77 permutations/s]
Permutation test:  82%|████████▏ | 8183/10000 [01:30<00:26, 68.50 permutations/s]
Permutation test:  82%|████████▏ | 8194/10000 [01:30<00:23, 77.18 permutations/s]
Permutation test:  82%|████████▏ | 8203/10000 [01:30<00:25, 69.49 permutations/s]
Permutation test:  82%|████████▏ | 8213/10000 [01:31<00:23, 76.65 permutations/s]
Permutation test:  82%|████████▏ | 8225/10000 [01:31<00:20, 86.09 permutations/s]
Permutation test:  82%|████████▏ | 8235/10000 [01:31<00:23, 76.39 permutations/s]
Permutation test:  82%|████████▏ | 8244/10000 [01:31<00:22, 78.33 permutations/s]
Permutation test:  83%|████████▎ | 8253/10000 [01:31<00:22, 78.67 permutations/s]
Permutation test:  83%|████████▎ | 8262/10000 [01:31<00:23, 74.00 permutations/s]
Permutation test:  83%|████████▎ | 8271/10000 [01:31<00:23, 73.64 permutations/s]
Permutation test:  83%|████████▎ | 8279/10000 [01:31<00:22, 75.04 permutations/s]
Permutation test:  83%|████████▎ | 8287/10000 [01:32<00:22, 75.00 permutations/s]
Permutation test:  83%|████████▎ | 8295/10000 [01:32<00:23, 72.87 permutations/s]
Permutation test:  83%|████████▎ | 8303/10000 [01:32<00:23, 71.89 permutations/s]
Permutation test:  83%|████████▎ | 8313/10000 [01:32<00:21, 79.37 permutations/s]
Permutation test:  83%|████████▎ | 8322/10000 [01:32<00:23, 72.13 permutations/s]
Permutation test:  83%|████████▎ | 8333/10000 [01:32<00:21, 76.37 permutations/s]
Permutation test:  83%|████████▎ | 8344/10000 [01:32<00:19, 84.25 permutations/s]
Permutation test:  84%|████████▎ | 8353/10000 [01:32<00:19, 84.15 permutations/s]
Permutation test:  84%|████████▎ | 8362/10000 [01:32<00:20, 81.07 permutations/s]
Permutation test:  84%|████████▎ | 8371/10000 [01:33<00:23, 69.31 permutations/s]
Permutation test:  84%|████████▍ | 8379/10000 [01:33<00:22, 71.78 permutations/s]
Permutation test:  84%|████████▍ | 8390/10000 [01:33<00:20, 79.09 permutations/s]
Permutation test:  84%|████████▍ | 8399/10000 [01:33<00:22, 71.74 permutations/s]
Permutation test:  84%|████████▍ | 8409/10000 [01:33<00:20, 77.65 permutations/s]
Permutation test:  84%|████████▍ | 8418/10000 [01:33<00:20, 77.00 permutations/s]
Permutation test:  84%|████████▍ | 8427/10000 [01:33<00:20, 77.93 permutations/s]
Permutation test:  84%|████████▍ | 8437/10000 [01:34<00:19, 78.79 permutations/s]
Permutation test:  84%|████████▍ | 8448/10000 [01:34<00:18, 81.77 permutations/s]
Permutation test:  85%|████████▍ | 8457/10000 [01:34<00:19, 78.67 permutations/s]
Permutation test:  85%|████████▍ | 8465/10000 [01:34<00:20, 75.53 permutations/s]
Permutation test:  85%|████████▍ | 8473/10000 [01:34<00:20, 73.38 permutations/s]
Permutation test:  85%|████████▍ | 8483/10000 [01:34<00:19, 78.49 permutations/s]
Permutation test:  85%|████████▍ | 8491/10000 [01:34<00:20, 73.06 permutations/s]
Permutation test:  85%|████████▍ | 8499/10000 [01:34<00:21, 69.65 permutations/s]
Permutation test:  85%|████████▌ | 8511/10000 [01:34<00:18, 82.65 permutations/s]
Permutation test:  85%|████████▌ | 8520/10000 [01:35<00:19, 74.78 permutations/s]
Permutation test:  85%|████████▌ | 8531/10000 [01:35<00:17, 82.80 permutations/s]
Permutation test:  85%|████████▌ | 8540/10000 [01:35<00:18, 79.67 permutations/s]
Permutation test:  85%|████████▌ | 8549/10000 [01:35<00:19, 72.79 permutations/s]
Permutation test:  86%|████████▌ | 8557/10000 [01:35<00:20, 71.72 permutations/s]
Permutation test:  86%|████████▌ | 8565/10000 [01:35<00:20, 70.74 permutations/s]
Permutation test:  86%|████████▌ | 8574/10000 [01:35<00:19, 72.00 permutations/s]
Permutation test:  86%|████████▌ | 8583/10000 [01:35<00:18, 75.90 permutations/s]
Permutation test:  86%|████████▌ | 8591/10000 [01:36<00:18, 75.32 permutations/s]
Permutation test:  86%|████████▌ | 8599/10000 [01:36<00:19, 73.73 permutations/s]
Permutation test:  86%|████████▌ | 8607/10000 [01:36<00:21, 65.54 permutations/s]
Permutation test:  86%|████████▌ | 8614/10000 [01:36<00:21, 63.33 permutations/s]
Permutation test:  86%|████████▌ | 8621/10000 [01:36<00:22, 60.73 permutations/s]
Permutation test:  86%|████████▋ | 8629/10000 [01:36<00:21, 64.14 permutations/s]
Permutation test:  86%|████████▋ | 8641/10000 [01:36<00:17, 78.58 permutations/s]
Permutation test:  87%|████████▋ | 8652/10000 [01:36<00:16, 83.81 permutations/s]
Permutation test:  87%|████████▋ | 8661/10000 [01:37<00:17, 77.96 permutations/s]
Permutation test:  87%|████████▋ | 8669/10000 [01:37<00:17, 77.60 permutations/s]
Permutation test:  87%|████████▋ | 8681/10000 [01:37<00:14, 88.97 permutations/s]
Permutation test:  87%|████████▋ | 8692/10000 [01:37<00:14, 91.86 permutations/s]
Permutation test:  87%|████████▋ | 8702/10000 [01:37<00:15, 83.88 permutations/s]
Permutation test:  87%|████████▋ | 8711/10000 [01:37<00:17, 72.86 permutations/s]
Permutation test:  87%|████████▋ | 8720/10000 [01:37<00:17, 74.16 permutations/s]
Permutation test:  87%|████████▋ | 8730/10000 [01:37<00:15, 80.53 permutations/s]
Permutation test:  87%|████████▋ | 8742/10000 [01:37<00:14, 86.87 permutations/s]
Permutation test:  88%|████████▊ | 8753/10000 [01:38<00:14, 88.35 permutations/s]
Permutation test:  88%|████████▊ | 8762/10000 [01:38<00:14, 83.12 permutations/s]
Permutation test:  88%|████████▊ | 8771/10000 [01:38<00:15, 78.70 permutations/s]
Permutation test:  88%|████████▊ | 8779/10000 [01:38<00:16, 74.51 permutations/s]
Permutation test:  88%|████████▊ | 8787/10000 [01:38<00:16, 72.84 permutations/s]
Permutation test:  88%|████████▊ | 8796/10000 [01:38<00:16, 72.82 permutations/s]
Permutation test:  88%|████████▊ | 8804/10000 [01:38<00:16, 73.19 permutations/s]
Permutation test:  88%|████████▊ | 8815/10000 [01:38<00:14, 82.79 permutations/s]
Permutation test:  88%|████████▊ | 8824/10000 [01:39<00:14, 78.70 permutations/s]
Permutation test:  88%|████████▊ | 8837/10000 [01:39<00:13, 87.89 permutations/s]
Permutation test:  88%|████████▊ | 8846/10000 [01:39<00:14, 80.63 permutations/s]
Permutation test:  89%|████████▊ | 8855/10000 [01:39<00:14, 79.10 permutations/s]
Permutation test:  89%|████████▊ | 8866/10000 [01:39<00:13, 84.91 permutations/s]
Permutation test:  89%|████████▉ | 8875/10000 [01:39<00:14, 78.95 permutations/s]
Permutation test:  89%|████████▉ | 8884/10000 [01:39<00:13, 81.70 permutations/s]
Permutation test:  89%|████████▉ | 8893/10000 [01:39<00:13, 80.57 permutations/s]
Permutation test:  89%|████████▉ | 8904/10000 [01:40<00:12, 87.21 permutations/s]
Permutation test:  89%|████████▉ | 8916/10000 [01:40<00:11, 91.73 permutations/s]
Permutation test:  89%|████████▉ | 8927/10000 [01:40<00:11, 94.69 permutations/s]
Permutation test:  89%|████████▉ | 8937/10000 [01:40<00:14, 75.36 permutations/s]
Permutation test:  89%|████████▉ | 8946/10000 [01:40<00:15, 68.08 permutations/s]
Permutation test:  90%|████████▉ | 8954/10000 [01:40<00:14, 70.58 permutations/s]
Permutation test:  90%|████████▉ | 8962/10000 [01:40<00:15, 64.97 permutations/s]
Permutation test:  90%|████████▉ | 8971/10000 [01:40<00:14, 70.45 permutations/s]
Permutation test:  90%|████████▉ | 8979/10000 [01:41<00:14, 70.93 permutations/s]
Permutation test:  90%|████████▉ | 8987/10000 [01:41<00:14, 68.69 permutations/s]
Permutation test:  90%|████████▉ | 8998/10000 [01:41<00:12, 79.07 permutations/s]
Permutation test:  90%|█████████ | 9008/10000 [01:41<00:12, 82.36 permutations/s]
Permutation test:  90%|█████████ | 9025/10000 [01:41<00:09, 99.50 permutations/s]
Permutation test:  90%|█████████ | 9036/10000 [01:41<00:10, 93.78 permutations/s]
Permutation test:  90%|█████████ | 9046/10000 [01:41<00:10, 88.55 permutations/s]
Permutation test:  91%|█████████ | 9055/10000 [01:41<00:10, 87.99 permutations/s]
Permutation test:  91%|█████████ | 9064/10000 [01:41<00:10, 87.04 permutations/s]
Permutation test:  91%|█████████ | 9073/10000 [01:42<00:11, 79.64 permutations/s]
Permutation test:  91%|█████████ | 9082/10000 [01:42<00:11, 77.24 permutations/s]
Permutation test:  91%|█████████ | 9092/10000 [01:42<00:11, 81.95 permutations/s]
Permutation test:  91%|█████████ | 9101/10000 [01:42<00:11, 77.98 permutations/s]
Permutation test:  91%|█████████ | 9114/10000 [01:42<00:09, 88.93 permutations/s]
Permutation test:  91%|█████████▏| 9131/10000 [01:42<00:08, 107.35 permutations/s]
Permutation test:  91%|█████████▏| 9142/10000 [01:42<00:09, 95.33 permutations/s]
Permutation test:  92%|█████████▏| 9152/10000 [01:43<00:09, 88.04 permutations/s]
Permutation test:  92%|█████████▏| 9162/10000 [01:43<00:10, 79.59 permutations/s]
Permutation test:  92%|█████████▏| 9174/10000 [01:43<00:09, 88.61 permutations/s]
Permutation test:  92%|█████████▏| 9185/10000 [01:43<00:09, 89.56 permutations/s]
Permutation test:  92%|█████████▏| 9195/10000 [01:43<00:09, 89.25 permutations/s]
Permutation test:  92%|█████████▏| 9205/10000 [01:43<00:08, 88.60 permutations/s]
Permutation test:  92%|█████████▏| 9215/10000 [01:43<00:08, 90.41 permutations/s]
Permutation test:  92%|█████████▏| 9225/10000 [01:43<00:08, 90.12 permutations/s]
Permutation test:  92%|█████████▏| 9235/10000 [01:43<00:08, 86.30 permutations/s]
Permutation test:  92%|█████████▏| 9244/10000 [01:44<00:09, 80.64 permutations/s]
Permutation test:  93%|█████████▎| 9255/10000 [01:44<00:08, 85.99 permutations/s]
Permutation test:  93%|█████████▎| 9264/10000 [01:44<00:10, 70.81 permutations/s]
Permutation test:  93%|█████████▎| 9272/10000 [01:44<00:10, 71.35 permutations/s]
Permutation test:  93%|█████████▎| 9280/10000 [01:44<00:10, 71.09 permutations/s]
Permutation test:  93%|█████████▎| 9291/10000 [01:44<00:08, 80.08 permutations/s]
Permutation test:  93%|█████████▎| 9300/10000 [01:44<00:09, 77.75 permutations/s]
Permutation test:  93%|█████████▎| 9312/10000 [01:44<00:07, 87.10 permutations/s]
Permutation test:  93%|█████████▎| 9321/10000 [01:45<00:07, 87.05 permutations/s]
Permutation test:  93%|█████████▎| 9330/10000 [01:45<00:07, 86.21 permutations/s]
Permutation test:  93%|█████████▎| 9339/10000 [01:45<00:08, 78.16 permutations/s]
Permutation test:  93%|█████████▎| 9348/10000 [01:45<00:08, 78.00 permutations/s]
Permutation test:  94%|█████████▎| 9356/10000 [01:45<00:09, 67.77 permutations/s]
Permutation test:  94%|█████████▎| 9364/10000 [01:45<00:09, 69.31 permutations/s]
Permutation test:  94%|█████████▎| 9372/10000 [01:45<00:08, 72.04 permutations/s]
Permutation test:  94%|█████████▍| 9382/10000 [01:45<00:07, 78.03 permutations/s]
Permutation test:  94%|█████████▍| 9390/10000 [01:45<00:07, 76.26 permutations/s]
Permutation test:  94%|█████████▍| 9398/10000 [01:46<00:07, 75.58 permutations/s]
Permutation test:  94%|█████████▍| 9406/10000 [01:46<00:07, 75.41 permutations/s]
Permutation test:  94%|█████████▍| 9415/10000 [01:46<00:07, 78.00 permutations/s]
Permutation test:  94%|█████████▍| 9424/10000 [01:46<00:07, 74.77 permutations/s]
Permutation test:  94%|█████████▍| 9434/10000 [01:46<00:07, 79.02 permutations/s]
Permutation test:  94%|█████████▍| 9448/10000 [01:46<00:05, 92.73 permutations/s]
Permutation test:  95%|█████████▍| 9458/10000 [01:46<00:06, 90.19 permutations/s]
Permutation test:  95%|█████████▍| 9468/10000 [01:46<00:06, 82.22 permutations/s]
Permutation test:  95%|█████████▍| 9477/10000 [01:47<00:06, 79.61 permutations/s]
Permutation test:  95%|█████████▍| 9486/10000 [01:47<00:06, 78.31 permutations/s]
Permutation test:  95%|█████████▍| 9494/10000 [01:47<00:07, 69.40 permutations/s]
Permutation test:  95%|█████████▌| 9503/10000 [01:47<00:07, 69.98 permutations/s]
Permutation test:  95%|█████████▌| 9513/10000 [01:47<00:06, 75.69 permutations/s]
Permutation test:  95%|█████████▌| 9521/10000 [01:47<00:06, 74.51 permutations/s]
Permutation test:  95%|█████████▌| 9529/10000 [01:47<00:06, 70.71 permutations/s]
Permutation test:  95%|█████████▌| 9538/10000 [01:47<00:06, 74.04 permutations/s]
Permutation test:  95%|█████████▌| 9546/10000 [01:48<00:06, 75.38 permutations/s]
Permutation test:  96%|█████████▌| 9555/10000 [01:48<00:05, 77.16 permutations/s]
Permutation test:  96%|█████████▌| 9563/10000 [01:48<00:05, 76.68 permutations/s]
Permutation test:  96%|█████████▌| 9574/10000 [01:48<00:05, 79.29 permutations/s]
Permutation test:  96%|█████████▌| 9584/10000 [01:48<00:05, 80.53 permutations/s]
Permutation test:  96%|█████████▌| 9593/10000 [01:48<00:05, 78.35 permutations/s]
Permutation test:  96%|█████████▌| 9601/10000 [01:48<00:05, 74.92 permutations/s]
Permutation test:  96%|█████████▌| 9609/10000 [01:48<00:05, 73.93 permutations/s]
Permutation test:  96%|█████████▌| 9619/10000 [01:48<00:04, 80.69 permutations/s]
Permutation test:  96%|█████████▋| 9630/10000 [01:49<00:04, 88.45 permutations/s]
Permutation test:  96%|█████████▋| 9644/10000 [01:49<00:03, 102.88 permutations/s]
Permutation test:  97%|█████████▋| 9655/10000 [01:49<00:03, 99.17 permutations/s]
Permutation test:  97%|█████████▋| 9666/10000 [01:49<00:03, 95.00 permutations/s]
Permutation test:  97%|█████████▋| 9676/10000 [01:49<00:03, 94.77 permutations/s]
Permutation test:  97%|█████████▋| 9686/10000 [01:49<00:03, 92.27 permutations/s]
Permutation test:  97%|█████████▋| 9696/10000 [01:49<00:03, 92.34 permutations/s]
Permutation test:  97%|█████████▋| 9706/10000 [01:49<00:03, 89.91 permutations/s]
Permutation test:  97%|█████████▋| 9716/10000 [01:49<00:03, 81.20 permutations/s]
Permutation test:  97%|█████████▋| 9729/10000 [01:50<00:02, 93.26 permutations/s]
Permutation test:  97%|█████████▋| 9739/10000 [01:50<00:03, 75.31 permutations/s]
Permutation test:  97%|█████████▋| 9748/10000 [01:50<00:03, 68.54 permutations/s]
Permutation test:  98%|█████████▊| 9756/10000 [01:50<00:03, 63.54 permutations/s]
Permutation test:  98%|█████████▊| 9772/10000 [01:50<00:02, 84.11 permutations/s]
Permutation test:  98%|█████████▊| 9782/10000 [01:50<00:02, 85.09 permutations/s]
Permutation test:  98%|█████████▊| 9792/10000 [01:50<00:02, 82.37 permutations/s]
Permutation test:  98%|█████████▊| 9802/10000 [01:51<00:02, 82.46 permutations/s]
Permutation test:  98%|█████████▊| 9811/10000 [01:51<00:02, 73.30 permutations/s]
Permutation test:  98%|█████████▊| 9820/10000 [01:51<00:02, 77.12 permutations/s]
Permutation test:  98%|█████████▊| 9829/10000 [01:51<00:02, 72.57 permutations/s]
Permutation test:  98%|█████████▊| 9841/10000 [01:51<00:01, 80.92 permutations/s]
Permutation test:  99%|█████████▊| 9862/10000 [01:51<00:01, 107.99 permutations/s]
Permutation test:  99%|█████████▊| 9874/10000 [01:51<00:01, 103.26 permutations/s]
Permutation test:  99%|█████████▉| 9885/10000 [01:52<00:01, 91.98 permutations/s]
Permutation test:  99%|█████████▉| 9895/10000 [01:52<00:01, 92.35 permutations/s]
Permutation test:  99%|█████████▉| 9905/10000 [01:52<00:01, 76.31 permutations/s]
Permutation test:  99%|█████████▉| 9918/10000 [01:52<00:00, 87.28 permutations/s]
Permutation test:  99%|█████████▉| 9928/10000 [01:52<00:00, 89.29 permutations/s]
Permutation test:  99%|█████████▉| 9943/10000 [01:52<00:00, 102.75 permutations/s]
Permutation test: 100%|█████████▉| 9957/10000 [01:52<00:00, 110.66 permutations/s]
Permutation test: 100%|█████████▉| 9969/10000 [01:52<00:00, 110.67 permutations/s]
Permutation test: 100%|█████████▉| 9983/10000 [01:52<00:00, 118.41 permutations/s]
Permutation test: 100%|██████████| 10000/10000 [01:53<00:00, 88.47 permutations/s]

A quick plot suggests an early effect related to n_chars around 130 ms, and a later effect of cloze around 400 ms:

p = plot.TopoButterfly(lm, t=0.130, axh=2, w=6)
sensor lm

Detailed plots of the two effects show that the cluster is quite variable due to noise in the data.

p = plot.TopoArray(lm.masked_parameter_map('n_chars'), t=[0.110, 0.130, 0.150], title='N Chars')
p = plot.TopoArray(lm.masked_parameter_map('cloze'), t=[0.380, 0.400, 0.420], title='Cloze')
  • N Chars
  • Cloze

To access some of the test results we need to know the index of different effects:

('intercept', 'n_chars', 'cloze')

Create a plot that shows the spatial cluster extent across time.

EFFECTS = [
    ('n_chars', (0.110, 0.150)),
    ('cloze', (0.380, 0.420)),
]

t_maps = []
for effect, time in EFFECTS:
    # t-maps are retrieved by effect name
    t = lm.t(effect).mean(time=time)
    # p-maps are stored in a list, so we need to know the index of te effect
    index = lm.effects.index(effect)
    # We are interested in the maximal spatial cluster extent, i.e., any sensor that is part of the cluster at any time
    p = lm.p[index].min(time=time)
    # Create a masked average t map
    t_av = t.mask(p > 0.05)
    t_maps.append(t_av)

p = plot.Topomap(t_maps, columns=2)
n_chars, cloze

Total running time of the script: (1 minutes 56.087 seconds)

Gallery generated by Sphinx-Gallery