@@ -34,8 +34,8 @@ micompm - Multivariate independent comparison of observations
34
34
35
35
### 1.1\. What is micompm?
36
36
37
- _ micompm_ is a [ MATLAB] /[ Octave] port of the original [ micompr] [ R ]
38
- [ \[ 1 \] ] [ ref1 ] package for comparing multivariate samples associated with
37
+ _ micompm_ [ \[ 1 \] ] [ ref1 ] is a [ MATLAB] /[ Octave] port of the original [ micompr]
38
+ [ R ] [ \[ 2 \] ] [ ref2 ] package for comparing multivariate samples associated with
39
39
different groups. It uses principal component analysis (PCA) to convert
40
40
multivariate observations into a set of linearly uncorrelated statistical
41
41
measures, which are then compared using a number of statistical methods. This
@@ -47,7 +47,7 @@ measures or similar multivariate observations. It is aimed at researchers from
47
47
all fields of science, although it requires some knowledge on design of
48
48
experiments, statistical testing and multidimensional data analysis.
49
49
50
- If you use _ micompm_ , please cite reference [ \[ 2 \] ] [ ref2 ] .
50
+ If you use _ micompm_ , please cite reference [ \[ 1 \] ] [ ref1 ] .
51
51
52
52
<a name =" basicconcepts " ></a >
53
53
@@ -91,7 +91,7 @@ outputs, centered and scaled to the same order of magnitude, thus reducing a
91
91
“system” with k outputs to a “system” with one output. The proposed method
92
92
would then be applied to samples composed of concatenated observations
93
93
encompassing the existing outputs. This technique is described in detail in
94
- reference [ \[ 2 \] ] [ ref2 ] in the context of comparing simulation outputs.
94
+ reference [ \[ 3 \] ] [ ref3 ] in the context of comparing simulation outputs.
95
95
96
96
<a name =" availablefunctions " ></a >
97
97
@@ -239,7 +239,7 @@ matrices (on `npcs`).
239
239
240
240
_ P_ -values smaller than the typical 0.05 or 0.01 thresholds may be considered
241
241
statistically significant, casting doubt on the respective assumption. However,
242
- as discussed in reference [ \[ 2 \] ] [ ref2 ] , analysis of these these _ p_ -values is
242
+ as discussed in reference [ \[ 3 \] ] [ ref3 ] , analysis of these these _ p_ -values is
243
243
often not so clear-cut.
244
244
245
245
<a name =" multiplecomparisonsanddifferentoutputs " ></a >
@@ -293,7 +293,7 @@ The [micomp_show] function returns `tbl`, containing the generated table, and
293
293
## 3\. Tutorial
294
294
295
295
The tutorial uses the following dataset, which corresponds to the results
296
- presented in reference [ \[ 2 \] ] [ ref2 ] :
296
+ presented in reference [ \[ 3 \] ] [ ref3 ] :
297
297
298
298
* [ ![ DOI] ( https://zenodo.org/badge/doi/10.5281/zenodo.46848.svg )] ( http://dx.doi.org/10.5281/zenodo.46848 )
299
299
@@ -306,7 +306,7 @@ datafolder = 'path/to/dataset';
306
306
307
307
The dataset contains output from several implementations or variants of the
308
308
[ PPHPC] agent-based model. The [ PPHPC] model, discussed in reference
309
- [ \[ 3 \] ] [ ref3 ] , is a realization of a prototypical predator-prey system with six
309
+ [ \[ 4 \] ] [ ref4 ] , is a realization of a prototypical predator-prey system with six
310
310
outputs:
311
311
312
312
1 . Sheep population
@@ -326,13 +326,13 @@ generate the data:
326
326
simulation parameters.
327
327
328
328
The first two implementations strictly follow the [ PPHPC] conceptual model
329
- [ \[ 3 \] ] [ ref3 ] , and should generate statistically similar outputs. Variants 3
329
+ [ \[ 4 \] ] [ ref4 ] , and should generate statistically similar outputs. Variants 3
330
330
and 4 are purposefully misaligned, and should yield outputs with statistically
331
331
significant differences from the first two implementations.
332
332
333
333
The datasets were collected under five different model sizes (100 _ x_ 100, 200
334
334
_ x_ 200, 400 _ x_ 400, 800 _ x_ 800 and 1600 _ x_ 1600) and two distinct
335
- parameterizations (_ v1_ and _ v2_ ), as discussed in reference [ \[ 2 \] ] [ ref2 ] . For
335
+ parameterizations (_ v1_ and _ v2_ ), as discussed in reference [ \[ 3 \] ] [ ref3 ] . For
336
336
the remainder of this tutorial we will focus on model size 400 _ x_ 400 and
337
337
parameterization _ v1_ .
338
338
@@ -439,7 +439,7 @@ P-value for the MANOVA test (39 PCs, 90.63% of variance explained)
439
439
```
440
440
441
441
The second PC _ p_ -values are slightly significant (<0.05). However, as
442
- discussed in reference [ \[ 2 \] ] [ ref2 ] , a few significant _ p_ -values are to be
442
+ discussed in reference [ \[ 3 \] ] [ ref3 ] , a few significant _ p_ -values are to be
443
443
expected, and output misalignments are mostly reflected in the first PC
444
444
_ p_ -values. As such, and considering that the _ p_ -values are generally
445
445
non-significant, it is not possible to show that the implementations are
@@ -578,7 +578,7 @@ comparison on two PCs (i.e., dimensions) according to the _p_-values yielded by
578
578
in the univariate case for the first PC (the most important), but doubt is cast
579
579
in a few less meaningful PCs, as shown by [ Bartlett's] test _ p_ -values.
580
580
Multivariate homogeneity of covariance matrices for the first two PCs is not
581
- confirmed by [ Box's M] test. However, as discussed in reference [ \[ 2 \] ] [ ref2 ] ,
581
+ confirmed by [ Box's M] test. However, as discussed in reference [ \[ 3 \] ] [ ref3 ] ,
582
582
this test is highly sensitive, and this assumption is not really critical when
583
583
sample size is equal for both groups, which is the case in this comparison.
584
584
Summarizing, these results indicate that the most critical parametric test
@@ -721,7 +721,7 @@ the table and compile the document.
721
721
## 4\. Limitations
722
722
723
723
_ micompm_ has the following limitations when compared with the original R
724
- [ implementation] [ micompr ] [ \[ 1 \] ] [ ref1 ] :
724
+ [ implementation] [ micompr ] [ \[ 2 \] ] [ ref2 ] :
725
725
726
726
* It does not support outputs with different lengths.
727
727
* It does not directly provide _ p_ -values adjusted with the weighted Bonferroni
@@ -754,27 +754,36 @@ The tests can take a few minutes to run.
754
754
755
755
<a name =" ref1 " ></a >
756
756
757
- * [ \[ 1\] ] [ ref1 ] Fachada N, Rodrigues J, Lopes VV, Martins RC, Rosa AC. (2016) micompr: An R
758
- Package for Multivariate Independent Comparison of Observations. * The R Journal*
759
- 8(2):405–420.
760
- https://journal.r-project.org/archive/2016-2/fachada-rodrigues-lopes-etal.pdf
757
+ * [ \[ 1\] ] [ ref1 ] Fachada N, Rosa AC. (2018)
758
+ micompm: A MATLAB/Octave toolbox for multivariate independent comparison of
759
+ observations.
760
+ * Journal of Open Source Software* . 3(23):430.
761
+ https://doi.org/10.21105/joss.00430
761
762
762
763
<a name =" ref2 " ></a >
763
764
764
- * [ \[ 2\] ] [ ref2 ] Fachada N, Lopes VV, Martins RC, Rosa AC. (2017)
765
+ * [ \[ 2\] ] [ ref2 ] Fachada N, Rodrigues J, Lopes VV, Martins RC, Rosa AC. (2016)
766
+ micompr: An R Package for Multivariate Independent Comparison of Observations.
767
+ * The R Journal* 8(2):405–420.
768
+ https://journal.r-project.org/archive/2016-2/fachada-rodrigues-lopes-etal.pdf
769
+
770
+ <a name =" ref3 " ></a >
771
+
772
+ * [ \[ 3\] ] [ ref3 ] Fachada N, Lopes VV, Martins RC, Rosa AC. (2017)
765
773
Model-independent comparison of simulation output. * Simulation Modelling
766
774
Practice and Theory* . 72:131–149. http://dx.doi.org/10.1016/j.simpat.2016.12.013
767
775
([ arXiv preprint] ( http://arxiv.org/abs/1509.09174 ) )
768
776
769
- <a name =" ref3 " ></a >
777
+ <a name =" ref4 " ></a >
770
778
771
- * [ \[ 3 \] ] [ ref3 ] Fachada N, Lopes VV, Martins RC, Rosa AC. (2015) Towards a
779
+ * [ \[ 4 \] ] [ ref4 ] Fachada N, Lopes VV, Martins RC, Rosa AC. (2015) Towards a
772
780
standard model for research in agent-based modeling and simulation. * PeerJ
773
781
Computer Science* 1: e36 . https://doi.org/10.7717/peerj-cs.36
774
782
775
783
[ ref1 ] : #ref1
776
784
[ ref2 ] : #ref2
777
785
[ ref3 ] : #ref3
786
+ [ ref4 ] : #ref4
778
787
[ NetLogo ] : https://ccl.northwestern.edu/netlogo/
779
788
[ PPHPC ] : https://github.com/fakenmc/pphpc
780
789
[ pphpc_netlogo ] : https://github.com/fakenmc/pphpc/tree/netlogo
0 commit comments