Should mock run create its own folder with matrices if we run a different scenario from "test"?

[hsl-petrhaj]

I think it would speed up the development tiny bit.

[hsl-petrhaj]

@zptro @johpiip