Investigate any refactoring or architecture improvements

[jasonmcewen]

[CosmoMatt]

We should probably add an abstract class for operators at some point (e.g. require dir_op adj_op etc.)