Add support for configuring the Redis DB via an environment variable

[anjackson]

The current crawler beans do not allow the Redis DB to be set via environment variable. In practice, it probably makes sense to use separate services in order to spread the load, but in some cases it might be a good idea, e.g. testing.