Add timeout and retry mecanisme on individual queries to deal with server connection loss

[FirekingD]

Hello,

I would like to request a feature that i think it worth implementing and it would help a lot those who launch processing on big dataset as we do on the Geoplateforme project

Feature

Add timeout and retry mecanisme on individual queries to deal with server connection loss on long processing

Problem

On the Geoplateforme we execute r2gg-pivot2osm via the command line, however recently we've had many processings that fails due to connection time out, these are probably due to the fact that we process a big dataset and it requires many hours of processing and we frequently get connection timeout.
psycopg2.DatabaseError: could not receive data from server: Connection timed out

Desired solution

It would be great to be able to configure a timeout and retry number on individual queries so that we won't have to relaunch the whole processing

Our team can handle the developpement via a PR if you approve this feature.

Thanks in advance,
Best regards

[azarz]

@FirekingD
Hi,

Thanks for the issue!
This seems to be a good improvement. I do not see any reason why we wouldn't want this feature.

I approve 😉