This repository was archived by the owner on Jul 1, 2025. It is now read-only.

Efficient storage for large comparisons #302

widdowquinn started this conversation in Ideas

widdowquinn
Jun 29, 2021
Maintainer

pandas dataframes may not be efficient for storage of or operations on large comparisons that produce tables with millions of results.

We should explore the possibilities of using other representations/extensions like

dask: https://dask.org/
HDF5: https://www.h5py.org/

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment