Data_Auto_Transfer

A Python Tool for Data Transfering from the SD Card to Your Field Computer - Data_Auto_Transfer

Rui Gao^1,2, Mohammad Safeeq^1,2, Joshua H. Viers^1,2

¹Department of Civil and Environmental Engineering, University of California Merced, Merced, CA 95343, USA
²Valley Institute for Sustainable Technology & Agriculture, University of California Merced, Merced, CA 95343, USA

Project overview

Field data collection from Eddy-Covariance (EC) flux towers often requires direct access to an SD card—an otherwise straightforward process that can become cumbersome under challenging environmental conditions. While copying the entire dataset is an option, it is time-consuming, often taking up to 10 minutes per session. Moreover, when temperatures soar above 40 °C (with surface temperatures exceeding 50 °C), prolonged exposure in the field is not just uncomfortable—it can be hazardous.
Manually selecting and transferring only the recent data files in such conditions is inconvenient and error-prone. It involves navigating laptop screens under harsh sunlight, finding shade, and carefully managing file selection with unstable gestures—all of which increase the chance of mistakes or incomplete transfers.
To streamline this process, we developed this Python-based tool. All the processes are mainly concentrated in transfer.py. It allows researchers to:

1. Specify the SD card source path,
2. Define a target directory on their computer,
3. Choose how many recent days’ worth of data to transfer.

The tool automatically identifies and copies only the relevant files, with intelligent handling of file name collisions—ensuring nothing is lost or overwritten.
This utility enables efficient and reliable data acquisition directly in the field, minimizing human effort and maximizing comfort and productivity, whether you're working under vineyard vines or back in the lab.

Document description

In this repository, we have three documents:

1. transfer.py – All the process are programed here.
2. main.ipynb – This Jupyter Notebook allows users to adjust input parameters as needed. After modifying the parameters, simply click run to generate results, which will be saved in the designated output folder. Three parameters are described below.
   • source: where the data comes from.
   • destination: where the data will be saved.
   • days: specifies the number of days of data you want to extract.
     A document named main.py is also provided, which has the same function.
3. README.md - which can help you to understand this repository.

Citation

If you use this repository in your work, please cite it using the following DOI:

BibTeX:

@misc{gao2025autodata,
  author       = {Rui Gao, Mohammad Safeeq, and Joshua H. Viers},
  title        = {A Python Tool for Data Transfering from the SD Card to Your Field Computer - Data_Auto_Transfer},
  year         = {2025},
  publisher    = {Zenodo},
  doi          = {10.5281/zenodo.16748203},
  url          = {https://doi.org/10.5281/zenodo.16748203}
}

Repository update information:

• Creation date: 2025-08-05
• Last update: 2025-08-05

Contact information if issues were found:

Rui Gao
Rui.Ray.Gao@gmail.com
RuiGao@UCMerced.edu