feat: Parallelize electrode processing with multiprocessing#256

Merged

abuzarmahmood merged 27 commits intomasterfrom

236-parallelize-autosort-processing

Nov 27, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: Parallelize electrode processing with multiprocessing#256

feat: Parallelize electrode processing with multiprocessing#256
abuzarmahmood merged 27 commits intomasterfrom
236-parallelize-autosort-processing

Commits on Nov 21, 2024

feat: Parallelize electrode processing with multiprocessing

Fix metadata getting logic for saving units

Commits on Nov 22, 2024

feat: Add script to toggle waveform classifier parameter in params file

refactor: Simplify spike_emg_test by extracting spike test logic into run_spike_test function

feat: Add jetstream bash runs with and without waveform classifier

Commits on Nov 25, 2024

feat: Add --delete-log flag to force deletion of results.log

Add --delete-log flag to force log deletion in blech_run_process

Write out sorting table during pipeline testing

Update workflow to have concurrency groups

Update workflow to have concurrency groups

Merge branch '236-parallelize-autosort-processing' of https://github.com/katzlabbrandeis/blech_clust into 236-parallelize-autosort-processing

Fix bug in blech_process if not using classifier

Also add concurency group to preamble

feat: Add electrode processing log with start/end timestamps and status tracking

Commits on Nov 26, 2024

Check arguments into blech_process.py

feat: Add log completion status check to blech_run_process.sh

feat: Add script to toggle auto clustering and post-processing parameters

refactor: Update toggle_auto_params to use dynamic params file path

feat: Add toggle_auto_params.py for pipeline testing configuration

feat: Add command-line arguments to set auto clustering parameters explicitly

Working version of multiprocess autosort with 1) autosort testing, 2) detecting multiple units, 3) bug fixes

Add max_parallel_cpu to parallel autosort

Add file to change auto-sorting + auto-post-processing params

Fix bugs in testing auto-sorting

Update change_auto_params.py to use data dir

Update prefect_pipeline.py to direct auto params changer to data dir

Commits on Nov 27, 2024

Fix bug in

feat: Parallelize electrode processing with multiprocessing#256abuzarmahmood merged 27 commits intomasterkatzlabbrandeis/blech_clust:masterfrom 236-parallelize-autosort-processingkatzlabbrandeis/blech_clust:236-parallelize-autosort-processingCopy head branch name to clipboard

Commits

Commits on Nov 21, 2024

Commits on Nov 22, 2024

Commits on Nov 25, 2024

Commits on Nov 26, 2024

Commits on Nov 27, 2024

feat: Parallelize electrode processing with multiprocessing#256
abuzarmahmood merged 27 commits intomasterfrom
236-parallelize-autosort-processing