Skip to content

feat: Parallelize electrode processing with multiprocessing #256

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 27 commits into from
Nov 27, 2024
Merged

feat: Parallelize electrode processing with multiprocessing #256

merged 27 commits into from
Nov 27, 2024

Conversation

abuzarmahmood
Copy link
Member

No description provided.

@abuzarmahmood abuzarmahmood linked an issue Nov 21, 2024 that may be closed by this pull request
Parallelize autosort processing #236
Closed
@abuzarmahmood
Copy link
Member Author

Add test for auto-sorting, and check that it passes

@abuzarmahmood
feat: Add script to toggle waveform classifier parameter in params file
ff5343e
@abuzarmahmood
refactor: Simplify spike_emg_test by extracting spike test logic into…
6aeac80 
… run_spike_test function
@abuzarmahmood
feat: Add jetstream bash runs with and without waveform classifier
777beb9
@abuzarmahmood
feat: Add --delete-log flag to force deletion of results.log
343c225
@abuzarmahmood
Add --delete-log flag to force log deletion in blech_run_process
c33982c
@abuzarmahmood
Write out sorting table during pipeline testing
d7cc48f
@abuzarmahmood
Update workflow to have concurrency groups
8d6d2d9
@abuzarmahmood
Update workflow to have concurrency groups
bcce20f
@abuzarmahmood
Merge branch '236-parallelize-autosort-processing' of https://github.…
6bd798c 
…com/katzlabbrandeis/blech_clust into 236-parallelize-autosort-processing
@abuzarmahmood
Fix bug in blech_process if not using classifier
ee82e09
@abuzarmahmood
Also add concurency group to preamble
593e1ce
@abuzarmahmood
feat: Add electrode processing log with start/end timestamps and stat…
d75c548 
…us tracking
@abuzarmahmood
Check arguments into blech_process.py
dd4ee8e
@abuzarmahmood
feat: Add log completion status check to blech_run_process.sh
fd2ebb3
@abuzarmahmood
feat: Add script to toggle auto clustering and post-processing parame…
bc71186 
…ters
@abuzarmahmood
refactor: Update toggle_auto_params to use dynamic params file path
e9e8879
@abuzarmahmood
feat: Add toggle_auto_params.py for pipeline testing configuration
1c17e6c
@abuzarmahmood
feat: Add command-line arguments to set auto clustering parameters ex…
8e15626 
…plicitly
@abuzarmahmood
Working version of multiprocess autosort with 1) autosort testing, 2)…
37a0ed5 
… detecting multiple units, 3) bug fixes
@abuzarmahmood
Add max_parallel_cpu to parallel autosort
0504a1a
@abuzarmahmood
Add file to change auto-sorting + auto-post-processing params
80ff07d
@abuzarmahmood
Fix bugs in testing auto-sorting
60408b2
@abuzarmahmood
Copy link
Member Author

change_auto_params.py needs to target data sir as params file gets copied over

@abuzarmahmood abuzarmahmood requested review from hfgem and Mraymon5 and removed request for hfgem and Mraymon5 November 27, 2024 02:02
@abuzarmahmood abuzarmahmood merged commit 53182d3 into master Nov 27, 2024
4 checks passed
@abuzarmahmood abuzarmahmood deleted the 236-parallelize-autosort-processing branch November 27, 2024 02:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Parallelize autosort processing
1 participant
@abuzarmahmood