Skip to content

Conversation

abuzarmahmood
Copy link
Member

No description provided.

@abuzarmahmood abuzarmahmood linked an issue Nov 23, 2024 that may be closed by this pull request
@abuzarmahmood
Copy link
Member Author

Issue with autosorting multiprocessing...likely due to the fact that by the time the check to see if the directory is there, and by the time it is created, another process has ended up creating the directory.
This step can just be removed from the parallel part

Traceback (most recent call last):
  File "blech_post_process.py", line 462, in <module>
    result = pool.starmap(
  File "/home/exouser/anaconda3/envs/blech_clust/lib/python3.8/multiprocessing/pool.py", line 372, in starmap
    return self._map_async(func, iterable, starmapstar, chunksize).get()
  File "/home/exouser/anaconda3/envs/blech_clust/lib/python3.8/multiprocessing/pool.py", line 771, in get
    raise self._value
  File "/home/exouser/anaconda3/envs/blech_clust/lib/python3.8/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/home/exouser/anaconda3/envs/blech_clust/lib/python3.8/multiprocessing/pool.py", line 51, in starmapstar
    return list(itertools.starmap(args[0], args[1]))
  File "/home/exouser/Desktop/blech_clust/utils/blech_post_process_utils.py", line 1499, in auto_process_electrode
    gen_autosort_plot(
  File "/home/exouser/Desktop/blech_clust/utils/blech_post_process_utils.py", line 1059, in gen_autosort_plot
    os.makedirs(autosort_output_dir)
  File "/home/exouser/anaconda3/envs/blech_clust/lib/python3.8/os.py", line 223, in makedirs
    mkdir(name, mode)
FileExistsError: [Errno 17] File exists: '/home/exouser/Desktop/blech_clust/pipeline_testing/test_data_handling/test_data/KM45_5tastes_210620_113227_new/autosort_outputs'
Closing remaining open files:/home/exouser/Desktop/blech_clust/pipeline_testing/test_data_handling/test_data/KM45_5tastes_210620_113227_new/KM45_5tastes_210620_113227_new.h5...done

@abuzarmahmood
Copy link
Member Author

Adds following plot to QA output

pca_umap_firing_rates

Copy link
Collaborator

@hfgem hfgem left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@abuzarmahmood abuzarmahmood merged commit 08a3855 into master Dec 6, 2024
4 checks passed
@abuzarmahmood abuzarmahmood deleted the 214-improved-drift-plot1d-visualization branch December 6, 2024 20:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Improved drift plot...1D visualization
2 participants