BrainCLIP: Bridging Brain and Visual-Linguistic Representation Via CLIP for Generic Natural Visual Stimulus Decoding

News

• 2023-09-16 GOD annotations are released.

The code for fMRI embedding guided diffusion is provided. You can change the CLIP visual encoder and using your fMRI embeddings to generate images.

Download Pretrained Diffusion Model from OpenAI by clicking here

Data License

The Datasets are provided to You under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International Public License (“CC BY-NC-SA 4.0”). The CC BY-NC-SA 4.0 may be accessed at https://creativecommons.org/licenses/bync-sa/4.0/legalcode. This dataset is used only for non-commercial purposes such as academic research, teaching, or scientific publications

Citation

@article{liu2023brainclip,
  title={BrainCLIP: Bridging Brain and Visual-Linguistic Representation via CLIP for Generic Natural Visual Stimulus Decoding from fMRI},
  author={Liu, Yulong and Ma, Yongqiang and Zhou, Wei and Zhu, Guibo and Zheng, Nanning},
  journal={arXiv preprint arXiv:2302.12971},
  year={2023}
}