Skip to content

Releases: BBC-Esq/VectorDB-Plugin

v1.4.1 - cuda/vram/multiprocessing/threading

12 Sep 16:43
fc854e7
Compare
Choose a tag to compare

Properly implemented multithreading/processing to make sure the CUDA/VRAM usage (and the GUI in general) doesn't freeze when creating the vector database nor when querying the database.

Updated pro tip to reflect reliable comments on Discord regarding larger LLMs being helpful for especially technical jargon.

v1.4 - BREAKING changes

06 Sep 13:51
6c99695
Compare
Choose a tag to compare

Significantly revised the code, created new scripts, started using a configuration yaml file, reducing the "global variables," etc.

After much struggling, added a GPU and VRAM usage metrics at the bottom of the GUI so you can see when running! However, the GUI still hangs periodically, which prevents it from updating when you need it most. This will be fixed in a patch in the next day or so.

Comments are welcome. Collaboration is appreciated.

1.3 - added file-type support!

04 Sep 22:53
2741d40
Compare
Choose a tag to compare

Added support for the following file types!

pdf, docx, txt, json, enex, eml, msg, csv, xls, xlsx

Removed placeholder text on gui.

1.2.1 - IMPORTANT

03 Sep 18:48
ba1a7d7
Compare
Choose a tag to compare

IMPORTANT

I addressed the "pandas.core.arrays.arrow.dtype" error, which ChromaDB caused while trying to use/not use the "pandas" library - I'm not 100%. Regardless, it prevented all releases of my program from working - I APOLOGIZE to people who were struggling.

Therefore, I have:

  1. Added "pandas==2.0.3" to the requirements.txt file. This will install pandas 2.0.3 over any other version of pandas that any other library listed in the requirements.txt tries to install.

  2. Confirmed the latest versions of all libraries in requirements.txt work with my program.

  3. Put version numbers after each library in the requirements.txt file that I know work; therefore, only version of libraries that work with my script will be installed.

INSTALLATION instructions remain the same, but if you tried installing in the last 24 hours you'll need to reinstall everything from scratch.

Version 1.2

03 Sep 12:47
49ec375
Compare
Choose a tag to compare

Added Metal/MPS and AMD GPU acceleration.

Revised readme and provided better installation instructions.

Added "check_gpu.py" to allow people to check if they're installed gpu-acceleration correctly.

Version 1.1

30 Aug 04:09
49ec375
Compare
Choose a tag to compare

Significant changes:

  1. Option to select and automatically download multiple embedding models.

  2. Automatically select HuggingFaceInstructEmbeddings or HuggingFaceEmbeddings depending on the embedding models being used.

  3. More useful GUI.