Delphi >= 12.8 required

[WirrWicht]

Hi, I just wanted to mention this for anyone who stumbles upon this project. As it stands, you need Delphi 12.8 or higher. Delphi 11.x, as far as I can see, breaks on some string literals over 255 characters long. This can be worked out, but I've upgraded to Delphi 12. Unfortunately, earlier Delphi 12 versions lack the TOrderedDictionary class. I don't have access to Delphi 12.8, so I made a few quick additions to get it working. Now I need to try to tackle GPU support on Windows.

[lmbelo]

@WirrWicht do you have a CUDA compatible GPU?

[WirrWicht]

Yes...

[lmbelo]

You can use one of the libraries bellow, depending on your CUDA version:

https://github.com/Embarcadero/llama-cpp-delphi/releases/download/main-b3-d4ec316/cudart-llama-bin-win-cu11.7-x64.zip or
https://github.com/Embarcadero/llama-cpp-delphi/releases/download/main-b3-d4ec316/cudart-llama-bin-win-cu12.4-x64.zip

https://github.com/Embarcadero/llama-cpp-delphi/releases/download/main-b3-d4ec316/llama-main-b4274-7736837-bin-win-cuda-cu11.7-x64.zip
or
https://github.com/Embarcadero/llama-cpp-delphi/releases/download/main-b3-d4ec316/llama-main-b4274-7736837-bin-win-cuda-cu12.4-x64.zip

Test it on CPU first, so you will understand how it works...

Run this sample once:

https://github.com/Embarcadero/llama-cpp-delphi/tree/main/samples/SimpleChatWithDownload

[WirrWicht]

I've already run the SimpleChatWithDownload demo on my CPU. I simply misunderstood your reference to the "Release" section as some kind of release directory within the repository. I'm not really familiar with GitHub and constantly overlook this release section. So I replaced the DLL files, got an interface error (?) on the first attempt, but the problem was somehow resolved. I swear I did not touch anything. But thanks anyway. PS: And the situation became even more confusing when I actually found some DLLs in the repository