Feature Request: Add Support for AMD GPUs #7
Description
Description:
Currently, LLMOne supports NVIDIA GPU, Ascend NPU, Apple Silicon, and other domestic chips. It would be great if it could also support AMD GPUs. This would expand the hardware compatibility of the platform and provide more options for users with AMD GPU-based systems.
Expected Behavior:
After the implementation, users should be able to use LLMOne on systems with AMD GPUs without any issues, and the platform should be able to take advantage of the hardware features of AMD GPUs to provide optimal performance.
Possible Solution:
The development team could look into integrating relevant AMD GPU drivers and optimizing the inference engines for AMD GPUs.