Skip to content

Conversation

Alcanderian
Copy link
Collaborator

@Alcanderian Alcanderian commented Apr 4, 2025

Motivation

Continuous of #4928
For issue #4353

Modifications

The key difference from vLLM is multi-platform compatibility: our solution can possibly work across different platforms (e.g., CPU/GPU) in one environment, whereas vLLM is restricted to specific setups.

Checklist

@Alcanderian Alcanderian marked this pull request as ready for review April 4, 2025 11:44
@Alcanderian Alcanderian changed the title [Feat] platform auto detection [WIP][Feat] platform auto detection Apr 21, 2025
@Alcanderian
Copy link
Collaborator Author

This folder will become the largest folder if the abstraction is keep going on. Hence it is not a good choice to concentrated platform code here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants