Skip to content

Conversation

laixinn
Copy link
Contributor

@laixinn laixinn commented Mar 24, 2025

Motivation

related issue: #4462
The dsv3 awq issue requires a few PRs to fix, this is a part of it.
MoE wNa16 kernel #4625 requires this AWQ Linear.

Coauthor: @AniZpZ

Modifications

Migrate AWQ Linear from vLLM.

Checklist

@laixinn laixinn force-pushed the awq-linear branch 2 times, most recently from e544eae to 4f8d962 Compare March 24, 2025 10:23
laixinn and others added 2 commits March 24, 2025 18:25
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: AniZpZ <aniz1905@gmail.com>
@AniZpZ AniZpZ mentioned this pull request Mar 26, 2025
6 tasks
@zhyncs zhyncs merged commit ae25d36 into sgl-project:main Mar 27, 2025
9 of 21 checks passed
jimoosciuc pushed a commit to Furion-cn/sglang that referenced this pull request Apr 17, 2025
Co-authored-by: AniZpZ <aniz1905@gmail.com>
@zhyncs zhyncs mentioned this pull request Apr 23, 2025
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants