-
-
Notifications
You must be signed in to change notification settings - Fork 10.4k
Document aarch64 CPU support works #22646
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
I tested it recently in a Linux VM on macOS, works great! Although it could do with CI, I see silly bugs creep in sometimes. Signed-off-by: Eric Curtin <[email protected]>
@DarkLight1337 @simon-mo PTAL |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request updates the vLLM V1 guide to document support for the aarch64 CPU architecture. The change modifies the hardware support table, adding aarch64
to the list of supported CPU architectures. This is a straightforward and valuable documentation improvement that accurately reflects the project's capabilities.
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add 🚀 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
cc @mgoin do you know the status of MacOS support?
ARM CI seems pretty simplified these days on github: windows-11-arm |
I do think Vulkan with macOS and MoltenVK (or even in Linux VMs via krunkit) could be really neat. Something that has been discussed with people like @rhatdan, @slp, @airlied , etc. Vulkan solves problems as regards acceleration on a lot of hardware. And performs decently well: https://airlied.blogspot.com/2025/07/ramalamamesa-benchmarks-on-my-hardware.html |
Signed-off-by: Eric Curtin <[email protected]> Signed-off-by: Paul Pak <[email protected]>
Signed-off-by: Eric Curtin <[email protected]> Signed-off-by: Diego-Castan <[email protected]>
Signed-off-by: Eric Curtin <[email protected]>
Signed-off-by: Eric Curtin <[email protected]>
Signed-off-by: Eric Curtin <[email protected]> Signed-off-by: Xiao Yu <[email protected]>
Signed-off-by: Eric Curtin <[email protected]>
I tested it recently in a Linux VM on macOS, works great! Although it could do with CI, I see silly bugs creep in sometimes.