🚀 The feature, motivation and pitch
We're currently working on a PR for adding Aarch64 to vLLM's dashboard. Based on this comment on a pytorch-integration-testing PR it seems there is infrastructure to support wheels for a CPU only build. There should be a linux.arm64.m7g.metal runner ready to use. This runner may also be used for building Aarch64 wheels.
Alternatives
No response
Additional context
No response
Before submitting a new issue...