Does SGLang support NVIDIA B300 now? #11604
Unanswered
KwokhoTsui
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi, all.

We tried to serve Deepseek R1 with Sglang with the official b200 docker image: v0.5.2rc1-cu128-b200 but failed with the following error:
It seems that the problem stems from the slightly different compute capabilities between b200 (10.0) and b300 (10.3) (source).
We are wondering are there any plans to officially support NVIDIA B300 GPUs, and is there any advice for us to run Deepseek R1 with Sglang on NVIDIA B300 GPUs.
Beta Was this translation helpful? Give feedback.
All reactions