GitHub discussion is not used anymore, please use the forum for discussion.

[youkaichao]

Please enjoy the discussion forum at https://discuss.vllm.ai . See you there!

[byjlw]

why the change?

[gaby]

How is a forum even better? That requires an extra account.

I'm a maintainer in another project, you get notifications when discussions are created.

[endolith]

Why should we need to create a separate account?? There is a Discussions feature built into GitHub....

[hmellor]

Fundamentally, it comes down to separation of concerns:

• the GitHub repo is for vLLM developers
• the forum is for vLLM users

The vLLM maintainers do not have time to handle user queries on GitHub.

---

Additionally, the forum is much more accessible for search engines. The GitHub Discussions were viewed a little over 9k times in October, whereas the Forum was viewed a little over 45k times. The numbers speak for themselves.

[endolith]

GitHub Discussions is for vLLM users to discuss problems among themselves, so they don't clutter up the Issues list with user-level stuff.

[limingde01]

请教下，nv 的orin 平台能vllm支持吗？

[vadimkantorov]

One problem with the forum is that RunLLM responds there without a way to switch it off:
https://discuss.vllm.ai/t/vllm-serve-to-use-all-gpus-of-a-single-node-multi-use/1264/4

It does not even listen when explicitly tell it to not respond. And there is no way to downvote its imperfect responses. At least it would be good to have some way to mention in the post, so that RunLLM would abstain from posting in certain threads.

I'd like to have a place for technical discussion with actual humans (as I'm a human myself).

[hmellor]

This should now be fixed (based on your feedback actually 🎉 ) so now after the first response you must tag RunLLM in order for it to keep responding.

[vadimkantorov]

Is it possible to use some magic word in the OP to prevent from responding? Or maybe somehow make its responses not being counted in the post total count

As other humans can see that "there are some responses already" and even not click on a thread...

[vadimkantorov]

I would maybe propose to keep GH Discussions for kind of "dev forum"... or have a separate place for a "dev forum"/section without automatic RunLLM

[hmellor]

Not that I'm aware of. I can check for you though.

[hmellor]

The feature request has been logged with RunLLM. No timeline yet though.