Preview of sgl-project/sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 38.9K Stars
⑂ 10.5K Forks
○ 38.9K Watchers
✖ 6.8K Issues
Python
attention blackwell cuda deepseek diffusion glm gpt-oss inference llama llm minimax moe qwen qwen-image reinforcement-learning transformer vlm wan

Last push:

Created:

Loading additional information…