SGLang

Latest news

1. 20 Oct
   Google launches native vLLM and SGLang PyTorch engines on TPU

   Google announced new native PyTorch inference backends for vLLM and SGLang running on TPU, built on a new TorchTPU runtime. The engines include production-ready serving features and custom Pallas kernels to make serving on TPU faster and easier to debug for PyTorch developers.

   Developers · 1 source

   

Articles

No articles about SGLang yet.