Pinned Loading

1. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python 1

2. nccl nccl Public

   Forked from NVIDIA/nccl

   Optimized primitives for collective multi-GPU communication

   C++

3. SpecForge SpecForge Public

   Forked from sgl-project/SpecForge

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. kubernetes kubernetes Public

   Forked from kubernetes/kubernetes

   Production-Grade Container Scheduling and Management

   Go

6. koordinator koordinator Public

   Forked from koordinator-sh/koordinator

   A QoS-based scheduling system brings optimal layout and status to workloads such as microservices, web services, big data jobs, AI jobs, etc.

   Go