Popular repositories Loading

1. aibrix aibrix Public

   Forked from vllm-project/aibrix

   Cost-efficient and pluggable Infrastructure components for GenAI inference

   Go

2. nixl nixl Public

   Forked from ai-dynamo/nixl

   NVIDIA Inference Xfer Library (NIXL)

   C++

3. ucx ucx Public

   Forked from openucx/ucx

   Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)

   C

4. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python