pegainfer-project

Popular repositories Loading

1. pegainfer pegainfer Public

   Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

   Rust 682 104

2. kern kern Public

   A model-agnostic GPU runtime for shipping models as verified programs.

   Rust 36 3

3. website website Public

   Documentation website for openinfer — Astro Starlight on Cloudflare Workers

   MDX 4 1

4. pegastore pegastore Public

   Placement-aware immutable large-object cache for AI workloads: multi-slot values across GPU / DRAM / SSD, shared across nodes.

   Rust 4

5. DeepGEMM DeepGEMM Public

   Forked from deepseek-ai/DeepGEMM

   DeepGEMM: clean and efficient BLAS kernel library on GPU

   Cuda