Issues

• Inquire about the open-source timeline of mcp-altas

  scaleapi/llm-engine#728 · Filter by author SinonH opened on Nov 12, 2025

• ⚠️ Notice: sunsetting the public demo of LLM Engine ⚠️

  scaleapi/llm-engine#619 · Filter by author yixu34 opened on Sep 23, 2024

• Fine-Tuning LLM using Local GPU and Infra

  scaleapi/llm-engine#477 · Filter by author Sree-abcprocure opened on Mar 28, 2024
  1

  

• self host on runnpod

  scaleapi/llm-engine#285 · Filter by author Stealthwriter opened on Sep 21, 2023
  1

• Control frequency - completion

  scaleapi/llm-engine#277 · Filter by author Stealthwriter opened on Sep 14, 2023
  3

• max token length for finetune and completion endpoints on Lllama-2?

  scaleapi/llm-engine#208 · Filter by author urimerhav opened on Aug 12, 2023
  2

  

• [Feature Request] support InternLM

  scaleapi/llm-engine#206 · Filter by author JimmyMa99 opened on Aug 9, 2023
  1

  

• [Tokenizer] Allow for custom tokens/tokenizer

  scaleapi/llm-engine#164 · Filter by author sam-scale opened on Jul 24, 2023
  1

• [Checkpointing] Allow users to save/use multiple checkpoints

  scaleapi/llm-engine#162 · Filter by author sam-scale opened on Jul 24, 2023

• Create guide for how to deploy an existing Hugging Face model on self-hosted LLM Engine

  documentationenhancement
  scaleapi/llm-engine#141 · Filter by author rkaplan opened on Jul 19, 2023
  2

  

• Discuss: Chat API with a "session" with the client caching messages to make usage more ergonomic

  scaleapi/llm-engine#139 · Filter by author acmatscale opened on Jul 19, 2023
  

• Comparison benchmarks?

  scaleapi/llm-engine#138 · Filter by author tripathiarpan20 opened on Jul 19, 2023
  1

  

• Preparing dataset for LLaMa-13b-chat

  documentation
  scaleapi/llm-engine#136 · Filter by author FarziBuilder opened on Jul 19, 2023
  2