Issues

• Allow requesting a service with a specific resource amount allocated

  perk11/large-model-proxy#159 · Filter by author perk11 opened on Sep 20, 2026

• Smarter service stopping - avoid stoppping when it won't achieve target resource amounts, stop less used services.

  perk11/large-model-proxy#158 · Filter by author perk11 opened on Sep 10, 2026

• Determining service based on context size

  perk11/large-model-proxy#153 · Filter by author perk11 opened on Aug 4, 2026

• A universal proxy that sniffs on "model" field of a JSON request

  perk11/large-model-proxy#152 · Filter by author perk11 opened on Aug 4, 2026

• Ability to log the contents of the requests

  perk11/large-model-proxy#151 · Filter by author perk11 opened on Aug 4, 2026

• Do not actually stop the services when all clients diconnected during healthcheck right away

  perk11/large-model-proxy#150 · Filter by author perk11 opened on Aug 4, 2026

• Data race on EOFOnWriteFromServerToClient in forwardConnection

  perk11/large-model-proxy#146 · Filter by author perk11 opened on Jul 29, 2026

• Migrate to signal.NotifyContext

  perk11/large-model-proxy#145 · Filter by author perk11 opened on Jul 28, 2026

• Run tests with the race detector

  perk11/large-model-proxy#144 · Filter by author perk11 opened on Jul 28, 2026

• Fix zombie RunningService

  perk11/large-model-proxy#143 · Filter by author perk11 opened on Jul 28, 2026

• Different color for each service output logs

  perk11/large-model-proxy#124 · Filter by author perk11 opened on Jan 1, 2026

• When client connection is closed, immediately close the service connection

  roadmap
  perk11/large-model-proxy#123 · Filter by author perk11 opened on Jan 1, 2026

• Add a service configuration parameters to restart after X requests

  perk11/large-model-proxy#121 · Filter by author perk11 opened on Dec 27, 2025

• Allow setting minimal time a service has to stay loaded before unload

  roadmap
  perk11/large-model-proxy#120 · Filter by author perk11 opened on Dec 23, 2025

• Config settings for logging Management API and OpenAI API requests

  perk11/large-model-proxy#118 · Filter by author perk11 opened on Dec 22, 2025

• Implement testResourceCheckCommandShouldNotUseAnOutdatedResourceCheckResult

  roadmap
  perk11/large-model-proxy#117 · Filter by author perk11 opened on Dec 22, 2025

• Implement long polling for status API

  perk11/large-model-proxy#115 · Filter by author perk11 opened on Dec 22, 2025

• A closed client connection is not handled while a service is waiting for resources to free up

  roadmap
  perk11/large-model-proxy#112 · Filter by author perk11 opened on Dec 21, 2025

• API for setting available resource amounts

  perk11/large-model-proxy#111 · Filter by author perk11 opened on Dec 19, 2025

• Add "resources used" to the Management API

  perk11/large-model-proxy#110 · Filter by author perk11 opened on Dec 18, 2025

• load/unload API endpoints

  perk11/large-model-proxy#109 · Filter by author perk11 opened on Dec 18, 2025

• First class docker support

  perk11/large-model-proxy#108 · Filter by author perk11 opened on Dec 18, 2025

• Group healtcheck output

  roadmap
  perk11/large-model-proxy#105 · Filter by author perk11 opened on Dec 7, 2025

• Automatic max resource amount detection for each service

  roadmap
  perk11/large-model-proxy#104 · Filter by author perk11 opened on Dec 7, 2025

• Improve handling of being unable to write logs

  low-priority
  perk11/large-model-proxy#100 · Filter by author perk11 opened on Nov 20, 2025