CITATION.cff

cff-version: 1.2.0
message: "If you use forgequant in your work, please cite it as below."
title: forgequant
abstract: "Config-driven asymmetric quantization for DeepSeek-V4-Flash. Turns a small JSON recipe — per-tensor-family quant types, an importance matrix (imatrix), and an optional per-layer expert boost — into a reproducible quantized GGUF with a manifest. Wraps ds4's deepseek4-quantize, its imatrix collection (offline dataset and live capture), and the GGUF expert-layer splicer, and calibrates domain imatrices on real, non-saturated benchmarks fetched through the benchy registry."
type: software
authors:
  - family-names: Borio
    given-names: Andrea
license: MIT
date-released: "2026-06-09"
repository-code: "https://github.com/andreaborio/forgequant"
keywords:
  - quantization
  - mixture-of-experts
  - importance-matrix
  - gguf
  - deepseek
  - llm
  - local-inference
references:
  - type: software
    title: "ds4 / DwarfStar — DeepSeek-V4-Flash inference engine and quantizer"
    authors:
      - family-names: Sanfilippo
        given-names: Salvatore
    notes: "Separate project (antirez). forgequant orchestrates its deepseek4-quantize, ds4 --imatrix-dataset, ds4-server --imatrix-out, and the GGUF expert-layer splicer. All the quantization work is ds4's — cite it directly. See https://github.com/antirez"
  - type: software
    title: "benchy — local LLM benchmark registry and dashboard"
    authors:
      - family-names: Borio
        given-names: Andrea
    notes: "A separate project; the source of the non-saturated benchmarks forgequant calibrates imatrices on (located via $BENCHY_DIR or a ./benchy checkout). https://github.com/andreaborio/benchy"